[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:13:23 dist-test-slave-gkw7 krb5kdc[21122](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:13:23 dist-test-slave-gkw7 krb5kdc[21122](info): set up 2 sockets
Aug 11 08:13:23 dist-test-slave-gkw7 krb5kdc[21122](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260811 08:13:25.119966 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.264s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:13:25 dist-test-slave-gkw7 krb5kdc[21122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:13:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:13:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:13:25.246649 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:42011
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:39421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:42011
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:25.343873 21143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:25.344125 21143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:25.344172 21143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:25.345335 21143 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:25.345410 21143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:25.345438 21143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:25.345465 21143 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:25.345486 21143 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:13:25.347186 21143 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:39421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:42011
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:42011
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21143
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:25.347488 21143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:25.347729 21143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:25.353576 21149 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:25.353629 21155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:25.353590 21152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:25.353664 21143 server_base.cc:1034] running on GCE node
I20260811 08:13:25.354100 21143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:25.354552 21143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:25.355721 21143 hybrid_clock.cc:648] HybridClock initialized: now 1786436005355721 us; error 48 us; skew 500 ppm
Aug 11 08:13:25 dist-test-slave-gkw7 krb5kdc[21122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436005, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:25.362792 21143 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:13:25.363356 21143 webserver.cc:460] Webserver started at http://127.20.158.190:33801/ using document root <none> and password file <none>
I20260811 08:13:25.363603 21143 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:25.363648 21143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:25.363817 21143 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:25.364980 21143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "3aa35b4f4cfd42b69140f9b56294d07d"
format_stamp: "Formatted at 2026-08-11 08:13:25 on dist-test-slave-gkw7"
server_key: "4c101b9a5b3d881aabf450fddb800957"
server_key_iv: "fa159ef68969988647d3dc82330b6041"
server_key_version: "encryptionkey@0"
I20260811 08:13:25.365360 21143 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "3aa35b4f4cfd42b69140f9b56294d07d"
format_stamp: "Formatted at 2026-08-11 08:13:25 on dist-test-slave-gkw7"
server_key: "4c101b9a5b3d881aabf450fddb800957"
server_key_iv: "fa159ef68969988647d3dc82330b6041"
server_key_version: "encryptionkey@0"
I20260811 08:13:25.366889 21143 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:13:25.367702 21168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:25.367980 21143 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:25.368060 21143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "3aa35b4f4cfd42b69140f9b56294d07d"
format_stamp: "Formatted at 2026-08-11 08:13:25 on dist-test-slave-gkw7"
server_key: "4c101b9a5b3d881aabf450fddb800957"
server_key_iv: "fa159ef68969988647d3dc82330b6041"
server_key_version: "encryptionkey@0"
I20260811 08:13:25.368113 21143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:25.392433 21143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:25.394908 21143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:25.395035 21143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:25.399886 21143 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:42011
I20260811 08:13:25.399959 21246 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:42011 every 8 connection(s)
I20260811 08:13:25.400383 21143 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:13:25.402014 21252 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:25.403821 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 21143
I20260811 08:13:25.403942 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:13:25.404817 21114 external_mini_cluster.cc:1428] Setting key 663a31b07117a23081de7ad7f1aa237d
I20260811 08:13:25.405562 21252 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3aa35b4f4cfd42b69140f9b56294d07d: Bootstrap starting.
I20260811 08:13:25.406286 21252 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3aa35b4f4cfd42b69140f9b56294d07d: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:25.406636 21252 log.cc:824] T 00000000000000000000000000000000 P 3aa35b4f4cfd42b69140f9b56294d07d: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:25.407349 21252 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3aa35b4f4cfd42b69140f9b56294d07d: No bootstrap required, opened a new log
I20260811 08:13:25.408972 21252 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3aa35b4f4cfd42b69140f9b56294d07d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3aa35b4f4cfd42b69140f9b56294d07d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42011 } }
I20260811 08:13:25.409138 21252 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3aa35b4f4cfd42b69140f9b56294d07d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:25.409205 21252 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3aa35b4f4cfd42b69140f9b56294d07d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3aa35b4f4cfd42b69140f9b56294d07d, State: Initialized, Role: FOLLOWER
I20260811 08:13:25.409369 21252 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3aa35b4f4cfd42b69140f9b56294d07d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3aa35b4f4cfd42b69140f9b56294d07d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42011 } }
I20260811 08:13:25.409513 21252 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3aa35b4f4cfd42b69140f9b56294d07d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:13:25.409574 21252 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3aa35b4f4cfd42b69140f9b56294d07d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:13:25.409646 21252 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3aa35b4f4cfd42b69140f9b56294d07d [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:25.410542 21252 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3aa35b4f4cfd42b69140f9b56294d07d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3aa35b4f4cfd42b69140f9b56294d07d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42011 } }
I20260811 08:13:25.410665 21252 leader_election.cc:302] T 00000000000000000000000000000000 P 3aa35b4f4cfd42b69140f9b56294d07d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3aa35b4f4cfd42b69140f9b56294d07d; no voters:
I20260811 08:13:25.410853 21252 leader_election.cc:288] T 00000000000000000000000000000000 P 3aa35b4f4cfd42b69140f9b56294d07d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:13:25.410879 21262 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3aa35b4f4cfd42b69140f9b56294d07d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:25.410995 21262 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3aa35b4f4cfd42b69140f9b56294d07d [term 1 LEADER]: Becoming Leader. State: Replica: 3aa35b4f4cfd42b69140f9b56294d07d, State: Running, Role: LEADER
I20260811 08:13:25.411080 21262 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3aa35b4f4cfd42b69140f9b56294d07d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3aa35b4f4cfd42b69140f9b56294d07d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42011 } }
I20260811 08:13:25.411170 21252 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3aa35b4f4cfd42b69140f9b56294d07d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:25.411517 21262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3aa35b4f4cfd42b69140f9b56294d07d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3aa35b4f4cfd42b69140f9b56294d07d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3aa35b4f4cfd42b69140f9b56294d07d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42011 } } }
I20260811 08:13:25.411602 21262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3aa35b4f4cfd42b69140f9b56294d07d [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:25.411729 21262 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3aa35b4f4cfd42b69140f9b56294d07d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3aa35b4f4cfd42b69140f9b56294d07d. Latest consensus state: current_term: 1 leader_uuid: "3aa35b4f4cfd42b69140f9b56294d07d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3aa35b4f4cfd42b69140f9b56294d07d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42011 } } }
I20260811 08:13:25.411798 21262 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3aa35b4f4cfd42b69140f9b56294d07d [sys.catalog]: This master's current role is: LEADER
W20260811 08:13:25.413172 21287 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3aa35b4f4cfd42b69140f9b56294d07d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:13:25.413245 21287 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:13:25.413304 21270 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:13:25.413506 21270 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:13:25.415045 21270 catalog_manager.cc:1347] Generated new cluster ID: d72fd9570e624fd88c017c5debd1e1e1
I20260811 08:13:25.415102 21270 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:13:25 dist-test-slave-gkw7 krb5kdc[21122](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436005, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:25.423110 21258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:25.406235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34734 (local address 127.20.158.190:42011)
0811 08:13:25.406504 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:25.406515 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:25.406742 (+ 227us) server_negotiation.cc:407] Connection header received
0811 08:13:25.408956 (+ 2214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:25.408962 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:25.409010 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:25.409160 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:25.411088 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:25.412900 (+ 1812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:25.414893 (+ 1993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:25.415477 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:25.415713 (+ 236us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:25.419193 (+ 3480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:25.419197 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:25.419198 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:25.419215 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:25.420949 (+ 1734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:25.421421 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:25.421427 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:25.421427 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:25.421573 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:25.421885 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:25.421886 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:25.421887 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:25.422136 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:25.422315 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:25.422608 (+ 293us) server_negotiation.cc:299] Negotiation successful
0811 08:13:25.422802 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":83,"threads_started":1}
I20260811 08:13:25.430862 21270 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:13:25.431440 21270 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:13:25.437847 21270 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3aa35b4f4cfd42b69140f9b56294d07d: Generated new TSK 0
I20260811 08:13:25.438078 21270 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.158.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
I20260811 08:13:25.471901 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:0
--local_ip_for_outbound_sockets=127.20.158.129
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:42011
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:39421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:25.577482 21297 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:25.577768 21297 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:25.577800 21297 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:25.579152 21297 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:25.579209 21297 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:25.579243 21297 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:13:25.581049 21297 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:39421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:42011
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21297
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:25.581400 21297 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:25.581761 21297 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:25.588039 21304 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:25.588229 21307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:25.588398 21305 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:25.588407 21297 server_base.cc:1034] running on GCE node
I20260811 08:13:25.588639 21297 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:25.588904 21297 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:25.590072 21297 hybrid_clock.cc:648] HybridClock initialized: now 1786436005590055 us; error 28 us; skew 500 ppm
Aug 11 08:13:25 dist-test-slave-gkw7 krb5kdc[21122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436005, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:25.593562 21297 init.cc:377] Logged in from keytab as kudu/127.20.158.129@KRBTEST.COM (short username kudu)
I20260811 08:13:25.594197 21297 webserver.cc:460] Webserver started at http://127.20.158.129:38125/ using document root <none> and password file <none>
I20260811 08:13:25.594508 21297 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:25.594571 21297 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:25.594730 21297 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:25.595956 21297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-0/data/instance:
uuid: "797625a78bda4fa98e144f2b773b607e"
format_stamp: "Formatted at 2026-08-11 08:13:25 on dist-test-slave-gkw7"
server_key: "4575863af7460cc6426ee2c194924bd3"
server_key_iv: "95b0bdbd32a39607391805ce6cb889f6"
server_key_version: "encryptionkey@0"
I20260811 08:13:25.596392 21297 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance:
uuid: "797625a78bda4fa98e144f2b773b607e"
format_stamp: "Formatted at 2026-08-11 08:13:25 on dist-test-slave-gkw7"
server_key: "4575863af7460cc6426ee2c194924bd3"
server_key_iv: "95b0bdbd32a39607391805ce6cb889f6"
server_key_version: "encryptionkey@0"
I20260811 08:13:25.598096 21297 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:13:25.599066 21318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:25.599287 21297 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:25.599383 21297 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "797625a78bda4fa98e144f2b773b607e"
format_stamp: "Formatted at 2026-08-11 08:13:25 on dist-test-slave-gkw7"
server_key: "4575863af7460cc6426ee2c194924bd3"
server_key_iv: "95b0bdbd32a39607391805ce6cb889f6"
server_key_version: "encryptionkey@0"
I20260811 08:13:25.599469 21297 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:25.645052 21297 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:25.647960 21297 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:25.648193 21297 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:25.648600 21297 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:25.648953 21297 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:25.649014 21297 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:25.649060 21297 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:25.649084 21297 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:25.664143 21297 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:41429
I20260811 08:13:25.664192 21499 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:41429 every 8 connection(s)
I20260811 08:13:25.664769 21297 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:13:25.668797 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 21297
I20260811 08:13:25.668927 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance
I20260811 08:13:25.669121 21114 external_mini_cluster.cc:1428] Setting key 6f5fac10dd6c26ec6844c8ebbeb861f9
Aug 11 08:13:25 dist-test-slave-gkw7 krb5kdc[21122](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436005, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:25.678505 21258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:25.665975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:49291 (local address 127.20.158.190:42011)
0811 08:13:25.666062 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:25.666065 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:25.666288 (+ 223us) server_negotiation.cc:407] Connection header received
0811 08:13:25.667097 (+ 809us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:25.667098 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:25.667112 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:25.667196 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:25.668529 (+ 1333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:25.669178 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:25.671164 (+ 1986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:25.671526 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:25.671592 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:25.674820 (+ 3228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:25.674822 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:25.674822 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:25.674832 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:25.676404 (+ 1572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:25.677051 (+ 647us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:25.677052 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:25.677052 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:25.677145 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:25.677630 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:25.677631 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:25.677632 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:25.677785 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:25.677865 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:25.678359 (+ 494us) server_negotiation.cc:299] Negotiation successful
0811 08:13:25.678438 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 08:13:25.678977 21506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:25.665890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42011 (local address 127.20.158.129:49291)
0811 08:13:25.666127 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:25.666171 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:25.666988 (+ 817us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:25.667290 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:25.667295 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:25.668126 (+ 831us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:25.668425 (+ 299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:25.668431 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:25.669310 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:25.669311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:25.671064 (+ 1753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:25.671069 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:25.671607 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:25.671608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:25.671862 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:25.672755 (+ 893us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:25.672764 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:25.674703 (+ 1939us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:25.676513 (+ 1810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:25.676522 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:25.676524 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:25.676952 (+ 428us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:25.677234 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:25.677235 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:25.677235 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:25.677421 (+ 186us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:25.677872 (+ 451us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:25.677895 (+ 23us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:25.678184 (+ 289us) client_negotiation.cc:769] Sending connection context
0811 08:13:25.678317 (+ 133us) client_negotiation.cc:240] Negotiation successful
0811 08:13:25.678589 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":72,"threads_started":1}
I20260811 08:13:25.679626 21500 heartbeater.cc:347] Connected to a master server at 127.20.158.190:42011
I20260811 08:13:25.679730 21500 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:25.679947 21500 heartbeater.cc:511] Master 127.20.158.190:42011 requested a full tablet report, sending...
I20260811 08:13:25.680539 21193 ts_manager.cc:194] Registered new tserver with Master: 797625a78bda4fa98e144f2b773b607e (127.20.158.129:41429)
I20260811 08:13:25.681248 21193 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.129@KRBTEST.COM'} at 127.20.158.129:49291
WARNING: no policy specified for kudu/127.20.158.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
I20260811 08:13:25.702909 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:0
--local_ip_for_outbound_sockets=127.20.158.130
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:42011
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:39421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:25.797721 21510 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:25.797930 21510 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:25.797955 21510 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:25.799010 21510 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:25.799045 21510 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:25.799077 21510 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:13:25.800433 21510 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:39421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:42011
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21510
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:25.800614 21510 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:25.800786 21510 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:13:25.806386 21510 server_base.cc:1034] running on GCE node
W20260811 08:13:25.806324 21524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:25.806345 21523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:25.806345 21529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:25.806877 21510 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:25.807142 21510 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:25.808282 21510 hybrid_clock.cc:648] HybridClock initialized: now 1786436005808273 us; error 33 us; skew 500 ppm
Aug 11 08:13:25 dist-test-slave-gkw7 krb5kdc[21122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436005, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:25.810954 21510 init.cc:377] Logged in from keytab as kudu/127.20.158.130@KRBTEST.COM (short username kudu)
I20260811 08:13:25.811474 21510 webserver.cc:460] Webserver started at http://127.20.158.130:39495/ using document root <none> and password file <none>
I20260811 08:13:25.811712 21510 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:25.811780 21510 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:25.811970 21510 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:25.813227 21510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-1/data/instance:
uuid: "f9cdeb3ef38c47f4a6b325e90ea50005"
format_stamp: "Formatted at 2026-08-11 08:13:25 on dist-test-slave-gkw7"
server_key: "daecffcd9f80b0409416e68f8d73278c"
server_key_iv: "6e59ef75507e924b7f4fe0ccb7420d54"
server_key_version: "encryptionkey@0"
I20260811 08:13:25.813647 21510 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance:
uuid: "f9cdeb3ef38c47f4a6b325e90ea50005"
format_stamp: "Formatted at 2026-08-11 08:13:25 on dist-test-slave-gkw7"
server_key: "daecffcd9f80b0409416e68f8d73278c"
server_key_iv: "6e59ef75507e924b7f4fe0ccb7420d54"
server_key_version: "encryptionkey@0"
I20260811 08:13:25.815038 21510 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 08:13:25.815860 21537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:25.816083 21510 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:13:25.816187 21510 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "f9cdeb3ef38c47f4a6b325e90ea50005"
format_stamp: "Formatted at 2026-08-11 08:13:25 on dist-test-slave-gkw7"
server_key: "daecffcd9f80b0409416e68f8d73278c"
server_key_iv: "6e59ef75507e924b7f4fe0ccb7420d54"
server_key_version: "encryptionkey@0"
I20260811 08:13:25.816272 21510 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:25.832849 21510 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:25.835067 21510 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:25.835273 21510 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:25.835527 21510 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:25.835866 21510 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:25.835927 21510 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:25.835968 21510 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:25.835997 21510 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:25.844254 21510 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:38207
I20260811 08:13:25.844343 21715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:38207 every 8 connection(s)
I20260811 08:13:25.844691 21510 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
I20260811 08:13:25.849336 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 21510
I20260811 08:13:25.849445 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance
I20260811 08:13:25.849684 21114 external_mini_cluster.cc:1428] Setting key f0c6d5e7b5aa9a6abe3ccca5a7590da6
Aug 11 08:13:25 dist-test-slave-gkw7 krb5kdc[21122](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436005, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:25.855353 21258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:25.845665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:34681 (local address 127.20.158.190:42011)
0811 08:13:25.845730 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:25.845732 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:25.845947 (+ 215us) server_negotiation.cc:407] Connection header received
0811 08:13:25.846976 (+ 1029us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:25.846977 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:25.846988 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:25.847044 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:25.847648 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:25.848182 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:25.849177 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:25.849559 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:25.849673 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:25.852197 (+ 2524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:25.852198 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:25.852198 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:25.852207 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:25.853920 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:25.854350 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:25.854351 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:25.854352 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:25.854422 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:25.854669 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:25.854670 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:25.854670 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:25.854812 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:25.854893 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:25.855174 (+ 281us) server_negotiation.cc:299] Negotiation successful
0811 08:13:25.855261 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 08:13:25.855607 21719 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:25.845665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42011 (local address 127.20.158.130:34681)
0811 08:13:25.845817 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:25.845854 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:25.846875 (+ 1021us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:25.847100 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:25.847103 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:25.847370 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:25.847567 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:25.847572 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:25.848267 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:25.848268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:25.849073 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:25.849074 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:25.849672 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:25.849673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:25.849812 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:25.850413 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:25.850424 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:25.852104 (+ 1680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:25.854022 (+ 1918us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:25.854029 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:25.854031 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:25.854270 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:25.854489 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:25.854489 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:25.854489 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:25.854592 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:25.854893 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:25.854901 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:25.855034 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 08:13:25.855139 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 08:13:25.855312 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":85,"threads_started":1}
I20260811 08:13:25.856135 21717 heartbeater.cc:347] Connected to a master server at 127.20.158.190:42011
I20260811 08:13:25.856226 21717 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:25.856427 21717 heartbeater.cc:511] Master 127.20.158.190:42011 requested a full tablet report, sending...
I20260811 08:13:25.856808 21193 ts_manager.cc:194] Registered new tserver with Master: f9cdeb3ef38c47f4a6b325e90ea50005 (127.20.158.130:38207)
I20260811 08:13:25.857143 21193 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.130@KRBTEST.COM'} at 127.20.158.130:34681
WARNING: no policy specified for kudu/127.20.158.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
I20260811 08:13:25.880101 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:0
--local_ip_for_outbound_sockets=127.20.158.131
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:42011
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:39421
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:25.972817 21723 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:25.973024 21723 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:25.973048 21723 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:25.974159 21723 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:25.974197 21723 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:25.974222 21723 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:13:25.975589 21723 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:39421
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:42011
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21723
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:25.975834 21723 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:25.976019 21723 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:25.981240 21738 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:25.981206 21730 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:25.981333 21731 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:25.981729 21723 server_base.cc:1034] running on GCE node
I20260811 08:13:25.981993 21723 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:25.982300 21723 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:25.983476 21723 hybrid_clock.cc:648] HybridClock initialized: now 1786436005983450 us; error 41 us; skew 500 ppm
Aug 11 08:13:25 dist-test-slave-gkw7 krb5kdc[21122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436005, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:25.986132 21723 init.cc:377] Logged in from keytab as kudu/127.20.158.131@KRBTEST.COM (short username kudu)
I20260811 08:13:25.986574 21723 webserver.cc:460] Webserver started at http://127.20.158.131:40093/ using document root <none> and password file <none>
I20260811 08:13:25.986807 21723 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:25.986853 21723 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:25.986987 21723 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:25.988060 21723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-2/data/instance:
uuid: "46fce6c977d7477ebb0a7ed19908f851"
format_stamp: "Formatted at 2026-08-11 08:13:25 on dist-test-slave-gkw7"
server_key: "986e62f0580e83c140aa294b2c62bc39"
server_key_iv: "03fcae27b46840eddde445681ff3df5d"
server_key_version: "encryptionkey@0"
I20260811 08:13:25.988430 21723 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance:
uuid: "46fce6c977d7477ebb0a7ed19908f851"
format_stamp: "Formatted at 2026-08-11 08:13:25 on dist-test-slave-gkw7"
server_key: "986e62f0580e83c140aa294b2c62bc39"
server_key_iv: "03fcae27b46840eddde445681ff3df5d"
server_key_version: "encryptionkey@0"
I20260811 08:13:25.989883 21723 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:13:25.990687 21748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:25.990867 21723 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:25.990978 21723 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "46fce6c977d7477ebb0a7ed19908f851"
format_stamp: "Formatted at 2026-08-11 08:13:25 on dist-test-slave-gkw7"
server_key: "986e62f0580e83c140aa294b2c62bc39"
server_key_iv: "03fcae27b46840eddde445681ff3df5d"
server_key_version: "encryptionkey@0"
I20260811 08:13:25.991052 21723 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:26.009912 21723 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:26.012759 21723 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:26.012964 21723 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:26.013274 21723 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:26.013686 21723 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:26.013744 21723 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:26.013787 21723 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:26.013813 21723 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:26.020838 21723 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:43363
I20260811 08:13:26.020890 21908 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:43363 every 8 connection(s)
I20260811 08:13:26.021224 21723 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
I20260811 08:13:26.026607 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 21723
I20260811 08:13:26.026687 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance
I20260811 08:13:26.026861 21114 external_mini_cluster.cc:1428] Setting key b24448da7224a9eb6a80036106489613
Aug 11 08:13:26 dist-test-slave-gkw7 krb5kdc[21122](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436005, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:26.032742 21258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:26.022039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:59483 (local address 127.20.158.190:42011)
0811 08:13:26.022116 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:26.022119 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:26.022333 (+ 214us) server_negotiation.cc:407] Connection header received
0811 08:13:26.023082 (+ 749us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:26.023084 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:26.023108 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:26.023184 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:26.024296 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:26.024865 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:26.026175 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:26.026411 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:26.026511 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:26.029613 (+ 3102us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:26.029614 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:26.029615 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:26.029625 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:26.031131 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:26.031586 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:26.031587 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:26.031588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:26.031674 (+ 86us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:26.031981 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:26.031982 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:26.031983 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:26.032127 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:26.032210 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:26.032532 (+ 322us) server_negotiation.cc:299] Negotiation successful
0811 08:13:26.032635 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 08:13:26.033044 21911 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:26.022010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42011 (local address 127.20.158.131:59483)
0811 08:13:26.022201 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:26.022248 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:26.022769 (+ 521us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:26.023277 (+ 508us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:26.023282 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:26.023935 (+ 653us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:26.024166 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:26.024172 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:26.024991 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:26.024992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:26.026067 (+ 1075us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:26.026070 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:26.026525 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:26.026526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:26.026714 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:26.027512 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:26.027525 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:26.029456 (+ 1931us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:26.031228 (+ 1772us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:26.031237 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:26.031239 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:26.031495 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:26.031761 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:26.031762 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:26.031762 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:26.031895 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:26.032212 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:26.032221 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:26.032383 (+ 162us) client_negotiation.cc:769] Sending connection context
0811 08:13:26.032506 (+ 123us) client_negotiation.cc:240] Negotiation successful
0811 08:13:26.032699 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":95,"threads_started":1}
I20260811 08:13:26.033659 21909 heartbeater.cc:347] Connected to a master server at 127.20.158.190:42011
I20260811 08:13:26.033761 21909 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:26.033926 21909 heartbeater.cc:511] Master 127.20.158.190:42011 requested a full tablet report, sending...
I20260811 08:13:26.034394 21193 ts_manager.cc:194] Registered new tserver with Master: 46fce6c977d7477ebb0a7ed19908f851 (127.20.158.131:43363)
I20260811 08:13:26.034777 21193 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.131@KRBTEST.COM'} at 127.20.158.131:59483
I20260811 08:13:26.039456 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 08:13:26 dist-test-slave-gkw7 krb5kdc[21122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436006, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 08:13:26 dist-test-slave-gkw7 krb5kdc[21122](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436006, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.158.129@KRBTEST.COM
I20260811 08:13:26.066227 21918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:26.057950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54810 (local address 127.20.158.129:41429)
0811 08:13:26.058130 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:26.058135 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:26.058208 (+ 73us) server_negotiation.cc:407] Connection header received
0811 08:13:26.058270 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:26.058272 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:26.058287 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:26.058395 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:26.058995 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:26.059811 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:26.060570 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:26.060914 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:26.061001 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:26.063337 (+ 2336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:26.063348 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:26.063348 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:26.063356 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:26.064924 (+ 1568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:26.065298 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:26.065307 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:26.065307 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:26.065374 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:26.065628 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:26.065629 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:26.065630 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:26.065784 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:26.065951 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:26.066000 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 08:13:26.066084 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":92,"threads_started":1}
W20260811 08:13:26.066628 21363 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54810
Aug 11 08:13:26 dist-test-slave-gkw7 krb5kdc[21122](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 08:13:26 dist-test-slave-gkw7 krb5kdc[21122](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436006, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.129@KRBTEST.COM
I20260811 08:13:26.092378 21918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:26.084704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54820 (local address 127.20.158.129:41429)
0811 08:13:26.084781 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:26.084784 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:26.084866 (+ 82us) server_negotiation.cc:407] Connection header received
0811 08:13:26.084948 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:26.084948 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:26.084970 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:26.085037 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:26.085703 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:26.086226 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:26.086984 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:26.087198 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:26.087290 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:26.089817 (+ 2527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:26.089818 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:26.089818 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:26.089827 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:26.091280 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:26.091630 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:26.091631 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:26.091632 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:26.091701 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:26.091923 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:26.091924 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:26.091924 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:26.092039 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:26.092162 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:26.092231 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 08:13:26.092305 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 08:13:26.093209 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 21297
I20260811 08:13:26.101598 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 21510
I20260811 08:13:26.122052 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 21723
I20260811 08:13:26.135056 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 21143
2026-08-11T08:13:26Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (2313 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:13:26 dist-test-slave-gkw7 krb5kdc[21930](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:13:26 dist-test-slave-gkw7 krb5kdc[21930](info): set up 2 sockets
Aug 11 08:13:26 dist-test-slave-gkw7 krb5kdc[21930](info): commencing operation
krb5kdc: starting...
W20260811 08:13:27.381227 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.219s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:13:27 dist-test-slave-gkw7 krb5kdc[21930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436007, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:13:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:13:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:13:27.504087 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:33331
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:36561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:33331
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:27.586366 21948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:27.586578 21948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:27.586601 21948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:27.587917 21948 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:27.587965 21948 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:27.587978 21948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:27.587992 21948 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:27.588004 21948 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:13:27.589584 21948 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:36561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:33331
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:33331
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21948
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:27.589839 21948 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:27.590085 21948 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:27.596104 21955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:27.596243 21956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:27.596105 21958 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:27.596596 21948 server_base.cc:1034] running on GCE node
I20260811 08:13:27.596840 21948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:27.597138 21948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:27.598268 21948 hybrid_clock.cc:648] HybridClock initialized: now 1786436007598241 us; error 41 us; skew 500 ppm
Aug 11 08:13:27 dist-test-slave-gkw7 krb5kdc[21930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436007, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:27.600814 21948 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:13:27.601307 21948 webserver.cc:460] Webserver started at http://127.20.158.190:44577/ using document root <none> and password file <none>
I20260811 08:13:27.601574 21948 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:27.601651 21948 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:27.601824 21948 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:27.602900 21948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "81b7930b643c405aae1b48ca65dbbeb9"
format_stamp: "Formatted at 2026-08-11 08:13:27 on dist-test-slave-gkw7"
server_key: "acaec2c3cb1009e399c5edbe932521a3"
server_key_iv: "f68f63754d3bdd5d2f57aefb3032df7f"
server_key_version: "encryptionkey@0"
I20260811 08:13:27.603283 21948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "81b7930b643c405aae1b48ca65dbbeb9"
format_stamp: "Formatted at 2026-08-11 08:13:27 on dist-test-slave-gkw7"
server_key: "acaec2c3cb1009e399c5edbe932521a3"
server_key_iv: "f68f63754d3bdd5d2f57aefb3032df7f"
server_key_version: "encryptionkey@0"
I20260811 08:13:27.604671 21948 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:13:27.605448 21972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:27.605683 21948 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:27.605805 21948 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "81b7930b643c405aae1b48ca65dbbeb9"
format_stamp: "Formatted at 2026-08-11 08:13:27 on dist-test-slave-gkw7"
server_key: "acaec2c3cb1009e399c5edbe932521a3"
server_key_iv: "f68f63754d3bdd5d2f57aefb3032df7f"
server_key_version: "encryptionkey@0"
I20260811 08:13:27.605880 21948 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:27.625910 21948 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:27.627933 21948 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:27.628105 21948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:27.632551 21948 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:33331
I20260811 08:13:27.632594 22059 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:33331 every 8 connection(s)
I20260811 08:13:27.632974 21948 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:13:27.633942 22060 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:27.636351 22060 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81b7930b643c405aae1b48ca65dbbeb9: Bootstrap starting.
I20260811 08:13:27.636978 22060 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 81b7930b643c405aae1b48ca65dbbeb9: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:27.637279 22060 log.cc:824] T 00000000000000000000000000000000 P 81b7930b643c405aae1b48ca65dbbeb9: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:27.638026 22060 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 81b7930b643c405aae1b48ca65dbbeb9: No bootstrap required, opened a new log
I20260811 08:13:27.639097 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 21948
I20260811 08:13:27.639168 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:13:27.639340 21114 external_mini_cluster.cc:1428] Setting key 8684e8e9e13a23c9b3efc794b90f0b89
I20260811 08:13:27.639914 22060 raft_consensus.cc:348] T 00000000000000000000000000000000 P 81b7930b643c405aae1b48ca65dbbeb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81b7930b643c405aae1b48ca65dbbeb9" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 33331 } }
I20260811 08:13:27.640110 22060 raft_consensus.cc:374] T 00000000000000000000000000000000 P 81b7930b643c405aae1b48ca65dbbeb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:27.640151 22060 raft_consensus.cc:729] T 00000000000000000000000000000000 P 81b7930b643c405aae1b48ca65dbbeb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81b7930b643c405aae1b48ca65dbbeb9, State: Initialized, Role: FOLLOWER
I20260811 08:13:27.640285 22060 consensus_queue.cc:260] T 00000000000000000000000000000000 P 81b7930b643c405aae1b48ca65dbbeb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81b7930b643c405aae1b48ca65dbbeb9" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 33331 } }
I20260811 08:13:27.640364 22060 raft_consensus.cc:388] T 00000000000000000000000000000000 P 81b7930b643c405aae1b48ca65dbbeb9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:13:27.640394 22060 raft_consensus.cc:482] T 00000000000000000000000000000000 P 81b7930b643c405aae1b48ca65dbbeb9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:13:27.640450 22060 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 81b7930b643c405aae1b48ca65dbbeb9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:27.641667 22060 raft_consensus.cc:504] T 00000000000000000000000000000000 P 81b7930b643c405aae1b48ca65dbbeb9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81b7930b643c405aae1b48ca65dbbeb9" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 33331 } }
I20260811 08:13:27.641783 22060 leader_election.cc:302] T 00000000000000000000000000000000 P 81b7930b643c405aae1b48ca65dbbeb9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 81b7930b643c405aae1b48ca65dbbeb9; no voters:
I20260811 08:13:27.641968 22060 leader_election.cc:288] T 00000000000000000000000000000000 P 81b7930b643c405aae1b48ca65dbbeb9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:13:27.642001 22068 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 81b7930b643c405aae1b48ca65dbbeb9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:27.642125 22068 raft_consensus.cc:686] T 00000000000000000000000000000000 P 81b7930b643c405aae1b48ca65dbbeb9 [term 1 LEADER]: Becoming Leader. State: Replica: 81b7930b643c405aae1b48ca65dbbeb9, State: Running, Role: LEADER
I20260811 08:13:27.642237 22060 sys_catalog.cc:564] T 00000000000000000000000000000000 P 81b7930b643c405aae1b48ca65dbbeb9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:27.642306 22068 consensus_queue.cc:237] T 00000000000000000000000000000000 P 81b7930b643c405aae1b48ca65dbbeb9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81b7930b643c405aae1b48ca65dbbeb9" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 33331 } }
I20260811 08:13:27.642671 22068 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81b7930b643c405aae1b48ca65dbbeb9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 81b7930b643c405aae1b48ca65dbbeb9. Latest consensus state: current_term: 1 leader_uuid: "81b7930b643c405aae1b48ca65dbbeb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81b7930b643c405aae1b48ca65dbbeb9" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 33331 } } }
I20260811 08:13:27.642782 22068 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81b7930b643c405aae1b48ca65dbbeb9 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:27.642681 22073 sys_catalog.cc:455] T 00000000000000000000000000000000 P 81b7930b643c405aae1b48ca65dbbeb9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "81b7930b643c405aae1b48ca65dbbeb9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "81b7930b643c405aae1b48ca65dbbeb9" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 33331 } } }
I20260811 08:13:27.642944 22073 sys_catalog.cc:458] T 00000000000000000000000000000000 P 81b7930b643c405aae1b48ca65dbbeb9 [sys.catalog]: This master's current role is: LEADER
W20260811 08:13:27.644147 22090 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 81b7930b643c405aae1b48ca65dbbeb9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:13:27.644205 22090 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:13:27.644260 22079 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:13:27.644410 22079 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 08:13:27 dist-test-slave-gkw7 krb5kdc[21930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436007, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:27.647728 22079 catalog_manager.cc:1347] Generated new cluster ID: bd7d1064964548b4a1ce15d00377d78a
I20260811 08:13:27.647785 22079 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:13:27.651238 22067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:27.639910 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60946 (local address 127.20.158.190:33331)
0811 08:13:27.640130 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:27.640141 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:27.640177 (+ 36us) server_negotiation.cc:407] Connection header received
0811 08:13:27.640292 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:27.640300 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:27.640355 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:27.640504 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:27.641442 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:27.642753 (+ 1311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:27.643850 (+ 1097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:27.644452 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:27.644591 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:27.647335 (+ 2744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:27.647338 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:27.647339 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:27.647352 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:27.649370 (+ 2018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:27.649790 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:27.649793 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:27.649793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:27.649904 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:27.650098 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:27.650099 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:27.650099 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:27.650373 (+ 274us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:27.650858 (+ 485us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:27.650926 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 08:13:27.651053 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":103,"threads_started":1}
I20260811 08:13:27.656418 22079 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:13:27.656924 22079 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:13:27.662896 22079 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 81b7930b643c405aae1b48ca65dbbeb9: Generated new TSK 0
I20260811 08:13:27.663053 22079 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.158.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
I20260811 08:13:27.689999 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:0
--local_ip_for_outbound_sockets=127.20.158.129
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:33331
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:36561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:27.773581 22096 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:27.773797 22096 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:27.773821 22096 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:27.775000 22096 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:27.775046 22096 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:27.775074 22096 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:13:27.776593 22096 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:36561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:33331
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22096
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:27.776813 22096 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:27.777032 22096 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:27.782342 22105 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:27.782353 22103 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:27.782361 22102 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:27.782475 22096 server_base.cc:1034] running on GCE node
I20260811 08:13:27.782740 22096 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:27.782987 22096 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:27.784173 22096 hybrid_clock.cc:648] HybridClock initialized: now 1786436007784159 us; error 46 us; skew 500 ppm
Aug 11 08:13:27 dist-test-slave-gkw7 krb5kdc[21930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436007, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:27.786860 22096 init.cc:377] Logged in from keytab as kudu/127.20.158.129@KRBTEST.COM (short username kudu)
I20260811 08:13:27.787362 22096 webserver.cc:460] Webserver started at http://127.20.158.129:43923/ using document root <none> and password file <none>
I20260811 08:13:27.787596 22096 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:27.787669 22096 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:27.787832 22096 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:27.788895 22096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-0/data/instance:
uuid: "ac44a963f5a647d5ab7cc3422e73a776"
format_stamp: "Formatted at 2026-08-11 08:13:27 on dist-test-slave-gkw7"
server_key: "9df244911e94d5abaea5ceba4668de0b"
server_key_iv: "9a28ae96a2b8c85f6f525191c6948121"
server_key_version: "encryptionkey@0"
I20260811 08:13:27.789274 22096 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance:
uuid: "ac44a963f5a647d5ab7cc3422e73a776"
format_stamp: "Formatted at 2026-08-11 08:13:27 on dist-test-slave-gkw7"
server_key: "9df244911e94d5abaea5ceba4668de0b"
server_key_iv: "9a28ae96a2b8c85f6f525191c6948121"
server_key_version: "encryptionkey@0"
I20260811 08:13:27.790711 22096 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:13:27.791478 22117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:27.791646 22096 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:13:27.791749 22096 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "ac44a963f5a647d5ab7cc3422e73a776"
format_stamp: "Formatted at 2026-08-11 08:13:27 on dist-test-slave-gkw7"
server_key: "9df244911e94d5abaea5ceba4668de0b"
server_key_iv: "9a28ae96a2b8c85f6f525191c6948121"
server_key_version: "encryptionkey@0"
I20260811 08:13:27.791832 22096 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:27.804710 22096 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:27.806980 22096 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:27.807144 22096 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:27.807389 22096 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:27.807708 22096 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:27.807742 22096 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:27.807765 22096 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:27.807811 22096 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:27.813621 22096 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:34191
I20260811 08:13:27.813709 22281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:34191 every 8 connection(s)
I20260811 08:13:27.814042 22096 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:13:27.815552 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 22096
I20260811 08:13:27.815649 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance
I20260811 08:13:27.815829 21114 external_mini_cluster.cc:1428] Setting key b7d86ebb34beff81848fe4906c42f421
Aug 11 08:13:27 dist-test-slave-gkw7 krb5kdc[21930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436007, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:27.825126 22067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:27.814881 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:57681 (local address 127.20.158.190:33331)
0811 08:13:27.814946 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:27.814948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:27.815170 (+ 222us) server_negotiation.cc:407] Connection header received
0811 08:13:27.816540 (+ 1370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:27.816541 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:27.816557 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:27.816625 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:27.817612 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:27.818122 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:27.819268 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:27.819603 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:27.819697 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:27.822213 (+ 2516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:27.822215 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:27.822215 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:27.822224 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:27.823655 (+ 1431us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:27.824113 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:27.824114 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:27.824115 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:27.824176 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:27.824454 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:27.824455 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:27.824456 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:27.824573 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:27.824647 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:27.824945 (+ 298us) server_negotiation.cc:299] Negotiation successful
0811 08:13:27.825038 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
WARNING: no policy specified for kudu/127.20.158.130@KRBTEST.COM; defaulting to no policy
I20260811 08:13:27.825335 22285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:27.814853 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:33331 (local address 127.20.158.129:57681)
0811 08:13:27.815036 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:27.815080 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:27.816392 (+ 1312us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:27.816718 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:27.816723 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:27.817138 (+ 415us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:27.817469 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:27.817475 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:27.818215 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:27.818216 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:27.819166 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:27.819168 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:27.819716 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:27.819717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:27.819866 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:27.820383 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:27.820394 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:27.822111 (+ 1717us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:27.823748 (+ 1637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:27.823756 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:27.823758 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:27.824019 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:27.824249 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:27.824250 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:27.824250 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:27.824372 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:27.824650 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:27.824658 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:27.824805 (+ 147us) client_negotiation.cc:769] Sending connection context
0811 08:13:27.824921 (+ 116us) client_negotiation.cc:240] Negotiation successful
0811 08:13:27.825080 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":86,"threads_started":1}
I20260811 08:13:27.825943 22283 heartbeater.cc:347] Connected to a master server at 127.20.158.190:33331
I20260811 08:13:27.826069 22283 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:27.826287 22283 heartbeater.cc:511] Master 127.20.158.190:33331 requested a full tablet report, sending...
I20260811 08:13:27.826844 22003 ts_manager.cc:194] Registered new tserver with Master: ac44a963f5a647d5ab7cc3422e73a776 (127.20.158.129:34191)
I20260811 08:13:27.827463 22003 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.129@KRBTEST.COM'} at 127.20.158.129:57681
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
I20260811 08:13:27.844621 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:0
--local_ip_for_outbound_sockets=127.20.158.130
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:33331
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:36561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:27.928354 22288 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:27.928575 22288 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:27.928598 22288 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:27.929821 22288 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:27.929862 22288 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:27.929889 22288 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:13:27.931370 22288 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:36561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:33331
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22288
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:27.931619 22288 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:27.931857 22288 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:27.936887 22295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:27.936892 22302 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:27.936925 22297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:27.937117 22288 server_base.cc:1034] running on GCE node
I20260811 08:13:27.937318 22288 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:27.937510 22288 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:27.938717 22288 hybrid_clock.cc:648] HybridClock initialized: now 1786436007938705 us; error 29 us; skew 500 ppm
Aug 11 08:13:27 dist-test-slave-gkw7 krb5kdc[21930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436007, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:27.941151 22288 init.cc:377] Logged in from keytab as kudu/127.20.158.130@KRBTEST.COM (short username kudu)
I20260811 08:13:27.941584 22288 webserver.cc:460] Webserver started at http://127.20.158.130:42511/ using document root <none> and password file <none>
I20260811 08:13:27.941804 22288 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:27.941848 22288 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:27.941948 22288 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:27.943113 22288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-1/data/instance:
uuid: "e442e7ba9aca4333b7504ec2b8dbb5ff"
format_stamp: "Formatted at 2026-08-11 08:13:27 on dist-test-slave-gkw7"
server_key: "d2b34cd793456d33a561f11990ea1d36"
server_key_iv: "5f11fd1176feaadbd27234f5db7f295f"
server_key_version: "encryptionkey@0"
I20260811 08:13:27.943439 22288 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance:
uuid: "e442e7ba9aca4333b7504ec2b8dbb5ff"
format_stamp: "Formatted at 2026-08-11 08:13:27 on dist-test-slave-gkw7"
server_key: "d2b34cd793456d33a561f11990ea1d36"
server_key_iv: "5f11fd1176feaadbd27234f5db7f295f"
server_key_version: "encryptionkey@0"
I20260811 08:13:27.944849 22288 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:13:27.945492 22316 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:27.945688 22288 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:13:27.945768 22288 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "e442e7ba9aca4333b7504ec2b8dbb5ff"
format_stamp: "Formatted at 2026-08-11 08:13:27 on dist-test-slave-gkw7"
server_key: "d2b34cd793456d33a561f11990ea1d36"
server_key_iv: "5f11fd1176feaadbd27234f5db7f295f"
server_key_version: "encryptionkey@0"
I20260811 08:13:27.945820 22288 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:27.959018 22288 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:27.960891 22288 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:27.960999 22288 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:27.961169 22288 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:27.961426 22288 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:27.961458 22288 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:27.961479 22288 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:27.961493 22288 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:27.967746 22288 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:44467
I20260811 08:13:27.967788 22468 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:44467 every 8 connection(s)
I20260811 08:13:27.968106 22288 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
I20260811 08:13:27.969964 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 22288
I20260811 08:13:27.970041 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance
I20260811 08:13:27.970207 21114 external_mini_cluster.cc:1428] Setting key f89966fdb96f47198f4bdb33bac0371c
Aug 11 08:13:27 dist-test-slave-gkw7 krb5kdc[21930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436007, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:27.978976 22067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:27.968867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:50035 (local address 127.20.158.190:33331)
0811 08:13:27.968950 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:27.968952 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:27.969102 (+ 150us) server_negotiation.cc:407] Connection header received
0811 08:13:27.970157 (+ 1055us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:27.970159 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:27.970172 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:27.970223 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:27.970994 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:27.971497 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:27.972540 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:27.972818 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:27.972880 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:27.975666 (+ 2786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:27.975668 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:27.975668 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:27.975675 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:27.977406 (+ 1731us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:27.977867 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:27.977868 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:27.977869 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:27.977936 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:27.978190 (+ 254us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:27.978191 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:27.978191 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:27.978346 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:27.978417 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:27.978756 (+ 339us) server_negotiation.cc:299] Negotiation successful
0811 08:13:27.978857 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260811 08:13:27.978988 22472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:27.968778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:33331 (local address 127.20.158.130:50035)
0811 08:13:27.968977 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:27.969016 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:27.970052 (+ 1036us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:27.970313 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:27.970319 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:27.970648 (+ 329us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:27.970894 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:27.970901 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:27.971596 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:27.971598 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:27.972425 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:27.972427 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:27.972907 (+ 480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:27.972908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:27.973071 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:27.973629 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:27.973639 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:27.975553 (+ 1914us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:27.977506 (+ 1953us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:27.977512 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:27.977514 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:27.977788 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:27.978007 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:27.978008 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:27.978008 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:27.978112 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:27.978411 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:27.978415 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:27.978576 (+ 161us) client_negotiation.cc:769] Sending connection context
0811 08:13:27.978687 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 08:13:27.978826 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":107,"threads_started":1}
I20260811 08:13:27.979584 22470 heartbeater.cc:347] Connected to a master server at 127.20.158.190:33331
I20260811 08:13:27.979697 22470 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:27.979880 22470 heartbeater.cc:511] Master 127.20.158.190:33331 requested a full tablet report, sending...
I20260811 08:13:27.980300 22003 ts_manager.cc:194] Registered new tserver with Master: e442e7ba9aca4333b7504ec2b8dbb5ff (127.20.158.130:44467)
WARNING: no policy specified for kudu/127.20.158.131@KRBTEST.COM; defaulting to no policy
I20260811 08:13:27.980806 22003 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.130@KRBTEST.COM'} at 127.20.158.130:50035
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
I20260811 08:13:27.998430 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:0
--local_ip_for_outbound_sockets=127.20.158.131
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:33331
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:36561
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:28.083737 22479 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:28.083945 22479 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:28.083969 22479 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:28.085063 22479 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:28.085098 22479 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:28.085124 22479 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:13:28.086583 22479 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:36561
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:33331
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22479
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:28.086771 22479 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:28.086951 22479 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:28.092550 22486 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:28.092587 22487 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:28.092589 22489 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:28.092969 22479 server_base.cc:1034] running on GCE node
I20260811 08:13:28.093215 22479 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:28.093443 22479 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:28.094604 22479 hybrid_clock.cc:648] HybridClock initialized: now 1786436008094582 us; error 38 us; skew 500 ppm
Aug 11 08:13:28 dist-test-slave-gkw7 krb5kdc[21930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436008, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:28.097627 22479 init.cc:377] Logged in from keytab as kudu/127.20.158.131@KRBTEST.COM (short username kudu)
I20260811 08:13:28.098168 22479 webserver.cc:460] Webserver started at http://127.20.158.131:44919/ using document root <none> and password file <none>
I20260811 08:13:28.098397 22479 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:28.098443 22479 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:28.098544 22479 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:28.099658 22479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-2/data/instance:
uuid: "82c20ffea8df485391e0afab051771ee"
format_stamp: "Formatted at 2026-08-11 08:13:28 on dist-test-slave-gkw7"
server_key: "d769b0c3b300ae038da6a4bd7a7c4f8e"
server_key_iv: "1379e4100455ddb8798e5ca11ce1698a"
server_key_version: "encryptionkey@0"
I20260811 08:13:28.099993 22479 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance:
uuid: "82c20ffea8df485391e0afab051771ee"
format_stamp: "Formatted at 2026-08-11 08:13:28 on dist-test-slave-gkw7"
server_key: "d769b0c3b300ae038da6a4bd7a7c4f8e"
server_key_iv: "1379e4100455ddb8798e5ca11ce1698a"
server_key_version: "encryptionkey@0"
I20260811 08:13:28.101449 22479 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:13:28.102427 22498 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:28.102634 22479 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:28.102739 22479 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "82c20ffea8df485391e0afab051771ee"
format_stamp: "Formatted at 2026-08-11 08:13:28 on dist-test-slave-gkw7"
server_key: "d769b0c3b300ae038da6a4bd7a7c4f8e"
server_key_iv: "1379e4100455ddb8798e5ca11ce1698a"
server_key_version: "encryptionkey@0"
I20260811 08:13:28.102803 22479 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:28.126478 22479 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:28.129220 22479 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:28.129355 22479 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:28.129645 22479 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:28.129957 22479 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:28.129993 22479 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:28.130023 22479 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:28.130046 22479 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:28.136711 22479 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:35979
I20260811 08:13:28.136792 22676 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:35979 every 8 connection(s)
I20260811 08:13:28.137149 22479 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
Aug 11 08:13:28 dist-test-slave-gkw7 krb5kdc[21930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436008, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:28.144407 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 22479
I20260811 08:13:28.144531 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance
I20260811 08:13:28.144743 21114 external_mini_cluster.cc:1428] Setting key fd439ae9992a8429a78c8e97505665a4
I20260811 08:13:28.147989 22067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:28.138018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:35489 (local address 127.20.158.190:33331)
0811 08:13:28.138092 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:28.138095 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:28.138365 (+ 270us) server_negotiation.cc:407] Connection header received
0811 08:13:28.139422 (+ 1057us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:28.139423 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:28.139434 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:28.139494 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:28.140159 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.140683 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.141954 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.142216 (+ 262us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.142321 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:28.145008 (+ 2687us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:28.145010 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:28.145010 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:28.145019 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:28.146526 (+ 1507us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:28.146982 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:28.146983 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:28.146984 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:28.147050 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:28.147322 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:28.147323 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:28.147324 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:28.147442 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:28.147521 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:28.147812 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 08:13:28.147902 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 08:13:28.148195 22681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:28.138004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:33331 (local address 127.20.158.131:35489)
0811 08:13:28.138219 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:28.138270 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:28.139292 (+ 1022us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:28.139554 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:28.139558 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:28.139835 (+ 277us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:28.140049 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:28.140053 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.140776 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.140777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:28.141838 (+ 1061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:28.141842 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.142333 (+ 491us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.142335 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:28.142514 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:28.143221 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:28.143229 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:28.144911 (+ 1682us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:28.146659 (+ 1748us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:28.146665 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:28.146668 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:28.146900 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:28.147124 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:28.147125 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:28.147126 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:28.147246 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:28.147518 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:28.147526 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:28.147668 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 08:13:28.147777 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 08:13:28.147933 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":118,"threads_started":1}
I20260811 08:13:28.148739 22678 heartbeater.cc:347] Connected to a master server at 127.20.158.190:33331
I20260811 08:13:28.148836 22678 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:28.149049 22678 heartbeater.cc:511] Master 127.20.158.190:33331 requested a full tablet report, sending...
I20260811 08:13:28.149475 22003 ts_manager.cc:194] Registered new tserver with Master: 82c20ffea8df485391e0afab051771ee (127.20.158.131:35979)
I20260811 08:13:28.149890 22003 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.131@KRBTEST.COM'} at 127.20.158.131:35489
I20260811 08:13:28.156617 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:13:28.164752 22067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:28.158304 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60954 (local address 127.20.158.190:33331)
0811 08:13:28.158364 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:28.158366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:28.158523 (+ 157us) server_negotiation.cc:407] Connection header received
0811 08:13:28.158572 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:28.158573 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:28.158583 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:28.158632 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:28.159205 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.159721 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.160555 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.160770 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.160832 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:28.162189 (+ 1357us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:28.162191 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:28.162191 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:28.162197 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:28.163706 (+ 1509us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:28.164044 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:28.164045 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:28.164045 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:28.164097 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:28.164277 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:28.164278 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:28.164278 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:28.164411 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:28.164486 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:28.164580 (+ 94us) server_negotiation.cc:299] Negotiation successful
0811 08:13:28.164654 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 08:13:28.167105 22003 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60954:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:13:28.168675 22003 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:13:28.175745 22697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:28.171362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:44467 (local address 127.0.0.1:44926)
0811 08:13:28.171557 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:28.171598 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:28.171668 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:28.172204 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:28.172205 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:28.172208 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:28.172261 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:28.172263 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.173707 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.173708 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:28.174744 (+ 1036us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:28.174745 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.175431 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.175432 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:28.175514 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:28.175530 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 08:13:28.175600 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 08:13:28.175657 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":87,"threads_started":1}
I20260811 08:13:28.175819 22698 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:28.171410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:34191 (local address 127.0.0.1:34826)
0811 08:13:28.171735 (+ 325us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:28.171747 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:28.171800 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:28.172056 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:28.172059 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:28.172061 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:28.172136 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:28.172140 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.173262 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.173263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:28.174562 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:28.174565 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.175564 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.175565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:28.175632 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:28.175635 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:13:28.175684 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 08:13:28.175715 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":304,"thread_start_us":92,"threads_started":1}
I20260811 08:13:28.175832 22701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:28.171550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34826 (local address 127.20.158.129:34191)
0811 08:13:28.171783 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:28.171787 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:28.171798 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:13:28.171879 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:28.171881 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:28.171893 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:28.171986 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:28.172254 (+ 268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.173115 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.174653 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.175483 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.175565 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:28.175631 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:28.175699 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 08:13:28.175744 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":203,"thread_start_us":110,"threads_started":1}
I20260811 08:13:28.176069 22699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:28.171510 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44926 (local address 127.20.158.130:44467)
0811 08:13:28.172024 (+ 514us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:28.172028 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:28.172039 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:13:28.172087 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:28.172089 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:28.172102 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:28.172205 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:28.172365 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.173596 (+ 1231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.174840 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.175341 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.175431 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:28.175493 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:28.175951 (+ 458us) server_negotiation.cc:299] Negotiation successful
0811 08:13:28.175995 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":480,"thread_start_us":103,"threads_started":1}
I20260811 08:13:28.176925 22703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:28.171618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:35979 (local address 127.0.0.1:59586)
0811 08:13:28.172330 (+ 712us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:28.172341 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:28.172397 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:28.172710 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:28.172711 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:28.172713 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:28.172758 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:28.172759 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.174048 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.174049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:28.175353 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:28.175356 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.176662 (+ 1306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.176663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:28.176729 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:28.176733 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:13:28.176797 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 08:13:28.176841 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":690,"thread_start_us":58,"threads_started":1}
I20260811 08:13:28.176950 22705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:28.171797 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59586 (local address 127.20.158.131:35979)
0811 08:13:28.171970 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:28.171977 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:28.172465 (+ 488us) server_negotiation.cc:407] Connection header received
0811 08:13:28.172513 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:28.172515 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:28.172532 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:28.172620 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:28.172837 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.173937 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.175467 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.176490 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.176568 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:28.176622 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:28.176829 (+ 207us) server_negotiation.cc:299] Negotiation successful
0811 08:13:28.176880 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":98,"threads_started":1}
I20260811 08:13:28.176856 22187 tablet_service.cc:1467] Processing CreateTablet for tablet 75d4795af20c4a99973e6c75caa29f6a (DEFAULT_TABLE table=test-table [id=5bd596fb88ad434aba5caa3bed31a8a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:28.176856 22374 tablet_service.cc:1467] Processing CreateTablet for tablet 75d4795af20c4a99973e6c75caa29f6a (DEFAULT_TABLE table=test-table [id=5bd596fb88ad434aba5caa3bed31a8a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:28.177224 22374 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75d4795af20c4a99973e6c75caa29f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:28.177225 22187 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75d4795af20c4a99973e6c75caa29f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:28.180071 22707 tablet_bootstrap.cc:492] T 75d4795af20c4a99973e6c75caa29f6a P e442e7ba9aca4333b7504ec2b8dbb5ff: Bootstrap starting.
I20260811 08:13:28.180013 22706 tablet_bootstrap.cc:492] T 75d4795af20c4a99973e6c75caa29f6a P ac44a963f5a647d5ab7cc3422e73a776: Bootstrap starting.
I20260811 08:13:28.180931 22707 tablet_bootstrap.cc:654] T 75d4795af20c4a99973e6c75caa29f6a P e442e7ba9aca4333b7504ec2b8dbb5ff: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:28.180922 22562 tablet_service.cc:1467] Processing CreateTablet for tablet 75d4795af20c4a99973e6c75caa29f6a (DEFAULT_TABLE table=test-table [id=5bd596fb88ad434aba5caa3bed31a8a8]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:28.181072 22706 tablet_bootstrap.cc:654] T 75d4795af20c4a99973e6c75caa29f6a P ac44a963f5a647d5ab7cc3422e73a776: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:28.181314 22562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 75d4795af20c4a99973e6c75caa29f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:28.181973 22706 log.cc:824] T 75d4795af20c4a99973e6c75caa29f6a P ac44a963f5a647d5ab7cc3422e73a776: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:28.182961 22706 tablet_bootstrap.cc:492] T 75d4795af20c4a99973e6c75caa29f6a P ac44a963f5a647d5ab7cc3422e73a776: No bootstrap required, opened a new log
I20260811 08:13:28.183041 22706 ts_tablet_manager.cc:1397] T 75d4795af20c4a99973e6c75caa29f6a P ac44a963f5a647d5ab7cc3422e73a776: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 08:13:28.183377 22707 log.cc:824] T 75d4795af20c4a99973e6c75caa29f6a P e442e7ba9aca4333b7504ec2b8dbb5ff: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:28.184356 22707 tablet_bootstrap.cc:492] T 75d4795af20c4a99973e6c75caa29f6a P e442e7ba9aca4333b7504ec2b8dbb5ff: No bootstrap required, opened a new log
I20260811 08:13:28.184448 22707 ts_tablet_manager.cc:1397] T 75d4795af20c4a99973e6c75caa29f6a P e442e7ba9aca4333b7504ec2b8dbb5ff: Time spent bootstrapping tablet: real 0.004s user 0.004s sys 0.000s
I20260811 08:13:28.185132 22712 tablet_bootstrap.cc:492] T 75d4795af20c4a99973e6c75caa29f6a P 82c20ffea8df485391e0afab051771ee: Bootstrap starting.
I20260811 08:13:28.185650 22706 raft_consensus.cc:348] T 75d4795af20c4a99973e6c75caa29f6a P ac44a963f5a647d5ab7cc3422e73a776 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e442e7ba9aca4333b7504ec2b8dbb5ff" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 44467 } } peers { permanent_uuid: "ac44a963f5a647d5ab7cc3422e73a776" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 34191 } } peers { permanent_uuid: "82c20ffea8df485391e0afab051771ee" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 35979 } }
I20260811 08:13:28.185813 22706 raft_consensus.cc:374] T 75d4795af20c4a99973e6c75caa29f6a P ac44a963f5a647d5ab7cc3422e73a776 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:28.185858 22706 raft_consensus.cc:729] T 75d4795af20c4a99973e6c75caa29f6a P ac44a963f5a647d5ab7cc3422e73a776 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac44a963f5a647d5ab7cc3422e73a776, State: Initialized, Role: FOLLOWER
I20260811 08:13:28.185997 22706 consensus_queue.cc:260] T 75d4795af20c4a99973e6c75caa29f6a P ac44a963f5a647d5ab7cc3422e73a776 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e442e7ba9aca4333b7504ec2b8dbb5ff" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 44467 } } peers { permanent_uuid: "ac44a963f5a647d5ab7cc3422e73a776" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 34191 } } peers { permanent_uuid: "82c20ffea8df485391e0afab051771ee" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 35979 } }
I20260811 08:13:28.186203 22712 tablet_bootstrap.cc:654] T 75d4795af20c4a99973e6c75caa29f6a P 82c20ffea8df485391e0afab051771ee: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:28.186347 22706 ts_tablet_manager.cc:1428] T 75d4795af20c4a99973e6c75caa29f6a P ac44a963f5a647d5ab7cc3422e73a776: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 08:13:28.186393 22283 heartbeater.cc:503] Master 127.20.158.190:33331 was elected leader, sending a full tablet report...
I20260811 08:13:28.186874 22712 log.cc:824] T 75d4795af20c4a99973e6c75caa29f6a P 82c20ffea8df485391e0afab051771ee: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:28.186930 22707 raft_consensus.cc:348] T 75d4795af20c4a99973e6c75caa29f6a P e442e7ba9aca4333b7504ec2b8dbb5ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e442e7ba9aca4333b7504ec2b8dbb5ff" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 44467 } } peers { permanent_uuid: "ac44a963f5a647d5ab7cc3422e73a776" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 34191 } } peers { permanent_uuid: "82c20ffea8df485391e0afab051771ee" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 35979 } }
I20260811 08:13:28.187141 22707 raft_consensus.cc:374] T 75d4795af20c4a99973e6c75caa29f6a P e442e7ba9aca4333b7504ec2b8dbb5ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:28.187196 22707 raft_consensus.cc:729] T 75d4795af20c4a99973e6c75caa29f6a P e442e7ba9aca4333b7504ec2b8dbb5ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e442e7ba9aca4333b7504ec2b8dbb5ff, State: Initialized, Role: FOLLOWER
I20260811 08:13:28.187320 22707 consensus_queue.cc:260] T 75d4795af20c4a99973e6c75caa29f6a P e442e7ba9aca4333b7504ec2b8dbb5ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e442e7ba9aca4333b7504ec2b8dbb5ff" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 44467 } } peers { permanent_uuid: "ac44a963f5a647d5ab7cc3422e73a776" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 34191 } } peers { permanent_uuid: "82c20ffea8df485391e0afab051771ee" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 35979 } }
I20260811 08:13:28.187758 22707 ts_tablet_manager.cc:1428] T 75d4795af20c4a99973e6c75caa29f6a P e442e7ba9aca4333b7504ec2b8dbb5ff: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:13:28.187760 22470 heartbeater.cc:503] Master 127.20.158.190:33331 was elected leader, sending a full tablet report...
I20260811 08:13:28.189281 22712 tablet_bootstrap.cc:492] T 75d4795af20c4a99973e6c75caa29f6a P 82c20ffea8df485391e0afab051771ee: No bootstrap required, opened a new log
I20260811 08:13:28.189344 22712 ts_tablet_manager.cc:1397] T 75d4795af20c4a99973e6c75caa29f6a P 82c20ffea8df485391e0afab051771ee: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.002s
I20260811 08:13:28.190925 22712 raft_consensus.cc:348] T 75d4795af20c4a99973e6c75caa29f6a P 82c20ffea8df485391e0afab051771ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e442e7ba9aca4333b7504ec2b8dbb5ff" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 44467 } } peers { permanent_uuid: "ac44a963f5a647d5ab7cc3422e73a776" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 34191 } } peers { permanent_uuid: "82c20ffea8df485391e0afab051771ee" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 35979 } }
I20260811 08:13:28.191071 22712 raft_consensus.cc:374] T 75d4795af20c4a99973e6c75caa29f6a P 82c20ffea8df485391e0afab051771ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:28.191099 22712 raft_consensus.cc:729] T 75d4795af20c4a99973e6c75caa29f6a P 82c20ffea8df485391e0afab051771ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82c20ffea8df485391e0afab051771ee, State: Initialized, Role: FOLLOWER
I20260811 08:13:28.191187 22712 consensus_queue.cc:260] T 75d4795af20c4a99973e6c75caa29f6a P 82c20ffea8df485391e0afab051771ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e442e7ba9aca4333b7504ec2b8dbb5ff" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 44467 } } peers { permanent_uuid: "ac44a963f5a647d5ab7cc3422e73a776" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 34191 } } peers { permanent_uuid: "82c20ffea8df485391e0afab051771ee" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 35979 } }
I20260811 08:13:28.191440 22712 ts_tablet_manager.cc:1428] T 75d4795af20c4a99973e6c75caa29f6a P 82c20ffea8df485391e0afab051771ee: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:13:28.191445 22678 heartbeater.cc:503] Master 127.20.158.190:33331 was elected leader, sending a full tablet report...
W20260811 08:13:28.218628 22471 tablet.cc:2369] T 75d4795af20c4a99973e6c75caa29f6a P e442e7ba9aca4333b7504ec2b8dbb5ff: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:13:28.296866 22716 raft_consensus.cc:482] T 75d4795af20c4a99973e6c75caa29f6a P 82c20ffea8df485391e0afab051771ee [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:13:28.296998 22716 raft_consensus.cc:504] T 75d4795af20c4a99973e6c75caa29f6a P 82c20ffea8df485391e0afab051771ee [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e442e7ba9aca4333b7504ec2b8dbb5ff" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 44467 } } peers { permanent_uuid: "ac44a963f5a647d5ab7cc3422e73a776" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 34191 } } peers { permanent_uuid: "82c20ffea8df485391e0afab051771ee" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 35979 } }
I20260811 08:13:28.297631 22716 leader_election.cc:288] T 75d4795af20c4a99973e6c75caa29f6a P 82c20ffea8df485391e0afab051771ee [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e442e7ba9aca4333b7504ec2b8dbb5ff (127.20.158.130:44467), ac44a963f5a647d5ab7cc3422e73a776 (127.20.158.129:34191)
I20260811 08:13:28.300511 22681 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:28.297860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:34191 (local address 127.20.158.131:43769)
0811 08:13:28.297925 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:28.297937 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:28.297987 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:28.298141 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:28.298142 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:28.298144 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:28.298224 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:28.298228 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.298883 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.298884 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:28.299662 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:28.299664 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.300236 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.300237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:28.300329 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:28.300332 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:13:28.300395 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 08:13:28.300436 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 08:13:28.300513 22701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:28.297908 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:43769 (local address 127.20.158.129:34191)
0811 08:13:28.297954 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:28.297956 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:28.297968 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:13:28.298058 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:28.298059 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:28.298074 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:28.298136 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:28.298311 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.298801 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.299771 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.300136 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.300236 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:28.300247 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:28.300414 (+ 167us) server_negotiation.cc:299] Negotiation successful
0811 08:13:28.300454 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:13:28.300657 22699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:28.297935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:37143 (local address 127.20.158.130:44467)
0811 08:13:28.297987 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:28.297989 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:28.298182 (+ 193us) server_negotiation.cc:407] Connection header received
0811 08:13:28.298253 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:28.298255 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:28.298264 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:28.298340 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:28.298484 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.298952 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.299898 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.300286 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.300383 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:28.300391 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:28.300547 (+ 156us) server_negotiation.cc:299] Negotiation successful
0811 08:13:28.300597 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:13:28.300657 22717 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:28.297879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:44467 (local address 127.20.158.131:37143)
0811 08:13:28.298100 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:28.298109 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:28.298194 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:28.298341 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:28.298342 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:28.298343 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:28.298423 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:28.298425 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.299039 (+ 614us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.299040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:28.299796 (+ 756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:28.299798 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.300384 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.300385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:28.300468 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:28.300472 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:13:28.300541 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 08:13:28.300580 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":143,"threads_started":1}
I20260811 08:13:28.300992 22220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75d4795af20c4a99973e6c75caa29f6a" candidate_uuid: "82c20ffea8df485391e0afab051771ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac44a963f5a647d5ab7cc3422e73a776" is_pre_election: true
I20260811 08:13:28.301213 22220 raft_consensus.cc:2454] T 75d4795af20c4a99973e6c75caa29f6a P ac44a963f5a647d5ab7cc3422e73a776 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82c20ffea8df485391e0afab051771ee in term 0.
I20260811 08:13:28.301498 22499 leader_election.cc:302] T 75d4795af20c4a99973e6c75caa29f6a P 82c20ffea8df485391e0afab051771ee [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82c20ffea8df485391e0afab051771ee, ac44a963f5a647d5ab7cc3422e73a776; no voters:
I20260811 08:13:28.301676 22716 raft_consensus.cc:2781] T 75d4795af20c4a99973e6c75caa29f6a P 82c20ffea8df485391e0afab051771ee [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:13:28.301751 22716 raft_consensus.cc:482] T 75d4795af20c4a99973e6c75caa29f6a P 82c20ffea8df485391e0afab051771ee [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:13:28.301805 22716 raft_consensus.cc:3037] T 75d4795af20c4a99973e6c75caa29f6a P 82c20ffea8df485391e0afab051771ee [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:28.302778 22716 raft_consensus.cc:504] T 75d4795af20c4a99973e6c75caa29f6a P 82c20ffea8df485391e0afab051771ee [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e442e7ba9aca4333b7504ec2b8dbb5ff" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 44467 } } peers { permanent_uuid: "ac44a963f5a647d5ab7cc3422e73a776" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 34191 } } peers { permanent_uuid: "82c20ffea8df485391e0afab051771ee" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 35979 } }
I20260811 08:13:28.302934 22716 leader_election.cc:288] T 75d4795af20c4a99973e6c75caa29f6a P 82c20ffea8df485391e0afab051771ee [CANDIDATE]: Term 1 election: Requested vote from peers e442e7ba9aca4333b7504ec2b8dbb5ff (127.20.158.130:44467), ac44a963f5a647d5ab7cc3422e73a776 (127.20.158.129:34191)
I20260811 08:13:28.303143 22220 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75d4795af20c4a99973e6c75caa29f6a" candidate_uuid: "82c20ffea8df485391e0afab051771ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac44a963f5a647d5ab7cc3422e73a776"
I20260811 08:13:28.303216 22220 raft_consensus.cc:3037] T 75d4795af20c4a99973e6c75caa29f6a P ac44a963f5a647d5ab7cc3422e73a776 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:28.300992 22404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75d4795af20c4a99973e6c75caa29f6a" candidate_uuid: "82c20ffea8df485391e0afab051771ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e442e7ba9aca4333b7504ec2b8dbb5ff" is_pre_election: true
I20260811 08:13:28.303761 22404 raft_consensus.cc:2454] T 75d4795af20c4a99973e6c75caa29f6a P e442e7ba9aca4333b7504ec2b8dbb5ff [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82c20ffea8df485391e0afab051771ee in term 0.
I20260811 08:13:28.303934 22403 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75d4795af20c4a99973e6c75caa29f6a" candidate_uuid: "82c20ffea8df485391e0afab051771ee" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e442e7ba9aca4333b7504ec2b8dbb5ff"
I20260811 08:13:28.304015 22403 raft_consensus.cc:3037] T 75d4795af20c4a99973e6c75caa29f6a P e442e7ba9aca4333b7504ec2b8dbb5ff [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:28.304009 22220 raft_consensus.cc:2454] T 75d4795af20c4a99973e6c75caa29f6a P ac44a963f5a647d5ab7cc3422e73a776 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82c20ffea8df485391e0afab051771ee in term 1.
I20260811 08:13:28.304159 22499 leader_election.cc:302] T 75d4795af20c4a99973e6c75caa29f6a P 82c20ffea8df485391e0afab051771ee [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82c20ffea8df485391e0afab051771ee, ac44a963f5a647d5ab7cc3422e73a776; no voters:
I20260811 08:13:28.304276 22716 raft_consensus.cc:2781] T 75d4795af20c4a99973e6c75caa29f6a P 82c20ffea8df485391e0afab051771ee [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:28.304453 22716 raft_consensus.cc:686] T 75d4795af20c4a99973e6c75caa29f6a P 82c20ffea8df485391e0afab051771ee [term 1 LEADER]: Becoming Leader. State: Replica: 82c20ffea8df485391e0afab051771ee, State: Running, Role: LEADER
I20260811 08:13:28.304553 22716 consensus_queue.cc:237] T 75d4795af20c4a99973e6c75caa29f6a P 82c20ffea8df485391e0afab051771ee [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e442e7ba9aca4333b7504ec2b8dbb5ff" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 44467 } } peers { permanent_uuid: "ac44a963f5a647d5ab7cc3422e73a776" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 34191 } } peers { permanent_uuid: "82c20ffea8df485391e0afab051771ee" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 35979 } }
I20260811 08:13:28.304940 22403 raft_consensus.cc:2454] T 75d4795af20c4a99973e6c75caa29f6a P e442e7ba9aca4333b7504ec2b8dbb5ff [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82c20ffea8df485391e0afab051771ee in term 1.
I20260811 08:13:28.305683 22002 catalog_manager.cc:5495] T 75d4795af20c4a99973e6c75caa29f6a P 82c20ffea8df485391e0afab051771ee reported cstate change: term changed from 0 to 1, leader changed from <none> to 82c20ffea8df485391e0afab051771ee (127.20.158.131). New cstate: current_term: 1 leader_uuid: "82c20ffea8df485391e0afab051771ee" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e442e7ba9aca4333b7504ec2b8dbb5ff" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 44467 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac44a963f5a647d5ab7cc3422e73a776" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 34191 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82c20ffea8df485391e0afab051771ee" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 35979 } health_report { overall_health: HEALTHY } } }
W20260811 08:13:28.314767 22284 tablet.cc:2369] T 75d4795af20c4a99973e6c75caa29f6a P ac44a963f5a647d5ab7cc3422e73a776: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 08:13:28 dist-test-slave-gkw7 krb5kdc[21930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436007, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.129@KRBTEST.COM
I20260811 08:13:28.326216 22701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:28.318135 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34840 (local address 127.20.158.129:34191)
0811 08:13:28.318229 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:28.318232 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:28.318287 (+ 55us) server_negotiation.cc:407] Connection header received
0811 08:13:28.318367 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:28.318368 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:28.318380 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:28.318452 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:28.319085 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.319557 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.320329 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.320519 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.320595 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:28.323104 (+ 2509us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:28.323114 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:28.323115 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:28.323121 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:28.324779 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:28.325224 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:28.325228 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:28.325228 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:28.325285 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:28.325609 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:28.325611 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:28.325611 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:28.325791 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:28.325917 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:28.326035 (+ 118us) server_negotiation.cc:299] Negotiation successful
0811 08:13:28.326145 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
Aug 11 08:13:28 dist-test-slave-gkw7 krb5kdc[21930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436008, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 08:13:28 dist-test-slave-gkw7 krb5kdc[21930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436008, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.158.129@KRBTEST.COM
I20260811 08:13:28.352180 22701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:28.344399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34854 (local address 127.20.158.129:34191)
0811 08:13:28.344479 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:28.344481 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:28.344536 (+ 55us) server_negotiation.cc:407] Connection header received
0811 08:13:28.344622 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:28.344623 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:28.344633 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:28.344689 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:28.345327 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.345868 (+ 541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.346667 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.346874 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.346932 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:28.349680 (+ 2748us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:28.349681 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:28.349681 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:28.349688 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:28.350986 (+ 1298us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:28.351354 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:28.351355 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:28.351356 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:28.351409 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:28.351595 (+ 186us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:28.351596 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:28.351596 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:28.351705 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:28.351779 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:28.351937 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 08:13:28.352001 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
Aug 11 08:13:28 dist-test-slave-gkw7 krb5kdc[21930](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 08:13:28 dist-test-slave-gkw7 krb5kdc[21930](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436008, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.129@KRBTEST.COM
I20260811 08:13:28.375736 22701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:28.369018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34856 (local address 127.20.158.129:34191)
0811 08:13:28.369088 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:28.369091 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:28.369180 (+ 89us) server_negotiation.cc:407] Connection header received
0811 08:13:28.369259 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:28.369260 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:28.369272 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:28.369342 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:28.369950 (+ 608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.370426 (+ 476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.371166 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:28.371352 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:28.371429 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:28.373629 (+ 2200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:28.373630 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:28.373631 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:28.373637 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:28.374817 (+ 1180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:28.375127 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:28.375128 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:28.375128 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:28.375177 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:28.375341 (+ 164us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:28.375342 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:28.375342 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:28.375425 (+ 83us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:28.375494 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:28.375607 (+ 113us) server_negotiation.cc:299] Negotiation successful
0811 08:13:28.375660 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260811 08:13:28.376232 22159 tablet_service.cc:2908] Rejecting scan request for tablet 75d4795af20c4a99973e6c75caa29f6a: Uninitialized: clean time has not yet been initialized
I20260811 08:13:28.377400 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 22096
W20260811 08:13:28.387820 22679 tablet.cc:2369] T 75d4795af20c4a99973e6c75caa29f6a P 82c20ffea8df485391e0afab051771ee: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:13:28.390220 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 22288
I20260811 08:13:28.400189 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 22479
I20260811 08:13:28.410975 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 21948
2026-08-11T08:13:28Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2274 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:13:28 dist-test-slave-gkw7 krb5kdc[22742](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:13:28 dist-test-slave-gkw7 krb5kdc[22742](info): set up 2 sockets
Aug 11 08:13:28 dist-test-slave-gkw7 krb5kdc[22742](info): commencing operation
krb5kdc: starting...
W20260811 08:13:29.675325 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.239s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:13:29 dist-test-slave-gkw7 krb5kdc[22742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436009, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:13:29Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:13:29Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:13:29.800838 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:43777
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:42599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:43777
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:29.886323 22759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:29.886581 22759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:29.886632 22759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:29.887827 22759 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:29.887904 22759 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 08:13:29.887925 22759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:29.887945 22759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:29.887979 22759 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:29.888007 22759 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:13:29.889518 22759 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:42599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:43777
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:43777
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22759
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:29.889838 22759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:29.890076 22759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:29.895855 22770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:29.895898 22766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:29.895911 22768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:29.896051 22759 server_base.cc:1034] running on GCE node
I20260811 08:13:29.896451 22759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:29.896746 22759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:29.897897 22759 hybrid_clock.cc:648] HybridClock initialized: now 1786436009897871 us; error 37 us; skew 500 ppm
Aug 11 08:13:29 dist-test-slave-gkw7 krb5kdc[22742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436009, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:29.901049 22759 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:13:29.901674 22759 webserver.cc:460] Webserver started at http://127.20.158.190:46189/ using document root <none> and password file <none>
I20260811 08:13:29.901985 22759 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:29.902065 22759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:29.902244 22759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:29.903539 22759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "370c5bcd07dd4aa58b4fc628fcad4582"
format_stamp: "Formatted at 2026-08-11 08:13:29 on dist-test-slave-gkw7"
server_key: "3b7545505d6b6abc62bc06dde9125fcc"
server_key_iv: "8504a908a8e2133d64a8e2f29de57bf3"
server_key_version: "encryptionkey@0"
I20260811 08:13:29.904064 22759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "370c5bcd07dd4aa58b4fc628fcad4582"
format_stamp: "Formatted at 2026-08-11 08:13:29 on dist-test-slave-gkw7"
server_key: "3b7545505d6b6abc62bc06dde9125fcc"
server_key_iv: "8504a908a8e2133d64a8e2f29de57bf3"
server_key_version: "encryptionkey@0"
I20260811 08:13:29.905645 22759 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260811 08:13:29.906626 22779 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:29.906885 22759 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:29.907015 22759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "370c5bcd07dd4aa58b4fc628fcad4582"
format_stamp: "Formatted at 2026-08-11 08:13:29 on dist-test-slave-gkw7"
server_key: "3b7545505d6b6abc62bc06dde9125fcc"
server_key_iv: "8504a908a8e2133d64a8e2f29de57bf3"
server_key_version: "encryptionkey@0"
I20260811 08:13:29.907101 22759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:29.923336 22759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:29.925593 22759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:29.925784 22759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:29.930995 22759 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:43777
I20260811 08:13:29.931056 22871 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:43777 every 8 connection(s)
I20260811 08:13:29.931391 22759 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:13:29.932018 22872 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:29.934454 22872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 370c5bcd07dd4aa58b4fc628fcad4582: Bootstrap starting.
I20260811 08:13:29.935058 22872 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 370c5bcd07dd4aa58b4fc628fcad4582: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:29.935356 22872 log.cc:824] T 00000000000000000000000000000000 P 370c5bcd07dd4aa58b4fc628fcad4582: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:29.936069 22872 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 370c5bcd07dd4aa58b4fc628fcad4582: No bootstrap required, opened a new log
I20260811 08:13:29.936981 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 22759
I20260811 08:13:29.937083 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:13:29.937238 21114 external_mini_cluster.cc:1428] Setting key 115f6f7a7741409648962cf7c33875e6
I20260811 08:13:29.938799 22872 raft_consensus.cc:348] T 00000000000000000000000000000000 P 370c5bcd07dd4aa58b4fc628fcad4582 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "370c5bcd07dd4aa58b4fc628fcad4582" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 43777 } }
I20260811 08:13:29.938966 22872 raft_consensus.cc:374] T 00000000000000000000000000000000 P 370c5bcd07dd4aa58b4fc628fcad4582 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:29.939029 22872 raft_consensus.cc:729] T 00000000000000000000000000000000 P 370c5bcd07dd4aa58b4fc628fcad4582 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 370c5bcd07dd4aa58b4fc628fcad4582, State: Initialized, Role: FOLLOWER
I20260811 08:13:29.939185 22872 consensus_queue.cc:260] T 00000000000000000000000000000000 P 370c5bcd07dd4aa58b4fc628fcad4582 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "370c5bcd07dd4aa58b4fc628fcad4582" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 43777 } }
I20260811 08:13:29.939291 22872 raft_consensus.cc:388] T 00000000000000000000000000000000 P 370c5bcd07dd4aa58b4fc628fcad4582 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:13:29.939339 22872 raft_consensus.cc:482] T 00000000000000000000000000000000 P 370c5bcd07dd4aa58b4fc628fcad4582 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:13:29.939388 22872 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 370c5bcd07dd4aa58b4fc628fcad4582 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:29.939939 22872 raft_consensus.cc:504] T 00000000000000000000000000000000 P 370c5bcd07dd4aa58b4fc628fcad4582 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "370c5bcd07dd4aa58b4fc628fcad4582" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 43777 } }
I20260811 08:13:29.940065 22872 leader_election.cc:302] T 00000000000000000000000000000000 P 370c5bcd07dd4aa58b4fc628fcad4582 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 370c5bcd07dd4aa58b4fc628fcad4582; no voters:
I20260811 08:13:29.940265 22872 leader_election.cc:288] T 00000000000000000000000000000000 P 370c5bcd07dd4aa58b4fc628fcad4582 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:13:29.940295 22878 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 370c5bcd07dd4aa58b4fc628fcad4582 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:29.940405 22878 raft_consensus.cc:686] T 00000000000000000000000000000000 P 370c5bcd07dd4aa58b4fc628fcad4582 [term 1 LEADER]: Becoming Leader. State: Replica: 370c5bcd07dd4aa58b4fc628fcad4582, State: Running, Role: LEADER
I20260811 08:13:29.940546 22872 sys_catalog.cc:564] T 00000000000000000000000000000000 P 370c5bcd07dd4aa58b4fc628fcad4582 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:29.940550 22878 consensus_queue.cc:237] T 00000000000000000000000000000000 P 370c5bcd07dd4aa58b4fc628fcad4582 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "370c5bcd07dd4aa58b4fc628fcad4582" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 43777 } }
I20260811 08:13:29.941023 22879 sys_catalog.cc:455] T 00000000000000000000000000000000 P 370c5bcd07dd4aa58b4fc628fcad4582 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "370c5bcd07dd4aa58b4fc628fcad4582" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "370c5bcd07dd4aa58b4fc628fcad4582" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 43777 } } }
I20260811 08:13:29.941039 22880 sys_catalog.cc:455] T 00000000000000000000000000000000 P 370c5bcd07dd4aa58b4fc628fcad4582 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 370c5bcd07dd4aa58b4fc628fcad4582. Latest consensus state: current_term: 1 leader_uuid: "370c5bcd07dd4aa58b4fc628fcad4582" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "370c5bcd07dd4aa58b4fc628fcad4582" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 43777 } } }
I20260811 08:13:29.941213 22879 sys_catalog.cc:458] T 00000000000000000000000000000000 P 370c5bcd07dd4aa58b4fc628fcad4582 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:29.941227 22880 sys_catalog.cc:458] T 00000000000000000000000000000000 P 370c5bcd07dd4aa58b4fc628fcad4582 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:29.942283 22889 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:13:29.942866 22889 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:13:29.944736 22889 catalog_manager.cc:1347] Generated new cluster ID: 054f340f1fa946e683d221b4fe614a2e
I20260811 08:13:29.944797 22889 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:13:29 dist-test-slave-gkw7 krb5kdc[22742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436009, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:29.949155 22877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:29.937820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46624 (local address 127.20.158.190:43777)
0811 08:13:29.938032 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:29.938043 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:29.938083 (+ 40us) server_negotiation.cc:407] Connection header received
0811 08:13:29.938781 (+ 698us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:29.938789 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:29.938844 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:29.939003 (+ 159us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:29.939837 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:29.941249 (+ 1412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:29.942449 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:29.942847 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:29.943007 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:29.945800 (+ 2793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:29.945804 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:29.945805 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:29.945817 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:29.947530 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:29.947935 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:29.947938 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:29.947938 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:29.948053 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:29.948278 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:29.948279 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:29.948279 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:29.948519 (+ 240us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:29.948725 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:29.948794 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 08:13:29.948941 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":95,"threads_started":1}
I20260811 08:13:29.956828 22889 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:13:29.957453 22889 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:13:29.960718 22889 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 370c5bcd07dd4aa58b4fc628fcad4582: Generated new TSK 0
I20260811 08:13:29.960925 22889 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.158.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
I20260811 08:13:29.992581 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:0
--local_ip_for_outbound_sockets=127.20.158.129
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:43777
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:42599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:30.128494 22909 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:30.128820 22909 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:30.128859 22909 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:30.131029 22909 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:30.131098 22909 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:30.131134 22909 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 08:13:30.131162 22909 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:13:30.133610 22909 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:42599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.158.190:43777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22909
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:30.133891 22909 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:30.134177 22909 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:30.140231 22916 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:30.140306 22919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:30.140461 22909 server_base.cc:1034] running on GCE node
W20260811 08:13:30.140509 22917 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:30.140908 22909 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:30.141245 22909 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:30.142421 22909 hybrid_clock.cc:648] HybridClock initialized: now 1786436010142401 us; error 73 us; skew 500 ppm
Aug 11 08:13:30 dist-test-slave-gkw7 krb5kdc[22742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436010, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:30.146064 22909 init.cc:377] Logged in from keytab as kudu/127.20.158.129@KRBTEST.COM (short username kudu)
I20260811 08:13:30.146591 22909 webserver.cc:460] Webserver started at http://127.20.158.129:44117/ using document root <none> and password file <none>
I20260811 08:13:30.146873 22909 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:30.146956 22909 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:30.147152 22909 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:30.148384 22909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-0/data/instance:
uuid: "e47741f39b5d415e96527a962d15bbc4"
format_stamp: "Formatted at 2026-08-11 08:13:30 on dist-test-slave-gkw7"
server_key: "f91b9baa11fa25a830ece4a03db33fd3"
server_key_iv: "b66352ca119fb70a7cc679a43d1755d4"
server_key_version: "encryptionkey@0"
I20260811 08:13:30.148828 22909 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance:
uuid: "e47741f39b5d415e96527a962d15bbc4"
format_stamp: "Formatted at 2026-08-11 08:13:30 on dist-test-slave-gkw7"
server_key: "f91b9baa11fa25a830ece4a03db33fd3"
server_key_iv: "b66352ca119fb70a7cc679a43d1755d4"
server_key_version: "encryptionkey@0"
I20260811 08:13:30.150657 22909 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.004s sys 0.000s
I20260811 08:13:30.151528 22932 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:30.151757 22909 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:30.151885 22909 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "e47741f39b5d415e96527a962d15bbc4"
format_stamp: "Formatted at 2026-08-11 08:13:30 on dist-test-slave-gkw7"
server_key: "f91b9baa11fa25a830ece4a03db33fd3"
server_key_iv: "b66352ca119fb70a7cc679a43d1755d4"
server_key_version: "encryptionkey@0"
I20260811 08:13:30.151974 22909 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:30.163769 22909 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:30.166657 22909 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:30.166853 22909 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:30.167445 22909 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:30.167514 22909 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:30.167605 22909 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:30.167649 22909 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 08:13:30 dist-test-slave-gkw7 krb5kdc[22742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436010, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:30.176630 22909 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:37953
I20260811 08:13:30.176767 23134 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:37953 every 8 connection(s)
I20260811 08:13:30.177099 22909 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:13:30.179556 22877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.168110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:37263 (local address 127.20.158.190:43777)
0811 08:13:30.168156 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:30.168158 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:30.168425 (+ 267us) server_negotiation.cc:407] Connection header received
0811 08:13:30.168954 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:30.168956 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:30.168978 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:30.169100 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:30.170002 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.170928 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.172584 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.173028 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.173148 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.176279 (+ 3131us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:30.176281 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:30.176281 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:30.176291 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:30.178199 (+ 1908us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:30.178620 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:30.178621 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:30.178621 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:30.178691 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:30.178990 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:30.178991 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:30.178991 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:30.179096 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:30.179147 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:30.179407 (+ 260us) server_negotiation.cc:299] Negotiation successful
0811 08:13:30.179489 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:13:30.179754 22950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.168118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:43777 (local address 127.20.158.129:37263)
0811 08:13:30.168305 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:30.168340 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:30.168840 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:30.169149 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:30.169152 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:30.169524 (+ 372us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:30.169885 (+ 361us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:30.169892 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.171041 (+ 1149us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.171042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:30.172478 (+ 1436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:30.172482 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.173156 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.173157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:30.173356 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.173966 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:30.173976 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:30.176162 (+ 2186us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:30.178302 (+ 2140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:30.178309 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:30.178311 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:30.178543 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:30.178782 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:30.178783 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:30.178783 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:30.178921 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:30.179157 (+ 236us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:30.179162 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:30.179288 (+ 126us) client_negotiation.cc:769] Sending connection context
0811 08:13:30.179381 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 08:13:30.179518 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":111,"threads_started":1}
I20260811 08:13:30.179854 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 22909
I20260811 08:13:30.179960 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance
I20260811 08:13:30.180151 21114 external_mini_cluster.cc:1428] Setting key d331b1803bd00f821ac6ce8a179915f9
I20260811 08:13:30.180369 23135 heartbeater.cc:347] Connected to a master server at 127.20.158.190:43777
I20260811 08:13:30.180497 23135 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:30.180732 23135 heartbeater.cc:511] Master 127.20.158.190:43777 requested a full tablet report, sending...
I20260811 08:13:30.181262 22804 ts_manager.cc:194] Registered new tserver with Master: e47741f39b5d415e96527a962d15bbc4 (127.20.158.129:37953)
I20260811 08:13:30.182204 22804 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.129@KRBTEST.COM'} at 127.20.158.129:37263
I20260811 08:13:30.188658 22877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.181647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:40077 (local address 127.20.158.190:43777)
0811 08:13:30.181694 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:30.181696 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:30.181888 (+ 192us) server_negotiation.cc:407] Connection header received
0811 08:13:30.181968 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:30.181969 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:30.181981 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:30.182043 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:30.182434 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.183262 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.184053 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.184290 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.184374 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.185419 (+ 1045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:30.185421 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:30.185421 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:30.185429 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:30.187344 (+ 1915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:30.187754 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:30.187756 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:30.187756 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:30.187816 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:30.188053 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:30.188054 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:30.188055 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:30.188195 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:30.188283 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:30.188467 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 08:13:30.188555 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:13:30.188673 23142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.181646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:43777 (local address 127.20.158.129:40077)
0811 08:13:30.181785 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:30.181813 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:30.181903 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:30.182048 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:30.182049 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:30.182273 (+ 224us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:30.182362 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:30.182364 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.183368 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.183370 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:30.183943 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:30.183945 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.184371 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.184372 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:30.184456 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.184924 (+ 468us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:30.184929 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:30.185290 (+ 361us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:30.187457 (+ 2167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:30.187458 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:30.187458 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:30.187654 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:30.187910 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:30.187911 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:30.187911 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:30.187980 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:30.188287 (+ 307us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:30.188288 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:30.188342 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 08:13:30.188437 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 08:13:30.188555 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":89,"threads_started":1}
WARNING: no policy specified for kudu/127.20.158.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
I20260811 08:13:30.207999 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:0
--local_ip_for_outbound_sockets=127.20.158.130
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:43777
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:42599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:30.293805 23145 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:30.294006 23145 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:30.294029 23145 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:30.295148 23145 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:30.295187 23145 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:30.295207 23145 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 08:13:30.295224 23145 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:13:30.296615 23145 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:42599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.158.190:43777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23145
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:30.296813 23145 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:30.296983 23145 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:30.302212 23152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:30.302284 23154 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:30.302364 23145 server_base.cc:1034] running on GCE node
W20260811 08:13:30.302229 23157 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:30.302687 23145 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:30.302891 23145 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:30.304109 23145 hybrid_clock.cc:648] HybridClock initialized: now 1786436010304094 us; error 31 us; skew 500 ppm
Aug 11 08:13:30 dist-test-slave-gkw7 krb5kdc[22742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436010, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:30.306718 23145 init.cc:377] Logged in from keytab as kudu/127.20.158.130@KRBTEST.COM (short username kudu)
I20260811 08:13:30.307126 23145 webserver.cc:460] Webserver started at http://127.20.158.130:45219/ using document root <none> and password file <none>
I20260811 08:13:30.307323 23145 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:30.307365 23145 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:30.307457 23145 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:30.308486 23145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-1/data/instance:
uuid: "3c430fcbb43d42adad7584c9e7bdd709"
format_stamp: "Formatted at 2026-08-11 08:13:30 on dist-test-slave-gkw7"
server_key: "39484075decffa7716176f6313877fb7"
server_key_iv: "0ab8df2bf588ff6623a24a6e55c377b3"
server_key_version: "encryptionkey@0"
I20260811 08:13:30.308797 23145 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance:
uuid: "3c430fcbb43d42adad7584c9e7bdd709"
format_stamp: "Formatted at 2026-08-11 08:13:30 on dist-test-slave-gkw7"
server_key: "39484075decffa7716176f6313877fb7"
server_key_iv: "0ab8df2bf588ff6623a24a6e55c377b3"
server_key_version: "encryptionkey@0"
I20260811 08:13:30.310252 23145 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s
I20260811 08:13:30.311064 23167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:30.311262 23145 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:30.311352 23145 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "3c430fcbb43d42adad7584c9e7bdd709"
format_stamp: "Formatted at 2026-08-11 08:13:30 on dist-test-slave-gkw7"
server_key: "39484075decffa7716176f6313877fb7"
server_key_iv: "0ab8df2bf588ff6623a24a6e55c377b3"
server_key_version: "encryptionkey@0"
I20260811 08:13:30.311401 23145 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:30.339882 23145 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:30.342216 23145 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:30.342396 23145 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:30.343048 23145 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:30.343119 23145 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:30.343170 23145 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:30.343199 23145 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 08:13:30 dist-test-slave-gkw7 krb5kdc[22742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436010, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:30.350621 23145 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:34739
I20260811 08:13:30.350760 23348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:34739 every 8 connection(s)
I20260811 08:13:30.351102 23145 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
I20260811 08:13:30.353826 22877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.343488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:41593 (local address 127.20.158.190:43777)
0811 08:13:30.343541 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:30.343543 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:30.343821 (+ 278us) server_negotiation.cc:407] Connection header received
0811 08:13:30.344374 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:30.344376 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:30.344390 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:30.344470 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:30.345386 (+ 916us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.346271 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.347902 (+ 1631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.348249 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.348339 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.351012 (+ 2673us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:30.351014 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:30.351015 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:30.351025 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:30.352594 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:30.352975 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:30.352975 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:30.352976 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:30.353026 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:30.353242 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:30.353243 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:30.353243 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:30.353345 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:30.353396 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:30.353687 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 08:13:30.353763 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:13:30.354074 23178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.343483 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:43777 (local address 127.20.158.130:41593)
0811 08:13:30.343658 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:30.343717 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:30.344268 (+ 551us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:30.344573 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:30.344576 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:30.344978 (+ 402us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:30.345270 (+ 292us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:30.345277 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.346381 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.346382 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:30.347789 (+ 1407us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:30.347792 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.348376 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.348377 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:30.348538 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.349076 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:30.349086 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:30.350918 (+ 1832us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:30.352670 (+ 1752us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:30.352676 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:30.352678 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:30.352905 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:30.353085 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:30.353086 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:30.353086 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:30.353186 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:30.353401 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:30.353405 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:30.353518 (+ 113us) client_negotiation.cc:769] Sending connection context
0811 08:13:30.353670 (+ 152us) client_negotiation.cc:240] Negotiation successful
0811 08:13:30.353809 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":89,"threads_started":1}
I20260811 08:13:30.354135 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 23145
I20260811 08:13:30.354218 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance
I20260811 08:13:30.354410 21114 external_mini_cluster.cc:1428] Setting key 13626a5ff4e5d05d3c3d454939ad559d
I20260811 08:13:30.354585 23351 heartbeater.cc:347] Connected to a master server at 127.20.158.190:43777
I20260811 08:13:30.354704 23351 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:30.354924 23351 heartbeater.cc:511] Master 127.20.158.190:43777 requested a full tablet report, sending...
I20260811 08:13:30.355265 22806 ts_manager.cc:194] Registered new tserver with Master: 3c430fcbb43d42adad7584c9e7bdd709 (127.20.158.130:34739)
I20260811 08:13:30.355770 22806 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.130@KRBTEST.COM'} at 127.20.158.130:41593
I20260811 08:13:30.362363 22877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.356141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:60173 (local address 127.20.158.190:43777)
0811 08:13:30.356193 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:30.356195 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:30.356302 (+ 107us) server_negotiation.cc:407] Connection header received
0811 08:13:30.356331 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:30.356332 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:30.356344 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:30.356408 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:30.356693 (+ 285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.357417 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.358496 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.358677 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.358741 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.359749 (+ 1008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:30.359750 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:30.359750 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:30.359756 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:30.361137 (+ 1381us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:30.361587 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:30.361588 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:30.361588 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:30.361645 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:30.361883 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:30.361883 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:30.361883 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:30.362011 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:30.362064 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:30.362246 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 08:13:30.362306 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 08:13:30.362452 23360 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.356069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:43777 (local address 127.20.158.130:60173)
0811 08:13:30.356194 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:30.356228 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:30.356289 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:30.356410 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:30.356411 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:30.356572 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:30.356627 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:30.356628 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.357525 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.357549 (+ 24us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:30.358409 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:30.358412 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.358755 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.358757 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:30.358851 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.359225 (+ 374us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:30.359230 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:30.359641 (+ 411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:30.361230 (+ 1589us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:30.361231 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:30.361231 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:30.361484 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:30.361715 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:30.361716 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:30.361716 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:30.361802 (+ 86us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:30.362079 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:30.362080 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:30.362133 (+ 53us) client_negotiation.cc:769] Sending connection context
0811 08:13:30.362224 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 08:13:30.362340 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":98,"thread_start_us":71,"threads_started":1}
WARNING: no policy specified for kudu/127.20.158.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
I20260811 08:13:30.381989 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:0
--local_ip_for_outbound_sockets=127.20.158.131
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:43777
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:42599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:30.466404 23367 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:30.466601 23367 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:30.466625 23367 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:30.467716 23367 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:30.467773 23367 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:30.467792 23367 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 08:13:30.467810 23367 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:13:30.469141 23367 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:42599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.158.190:43777
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23367
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:30.469352 23367 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:30.469521 23367 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:30.474851 23379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:30.474854 23375 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:30.474854 23381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:30.475128 23367 server_base.cc:1034] running on GCE node
I20260811 08:13:30.475389 23367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:30.475667 23367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:30.476851 23367 hybrid_clock.cc:648] HybridClock initialized: now 1786436010476834 us; error 28 us; skew 500 ppm
Aug 11 08:13:30 dist-test-slave-gkw7 krb5kdc[22742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436010, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:30.479637 23367 init.cc:377] Logged in from keytab as kudu/127.20.158.131@KRBTEST.COM (short username kudu)
I20260811 08:13:30.480166 23367 webserver.cc:460] Webserver started at http://127.20.158.131:41085/ using document root <none> and password file <none>
I20260811 08:13:30.480438 23367 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:30.480512 23367 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:30.480664 23367 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:30.481864 23367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-2/data/instance:
uuid: "a8206c5ae15a4b91913d37ae7c537369"
format_stamp: "Formatted at 2026-08-11 08:13:30 on dist-test-slave-gkw7"
server_key: "3709704e78fcf5b963ccfc82b2a2dd3f"
server_key_iv: "5fc527c0118e8a6b9580ebd10af7957f"
server_key_version: "encryptionkey@0"
I20260811 08:13:30.482261 23367 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance:
uuid: "a8206c5ae15a4b91913d37ae7c537369"
format_stamp: "Formatted at 2026-08-11 08:13:30 on dist-test-slave-gkw7"
server_key: "3709704e78fcf5b963ccfc82b2a2dd3f"
server_key_iv: "5fc527c0118e8a6b9580ebd10af7957f"
server_key_version: "encryptionkey@0"
I20260811 08:13:30.483700 23367 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 08:13:30.484490 23390 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:30.484699 23367 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:30.484817 23367 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "a8206c5ae15a4b91913d37ae7c537369"
format_stamp: "Formatted at 2026-08-11 08:13:30 on dist-test-slave-gkw7"
server_key: "3709704e78fcf5b963ccfc82b2a2dd3f"
server_key_iv: "5fc527c0118e8a6b9580ebd10af7957f"
server_key_version: "encryptionkey@0"
I20260811 08:13:30.484897 23367 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:30.504289 23367 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:30.506855 23367 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:30.507030 23367 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:30.507736 23367 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:30.507803 23367 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:30.507840 23367 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:30.507864 23367 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 08:13:30 dist-test-slave-gkw7 krb5kdc[22742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436010, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:30.515738 23367 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:37701
I20260811 08:13:30.515808 23576 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:37701 every 8 connection(s)
I20260811 08:13:30.516178 23367 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
I20260811 08:13:30.517827 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 23367
I20260811 08:13:30.517930 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance
I20260811 08:13:30.518196 21114 external_mini_cluster.cc:1428] Setting key 1d235a6452d6df9349e6d6a89888f715
I20260811 08:13:30.519301 22877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.508310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:48339 (local address 127.20.158.190:43777)
0811 08:13:30.508387 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:30.508389 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:30.508597 (+ 208us) server_negotiation.cc:407] Connection header received
0811 08:13:30.509137 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:30.509139 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:30.509154 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:30.509239 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:30.510025 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.510944 (+ 919us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.512098 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.512333 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.512432 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.515687 (+ 3255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:30.515689 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:30.515689 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:30.515698 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:30.517590 (+ 1892us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:30.518148 (+ 558us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:30.518149 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:30.518149 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:30.518248 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:30.518564 (+ 316us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:30.518566 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:30.518566 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:30.518710 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:30.518800 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:30.519109 (+ 309us) server_negotiation.cc:299] Negotiation successful
0811 08:13:30.519204 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 08:13:30.519511 23404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.508268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:43777 (local address 127.20.158.131:48339)
0811 08:13:30.508447 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:30.508493 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:30.509035 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:30.509338 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:30.509342 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:30.509730 (+ 388us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:30.509943 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:30.509948 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.511070 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.511072 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:30.511984 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:30.511986 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.512444 (+ 458us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.512446 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:30.512596 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.513110 (+ 514us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:30.513124 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:30.515552 (+ 2428us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:30.517677 (+ 2125us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:30.517686 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:30.517688 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:30.518033 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:30.518333 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:30.518335 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:30.518335 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:30.518486 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:30.518790 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:30.518797 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:30.518950 (+ 153us) client_negotiation.cc:769] Sending connection context
0811 08:13:30.519076 (+ 126us) client_negotiation.cc:240] Negotiation successful
0811 08:13:30.519250 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":100,"threads_started":1}
I20260811 08:13:30.520030 23577 heartbeater.cc:347] Connected to a master server at 127.20.158.190:43777
I20260811 08:13:30.520125 23577 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:30.520328 23577 heartbeater.cc:511] Master 127.20.158.190:43777 requested a full tablet report, sending...
I20260811 08:13:30.521045 22806 ts_manager.cc:194] Registered new tserver with Master: a8206c5ae15a4b91913d37ae7c537369 (127.20.158.131:37701)
I20260811 08:13:30.521449 22806 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.131@KRBTEST.COM'} at 127.20.158.131:48339
I20260811 08:13:30.527417 23585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.521087 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:43777 (local address 127.20.158.131:34049)
0811 08:13:30.521748 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:30.521760 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:30.521837 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:30.521966 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:30.521967 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:30.522135 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:30.522199 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:30.522200 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.523050 (+ 850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.523051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:30.523645 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:30.523647 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.524016 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.524017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:30.524092 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.524503 (+ 411us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:30.524508 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:30.524803 (+ 295us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:30.526487 (+ 1684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:30.526488 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:30.526488 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:30.526678 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:30.526856 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:30.526857 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:30.526857 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:30.526914 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:30.527160 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:30.527160 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:30.527200 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 08:13:30.527259 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 08:13:30.527340 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":636,"thread_start_us":77,"threads_started":1}
I20260811 08:13:30.527451 22877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.521166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:34049 (local address 127.20.158.190:43777)
0811 08:13:30.521205 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:30.521207 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:30.521823 (+ 616us) server_negotiation.cc:407] Connection header received
0811 08:13:30.521891 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:30.521892 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:30.521902 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:30.521966 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:30.522277 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.522769 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.523732 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.523934 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.523998 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.524888 (+ 890us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:30.524889 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:30.524890 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:30.524897 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:30.526384 (+ 1487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:30.526745 (+ 361us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:30.526746 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:30.526746 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:30.526797 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:30.526988 (+ 191us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:30.526989 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:30.526989 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:30.527087 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:30.527168 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:30.527325 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 08:13:30.527391 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:13:30.529824 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 08:13:30 dist-test-slave-gkw7 krb5kdc[22742](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436010, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 08:13:30 dist-test-slave-gkw7 krb5kdc[22742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436010, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:30.556777 22877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.548322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46640 (local address 127.20.158.190:43777)
0811 08:13:30.548403 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:30.548405 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:30.548417 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:13:30.548455 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:30.548456 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:30.548467 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:30.548532 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:30.549228 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.549862 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.550693 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.550880 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.550940 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.553724 (+ 2784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:30.553725 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:30.553726 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:30.553742 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:30.555393 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:30.555886 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:30.555887 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:30.555888 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:30.555953 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:30.556193 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:30.556193 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:30.556194 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:30.556321 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:30.556440 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:30.556559 (+ 119us) server_negotiation.cc:299] Negotiation successful
0811 08:13:30.556658 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 08:13:30.558609 22806 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46640:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:13:30.560379 22806 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:13:30.567397 23605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.563033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:37701 (local address 127.0.0.1:56220)
0811 08:13:30.563456 (+ 423us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:30.563506 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:30.563583 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:30.563943 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:30.563944 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:30.563947 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:30.564032 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:30.564035 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.564997 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.564998 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:30.566066 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:30.566068 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.567035 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.567036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:30.567150 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.567166 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 08:13:30.567248 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 08:13:30.567310 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":378,"mutex_wait_us":44,"thread_start_us":124,"threads_started":1}
I20260811 08:13:30.567411 23609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.563228 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56220 (local address 127.20.158.131:37701)
0811 08:13:30.563404 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:30.563408 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:30.563697 (+ 289us) server_negotiation.cc:407] Connection header received
0811 08:13:30.563751 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:30.563754 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:30.563772 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:30.563867 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:30.564128 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.564908 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.566159 (+ 1251us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.566933 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.567013 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.567063 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:30.567273 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 08:13:30.567310 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":83,"threads_started":1}
I20260811 08:13:30.567642 23607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.563177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50940 (local address 127.20.158.129:37953)
0811 08:13:30.563402 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:30.563407 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:30.563690 (+ 283us) server_negotiation.cc:407] Connection header received
0811 08:13:30.563740 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:30.563742 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:30.563759 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:30.563830 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:30.564123 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.564839 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.566435 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.567045 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.567125 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.567187 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:30.567449 (+ 262us) server_negotiation.cc:299] Negotiation successful
0811 08:13:30.567501 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":103,"threads_started":1}
I20260811 08:13:30.567950 23604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.563033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:37953 (local address 127.0.0.1:50940)
0811 08:13:30.563461 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:30.563505 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:30.563594 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:30.563929 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:30.563932 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:30.563935 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:30.564040 (+ 105us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:30.564041 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.564931 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.564932 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:30.566359 (+ 1427us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:30.566362 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.567225 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.567226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:30.567289 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.567292 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:13:30.567343 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 08:13:30.567378 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":403,"mutex_wait_us":63,"thread_start_us":75,"threads_started":1}
I20260811 08:13:30.568549 23610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.563292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:34739 (local address 127.0.0.1:36116)
0811 08:13:30.563700 (+ 408us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:30.563712 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:30.563764 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:30.563997 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:30.563998 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:30.564000 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:30.564038 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:30.564040 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.566359 (+ 2319us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.566360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:30.567388 (+ 1028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:30.567391 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.568327 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.568328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:30.568385 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.568390 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:13:30.568444 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 08:13:30.568483 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":77,"threads_started":1}
I20260811 08:13:30.568584 23470 tablet_service.cc:1467] Processing CreateTablet for tablet 23224fcaf0244c4981a55e3ad8465ea1 (DEFAULT_TABLE table=test-table [id=a8239e2406744a3db384df7d4d6ae10d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:30.568753 23022 tablet_service.cc:1467] Processing CreateTablet for tablet 23224fcaf0244c4981a55e3ad8465ea1 (DEFAULT_TABLE table=test-table [id=a8239e2406744a3db384df7d4d6ae10d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:30.569031 23611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.563418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36116 (local address 127.20.158.130:34739)
0811 08:13:30.563614 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:30.563619 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:30.563827 (+ 208us) server_negotiation.cc:407] Connection header received
0811 08:13:30.563889 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:30.563891 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:30.563906 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:30.563984 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:30.565027 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.566264 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.567491 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.568177 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.568244 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.568291 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:30.568883 (+ 592us) server_negotiation.cc:299] Negotiation successful
0811 08:13:30.568927 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":101,"threads_started":1}
I20260811 08:13:30.569005 23470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23224fcaf0244c4981a55e3ad8465ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:30.569202 23022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23224fcaf0244c4981a55e3ad8465ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:30.569736 23246 tablet_service.cc:1467] Processing CreateTablet for tablet 23224fcaf0244c4981a55e3ad8465ea1 (DEFAULT_TABLE table=test-table [id=a8239e2406744a3db384df7d4d6ae10d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:30.570081 23246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 23224fcaf0244c4981a55e3ad8465ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:30.572012 23612 tablet_bootstrap.cc:492] T 23224fcaf0244c4981a55e3ad8465ea1 P a8206c5ae15a4b91913d37ae7c537369: Bootstrap starting.
I20260811 08:13:30.572832 23612 tablet_bootstrap.cc:654] T 23224fcaf0244c4981a55e3ad8465ea1 P a8206c5ae15a4b91913d37ae7c537369: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:30.573154 23612 log.cc:824] T 23224fcaf0244c4981a55e3ad8465ea1 P a8206c5ae15a4b91913d37ae7c537369: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:30.573408 23615 tablet_bootstrap.cc:492] T 23224fcaf0244c4981a55e3ad8465ea1 P e47741f39b5d415e96527a962d15bbc4: Bootstrap starting.
I20260811 08:13:30.573974 23612 tablet_bootstrap.cc:492] T 23224fcaf0244c4981a55e3ad8465ea1 P a8206c5ae15a4b91913d37ae7c537369: No bootstrap required, opened a new log
I20260811 08:13:30.574045 23612 ts_tablet_manager.cc:1397] T 23224fcaf0244c4981a55e3ad8465ea1 P a8206c5ae15a4b91913d37ae7c537369: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:13:30.574172 23615 tablet_bootstrap.cc:654] T 23224fcaf0244c4981a55e3ad8465ea1 P e47741f39b5d415e96527a962d15bbc4: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:30.574158 23617 tablet_bootstrap.cc:492] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709: Bootstrap starting.
I20260811 08:13:30.574499 23615 log.cc:824] T 23224fcaf0244c4981a55e3ad8465ea1 P e47741f39b5d415e96527a962d15bbc4: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:30.574803 23617 tablet_bootstrap.cc:654] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:30.575147 23617 log.cc:824] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:30.575314 23615 tablet_bootstrap.cc:492] T 23224fcaf0244c4981a55e3ad8465ea1 P e47741f39b5d415e96527a962d15bbc4: No bootstrap required, opened a new log
I20260811 08:13:30.575372 23615 ts_tablet_manager.cc:1397] T 23224fcaf0244c4981a55e3ad8465ea1 P e47741f39b5d415e96527a962d15bbc4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:13:30.575796 23617 tablet_bootstrap.cc:492] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709: No bootstrap required, opened a new log
I20260811 08:13:30.575841 23617 ts_tablet_manager.cc:1397] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:13:30.576113 23612 raft_consensus.cc:348] T 23224fcaf0244c4981a55e3ad8465ea1 P a8206c5ae15a4b91913d37ae7c537369 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } }
I20260811 08:13:30.576278 23612 raft_consensus.cc:374] T 23224fcaf0244c4981a55e3ad8465ea1 P a8206c5ae15a4b91913d37ae7c537369 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:30.576313 23612 raft_consensus.cc:729] T 23224fcaf0244c4981a55e3ad8465ea1 P a8206c5ae15a4b91913d37ae7c537369 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8206c5ae15a4b91913d37ae7c537369, State: Initialized, Role: FOLLOWER
I20260811 08:13:30.576429 23612 consensus_queue.cc:260] T 23224fcaf0244c4981a55e3ad8465ea1 P a8206c5ae15a4b91913d37ae7c537369 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } }
I20260811 08:13:30.576701 23612 ts_tablet_manager.cc:1428] T 23224fcaf0244c4981a55e3ad8465ea1 P a8206c5ae15a4b91913d37ae7c537369: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:13:30.576768 23577 heartbeater.cc:503] Master 127.20.158.190:43777 was elected leader, sending a full tablet report...
I20260811 08:13:30.577685 23615 raft_consensus.cc:348] T 23224fcaf0244c4981a55e3ad8465ea1 P e47741f39b5d415e96527a962d15bbc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } }
I20260811 08:13:30.577858 23615 raft_consensus.cc:374] T 23224fcaf0244c4981a55e3ad8465ea1 P e47741f39b5d415e96527a962d15bbc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:30.577780 23617 raft_consensus.cc:348] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } }
I20260811 08:13:30.577931 23615 raft_consensus.cc:729] T 23224fcaf0244c4981a55e3ad8465ea1 P e47741f39b5d415e96527a962d15bbc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47741f39b5d415e96527a962d15bbc4, State: Initialized, Role: FOLLOWER
I20260811 08:13:30.578003 23617 raft_consensus.cc:374] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:30.578055 23615 consensus_queue.cc:260] T 23224fcaf0244c4981a55e3ad8465ea1 P e47741f39b5d415e96527a962d15bbc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } }
I20260811 08:13:30.578087 23617 raft_consensus.cc:729] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c430fcbb43d42adad7584c9e7bdd709, State: Initialized, Role: FOLLOWER
I20260811 08:13:30.578238 23617 consensus_queue.cc:260] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } }
I20260811 08:13:30.578374 23615 ts_tablet_manager.cc:1428] T 23224fcaf0244c4981a55e3ad8465ea1 P e47741f39b5d415e96527a962d15bbc4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:13:30.578389 23135 heartbeater.cc:503] Master 127.20.158.190:43777 was elected leader, sending a full tablet report...
I20260811 08:13:30.578545 23617 ts_tablet_manager.cc:1428] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 08:13:30.578747 23351 heartbeater.cc:503] Master 127.20.158.190:43777 was elected leader, sending a full tablet report...
W20260811 08:13:30.602169 23352 tablet.cc:2369] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:13:30.677923 23136 tablet.cc:2369] T 23224fcaf0244c4981a55e3ad8465ea1 P e47741f39b5d415e96527a962d15bbc4: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:13:30.766902 23578 tablet.cc:2369] T 23224fcaf0244c4981a55e3ad8465ea1 P a8206c5ae15a4b91913d37ae7c537369: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:13:30.896385 23623 raft_consensus.cc:482] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:13:30.896521 23623 raft_consensus.cc:504] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } }
I20260811 08:13:30.896950 23623 leader_election.cc:288] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a8206c5ae15a4b91913d37ae7c537369 (127.20.158.131:37701), e47741f39b5d415e96527a962d15bbc4 (127.20.158.129:37953)
I20260811 08:13:30.900215 23609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.897331 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:57275 (local address 127.20.158.131:37701)
0811 08:13:30.897446 (+ 115us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:30.897448 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:30.897460 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:13:30.897583 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:30.897585 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:30.897597 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:30.897670 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:30.897879 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.898400 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.899479 (+ 1079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.899839 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.899938 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.899947 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:30.900106 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 08:13:30.900145 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260811 08:13:30.900240 23626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.897208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:37701 (local address 127.20.158.130:57275)
0811 08:13:30.897381 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:30.897396 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:30.897465 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:30.897706 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:30.897707 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:30.897710 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:30.897796 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:30.897798 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.898488 (+ 690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.898489 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:30.899381 (+ 892us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:30.899384 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.899939 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.899940 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:30.900009 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.900014 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:13:30.900097 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 08:13:30.900145 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":75,"thread_start_us":78,"threads_started":1}
I20260811 08:13:30.900467 23627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.897208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:37953 (local address 127.20.158.130:52565)
0811 08:13:30.897412 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:30.897431 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:30.897522 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:30.897808 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:30.897809 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:30.897811 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:30.897898 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:30.897899 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.898652 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.898653 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:30.899539 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:30.899542 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.900158 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.900160 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:30.900237 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.900240 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:13:30.900317 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 08:13:30.900368 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"mutex_wait_us":4,"thread_start_us":70,"threads_started":1}
I20260811 08:13:30.900552 23607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.897330 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:52565 (local address 127.20.158.129:37953)
0811 08:13:30.897389 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:30.897393 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:30.897493 (+ 100us) server_negotiation.cc:407] Connection header received
0811 08:13:30.897715 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:30.897716 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:30.897727 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:30.897793 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:30.897976 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.898533 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.899647 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.900038 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.900155 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.900165 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:30.900424 (+ 259us) server_negotiation.cc:299] Negotiation successful
0811 08:13:30.900469 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 08:13:30.900563 23511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23224fcaf0244c4981a55e3ad8465ea1" candidate_uuid: "3c430fcbb43d42adad7584c9e7bdd709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8206c5ae15a4b91913d37ae7c537369" is_pre_election: true
I20260811 08:13:30.900713 23511 raft_consensus.cc:2454] T 23224fcaf0244c4981a55e3ad8465ea1 P a8206c5ae15a4b91913d37ae7c537369 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c430fcbb43d42adad7584c9e7bdd709 in term 0.
I20260811 08:13:30.901001 23168 leader_election.cc:302] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c430fcbb43d42adad7584c9e7bdd709, a8206c5ae15a4b91913d37ae7c537369; no voters:
I20260811 08:13:30.901019 23057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23224fcaf0244c4981a55e3ad8465ea1" candidate_uuid: "3c430fcbb43d42adad7584c9e7bdd709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47741f39b5d415e96527a962d15bbc4" is_pre_election: true
I20260811 08:13:30.901170 23057 raft_consensus.cc:2454] T 23224fcaf0244c4981a55e3ad8465ea1 P e47741f39b5d415e96527a962d15bbc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c430fcbb43d42adad7584c9e7bdd709 in term 0.
I20260811 08:13:30.901175 23623 raft_consensus.cc:2781] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:13:30.901235 23623 raft_consensus.cc:482] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:13:30.901261 23623 raft_consensus.cc:3037] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:30.902174 23623 raft_consensus.cc:504] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } }
I20260811 08:13:30.902338 23623 leader_election.cc:288] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709 [CANDIDATE]: Term 1 election: Requested vote from peers a8206c5ae15a4b91913d37ae7c537369 (127.20.158.131:37701), e47741f39b5d415e96527a962d15bbc4 (127.20.158.129:37953)
I20260811 08:13:30.902505 23511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23224fcaf0244c4981a55e3ad8465ea1" candidate_uuid: "3c430fcbb43d42adad7584c9e7bdd709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8206c5ae15a4b91913d37ae7c537369"
I20260811 08:13:30.902523 23057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "23224fcaf0244c4981a55e3ad8465ea1" candidate_uuid: "3c430fcbb43d42adad7584c9e7bdd709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47741f39b5d415e96527a962d15bbc4"
I20260811 08:13:30.902629 23511 raft_consensus.cc:3037] T 23224fcaf0244c4981a55e3ad8465ea1 P a8206c5ae15a4b91913d37ae7c537369 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:30.902612 23057 raft_consensus.cc:3037] T 23224fcaf0244c4981a55e3ad8465ea1 P e47741f39b5d415e96527a962d15bbc4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:30.903374 23057 raft_consensus.cc:2454] T 23224fcaf0244c4981a55e3ad8465ea1 P e47741f39b5d415e96527a962d15bbc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c430fcbb43d42adad7584c9e7bdd709 in term 1.
I20260811 08:13:30.903411 23511 raft_consensus.cc:2454] T 23224fcaf0244c4981a55e3ad8465ea1 P a8206c5ae15a4b91913d37ae7c537369 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c430fcbb43d42adad7584c9e7bdd709 in term 1.
I20260811 08:13:30.903568 23171 leader_election.cc:302] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c430fcbb43d42adad7584c9e7bdd709, e47741f39b5d415e96527a962d15bbc4; no voters:
I20260811 08:13:30.903695 23623 raft_consensus.cc:2781] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:30.903836 23623 raft_consensus.cc:686] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709 [term 1 LEADER]: Becoming Leader. State: Replica: 3c430fcbb43d42adad7584c9e7bdd709, State: Running, Role: LEADER
I20260811 08:13:30.903936 23623 consensus_queue.cc:237] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } }
I20260811 08:13:30.904865 22804 catalog_manager.cc:5495] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c430fcbb43d42adad7584c9e7bdd709 (127.20.158.130). New cstate: current_term: 1 leader_uuid: "3c430fcbb43d42adad7584c9e7bdd709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } health_report { overall_health: UNKNOWN } } }
I20260811 08:13:30.928170 23611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.925213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36130 (local address 127.20.158.130:34739)
0811 08:13:30.925296 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:30.925298 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:30.925309 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:13:30.925386 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:30.925387 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:30.925410 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:30.925476 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:30.925699 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.926227 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.927204 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.927424 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.927506 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.927774 (+ 268us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:30.927891 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:30.927985 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:30.928048 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 08:13:30.928080 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 08:13:30.930167 23057 raft_consensus.cc:1261] T 23224fcaf0244c4981a55e3ad8465ea1 P e47741f39b5d415e96527a962d15bbc4 [term 1 FOLLOWER]: Refusing update from remote peer 3c430fcbb43d42adad7584c9e7bdd709: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:30.930483 23623 consensus_queue.cc:1035] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:13:30.932077 23511 raft_consensus.cc:1261] T 23224fcaf0244c4981a55e3ad8465ea1 P a8206c5ae15a4b91913d37ae7c537369 [term 1 FOLLOWER]: Refusing update from remote peer 3c430fcbb43d42adad7584c9e7bdd709: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:30.932437 23628 consensus_queue.cc:1035] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:13:30.934581 23633 mvcc.cc:205] Tried to move back new op lower bound from 7317241900766650368 to 7317241900663275520. Current Snapshot: MvccSnapshot[applied={T|T < 7317241900766650368 or (T in {7317241900766650368})}]
I20260811 08:13:30.937433 22806 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:13:30.937592 22806 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:13:30.938503 22806 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 370c5bcd07dd4aa58b4fc628fcad4582: Sending DeleteTablet for 3 replicas of tablet 23224fcaf0244c4981a55e3ad8465ea1
I20260811 08:13:30.938952 23246 tablet_service.cc:1514] Processing DeleteTablet for tablet 23224fcaf0244c4981a55e3ad8465ea1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:30 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:36116
I20260811 08:13:30.938941 23470 tablet_service.cc:1514] Processing DeleteTablet for tablet 23224fcaf0244c4981a55e3ad8465ea1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:30 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:56220
I20260811 08:13:30.939263 23022 tablet_service.cc:1514] Processing DeleteTablet for tablet 23224fcaf0244c4981a55e3ad8465ea1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:30 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:50940
I20260811 08:13:30.939381 23649 tablet_replica.cc:330] T 23224fcaf0244c4981a55e3ad8465ea1 P a8206c5ae15a4b91913d37ae7c537369: stopping tablet replica
I20260811 08:13:30.939476 23649 raft_consensus.cc:2229] T 23224fcaf0244c4981a55e3ad8465ea1 P a8206c5ae15a4b91913d37ae7c537369 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:13:30.939561 23650 tablet_replica.cc:330] T 23224fcaf0244c4981a55e3ad8465ea1 P e47741f39b5d415e96527a962d15bbc4: stopping tablet replica
I20260811 08:13:30.939607 23649 raft_consensus.cc:2258] T 23224fcaf0244c4981a55e3ad8465ea1 P a8206c5ae15a4b91913d37ae7c537369 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:30.939630 22806 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46640:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 08:13:30.939751 23650 raft_consensus.cc:2229] T 23224fcaf0244c4981a55e3ad8465ea1 P e47741f39b5d415e96527a962d15bbc4 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260811 08:13:30.939769 22806 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:13:30.939795 23645 tablet_replica.cc:330] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709: stopping tablet replica
I20260811 08:13:30.939882 23645 raft_consensus.cc:2229] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:13:30.939966 23645 raft_consensus.cc:2258] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:30.940246 23649 ts_tablet_manager.cc:1905] T 23224fcaf0244c4981a55e3ad8465ea1 P a8206c5ae15a4b91913d37ae7c537369: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:13:30.941305 23022 tablet_service.cc:1467] Processing CreateTablet for tablet 66825f79f6144e0193d9b3fddfdbd9f7 (DEFAULT_TABLE table=test-table [id=bf82be5854a248f992b3c0d907077bc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:30.941334 23246 tablet_service.cc:1467] Processing CreateTablet for tablet 66825f79f6144e0193d9b3fddfdbd9f7 (DEFAULT_TABLE table=test-table [id=bf82be5854a248f992b3c0d907077bc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:30.941471 23022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66825f79f6144e0193d9b3fddfdbd9f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:30.941522 23246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66825f79f6144e0193d9b3fddfdbd9f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:30.942770 23649 ts_tablet_manager.cc:1918] T 23224fcaf0244c4981a55e3ad8465ea1 P a8206c5ae15a4b91913d37ae7c537369: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:13:30.942831 23649 log.cc:1196] T 23224fcaf0244c4981a55e3ad8465ea1 P a8206c5ae15a4b91913d37ae7c537369: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-2/wal/wals/23224fcaf0244c4981a55e3ad8465ea1
I20260811 08:13:30.942984 23470 tablet_service.cc:1467] Processing CreateTablet for tablet 66825f79f6144e0193d9b3fddfdbd9f7 (DEFAULT_TABLE table=test-table [id=bf82be5854a248f992b3c0d907077bc2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:30.943091 23470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66825f79f6144e0193d9b3fddfdbd9f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:30.943223 23650 raft_consensus.cc:2258] T 23224fcaf0244c4981a55e3ad8465ea1 P e47741f39b5d415e96527a962d15bbc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:30.943249 23617 tablet_bootstrap.cc:492] T 66825f79f6144e0193d9b3fddfdbd9f7 P 3c430fcbb43d42adad7584c9e7bdd709: Bootstrap starting.
I20260811 08:13:30.943686 23617 tablet_bootstrap.cc:654] T 66825f79f6144e0193d9b3fddfdbd9f7 P 3c430fcbb43d42adad7584c9e7bdd709: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:30.944341 23615 tablet_bootstrap.cc:492] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4: Bootstrap starting.
I20260811 08:13:30.944351 23617 tablet_bootstrap.cc:492] T 66825f79f6144e0193d9b3fddfdbd9f7 P 3c430fcbb43d42adad7584c9e7bdd709: No bootstrap required, opened a new log
I20260811 08:13:30.944399 23617 ts_tablet_manager.cc:1397] T 66825f79f6144e0193d9b3fddfdbd9f7 P 3c430fcbb43d42adad7584c9e7bdd709: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 08:13:30.944543 23617 raft_consensus.cc:348] T 66825f79f6144e0193d9b3fddfdbd9f7 P 3c430fcbb43d42adad7584c9e7bdd709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } }
I20260811 08:13:30.944588 23617 raft_consensus.cc:374] T 66825f79f6144e0193d9b3fddfdbd9f7 P 3c430fcbb43d42adad7584c9e7bdd709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:30.944608 23617 raft_consensus.cc:729] T 66825f79f6144e0193d9b3fddfdbd9f7 P 3c430fcbb43d42adad7584c9e7bdd709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c430fcbb43d42adad7584c9e7bdd709, State: Initialized, Role: FOLLOWER
I20260811 08:13:30.944670 23617 consensus_queue.cc:260] T 66825f79f6144e0193d9b3fddfdbd9f7 P 3c430fcbb43d42adad7584c9e7bdd709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } }
I20260811 08:13:30.944758 23617 ts_tablet_manager.cc:1428] T 66825f79f6144e0193d9b3fddfdbd9f7 P 3c430fcbb43d42adad7584c9e7bdd709: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:30.944799 23615 tablet_bootstrap.cc:654] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:30.945124 23612 tablet_bootstrap.cc:492] T 66825f79f6144e0193d9b3fddfdbd9f7 P a8206c5ae15a4b91913d37ae7c537369: Bootstrap starting.
I20260811 08:13:30.945415 23650 ts_tablet_manager.cc:1905] T 23224fcaf0244c4981a55e3ad8465ea1 P e47741f39b5d415e96527a962d15bbc4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:13:30.945523 23612 tablet_bootstrap.cc:654] T 66825f79f6144e0193d9b3fddfdbd9f7 P a8206c5ae15a4b91913d37ae7c537369: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:30.946215 23612 tablet_bootstrap.cc:492] T 66825f79f6144e0193d9b3fddfdbd9f7 P a8206c5ae15a4b91913d37ae7c537369: No bootstrap required, opened a new log
I20260811 08:13:30.946288 23612 ts_tablet_manager.cc:1397] T 66825f79f6144e0193d9b3fddfdbd9f7 P a8206c5ae15a4b91913d37ae7c537369: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:30.946432 23612 raft_consensus.cc:348] T 66825f79f6144e0193d9b3fddfdbd9f7 P a8206c5ae15a4b91913d37ae7c537369 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } }
I20260811 08:13:30.946511 23612 raft_consensus.cc:374] T 66825f79f6144e0193d9b3fddfdbd9f7 P a8206c5ae15a4b91913d37ae7c537369 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:30.946534 23612 raft_consensus.cc:729] T 66825f79f6144e0193d9b3fddfdbd9f7 P a8206c5ae15a4b91913d37ae7c537369 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8206c5ae15a4b91913d37ae7c537369, State: Initialized, Role: FOLLOWER
I20260811 08:13:30.946587 23612 consensus_queue.cc:260] T 66825f79f6144e0193d9b3fddfdbd9f7 P a8206c5ae15a4b91913d37ae7c537369 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } }
I20260811 08:13:30.946681 23612 ts_tablet_manager.cc:1428] T 66825f79f6144e0193d9b3fddfdbd9f7 P a8206c5ae15a4b91913d37ae7c537369: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 08:13:30.947032 23615 tablet_bootstrap.cc:492] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4: No bootstrap required, opened a new log
I20260811 08:13:30.947084 23615 ts_tablet_manager.cc:1397] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 08:13:30.947109 23650 ts_tablet_manager.cc:1918] T 23224fcaf0244c4981a55e3ad8465ea1 P e47741f39b5d415e96527a962d15bbc4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:13:30.947211 23650 log.cc:1196] T 23224fcaf0244c4981a55e3ad8465ea1 P e47741f39b5d415e96527a962d15bbc4: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-0/wal/wals/23224fcaf0244c4981a55e3ad8465ea1
I20260811 08:13:30.947273 23615 raft_consensus.cc:348] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } }
I20260811 08:13:30.947340 23615 raft_consensus.cc:374] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:30.947360 23615 raft_consensus.cc:729] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47741f39b5d415e96527a962d15bbc4, State: Initialized, Role: FOLLOWER
I20260811 08:13:30.947413 23615 consensus_queue.cc:260] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } }
I20260811 08:13:30.947505 23615 ts_tablet_manager.cc:1428] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:30.947911 23650 ts_tablet_manager.cc:1939] T 23224fcaf0244c4981a55e3ad8465ea1 P e47741f39b5d415e96527a962d15bbc4: Deleting consensus metadata
I20260811 08:13:30.943095 23649 ts_tablet_manager.cc:1939] T 23224fcaf0244c4981a55e3ad8465ea1 P a8206c5ae15a4b91913d37ae7c537369: Deleting consensus metadata
I20260811 08:13:30.948359 22785 catalog_manager.cc:4841] TS e47741f39b5d415e96527a962d15bbc4 (127.20.158.129:37953): tablet 23224fcaf0244c4981a55e3ad8465ea1 (table test-table [id=a8239e2406744a3db384df7d4d6ae10d]) successfully deleted
I20260811 08:13:30.948730 22780 catalog_manager.cc:4841] TS a8206c5ae15a4b91913d37ae7c537369 (127.20.158.131:37701): tablet 23224fcaf0244c4981a55e3ad8465ea1 (table test-table [id=a8239e2406744a3db384df7d4d6ae10d]) successfully deleted
I20260811 08:13:30.949038 23645 ts_tablet_manager.cc:1905] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:13:30.950656 23645 ts_tablet_manager.cc:1918] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:13:30.950737 23645 log.cc:1196] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-1/wal/wals/23224fcaf0244c4981a55e3ad8465ea1
I20260811 08:13:30.950985 23645 ts_tablet_manager.cc:1939] T 23224fcaf0244c4981a55e3ad8465ea1 P 3c430fcbb43d42adad7584c9e7bdd709: Deleting consensus metadata
I20260811 08:13:30.951390 22780 catalog_manager.cc:4841] TS 3c430fcbb43d42adad7584c9e7bdd709 (127.20.158.130:34739): tablet 23224fcaf0244c4981a55e3ad8465ea1 (table test-table [id=a8239e2406744a3db384df7d4d6ae10d]) successfully deleted
I20260811 08:13:30.988790 23622 raft_consensus.cc:482] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:13:30.988948 23622 raft_consensus.cc:504] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } }
I20260811 08:13:30.989349 23622 leader_election.cc:288] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c430fcbb43d42adad7584c9e7bdd709 (127.20.158.130:34739), a8206c5ae15a4b91913d37ae7c537369 (127.20.158.131:37701)
I20260811 08:13:30.993641 23609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.989891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:52961 (local address 127.20.158.131:37701)
0811 08:13:30.989940 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:30.989942 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:30.990038 (+ 96us) server_negotiation.cc:407] Connection header received
0811 08:13:30.990105 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:30.990106 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:30.990116 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:30.990170 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:30.990430 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.991188 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.992579 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.993086 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.993189 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.993200 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:30.993478 (+ 278us) server_negotiation.cc:299] Negotiation successful
0811 08:13:30.993524 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:13:30.993654 23658 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.989784 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:37701 (local address 127.20.158.129:52961)
0811 08:13:30.989968 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:30.989979 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:30.990036 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:30.990185 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:30.990186 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:30.990188 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:30.990276 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:30.990278 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.991282 (+ 1004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.991283 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:30.992460 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:30.992462 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.993243 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.993244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:30.993333 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.993338 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:13:30.993460 (+ 122us) client_negotiation.cc:240] Negotiation successful
0811 08:13:30.993514 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":88,"threads_started":1}
I20260811 08:13:30.993662 23611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.989640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:51191 (local address 127.20.158.130:34739)
0811 08:13:30.989721 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:30.989724 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:30.989898 (+ 174us) server_negotiation.cc:407] Connection header received
0811 08:13:30.990037 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:30.990038 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:30.990050 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:30.990111 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:30.990345 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.990924 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.992547 (+ 1623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.993119 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.993219 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.993228 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:30.993508 (+ 280us) server_negotiation.cc:299] Negotiation successful
0811 08:13:30.993588 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 08:13:30.993920 23657 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:30.989585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:34739 (local address 127.20.158.129:51191)
0811 08:13:30.989811 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:30.989825 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:30.989934 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:30.990168 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:30.990170 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:30.990172 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:30.990251 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:30.990253 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.991026 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.991027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:30.992436 (+ 1409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:30.992440 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:30.993293 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:30.993295 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:30.993410 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:30.993414 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:13:30.993791 (+ 377us) client_negotiation.cc:240] Negotiation successful
0811 08:13:30.993840 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":85,"threads_started":1}
I20260811 08:13:30.994421 23273 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66825f79f6144e0193d9b3fddfdbd9f7" candidate_uuid: "e47741f39b5d415e96527a962d15bbc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c430fcbb43d42adad7584c9e7bdd709" is_pre_election: true
I20260811 08:13:30.994447 23511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66825f79f6144e0193d9b3fddfdbd9f7" candidate_uuid: "e47741f39b5d415e96527a962d15bbc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8206c5ae15a4b91913d37ae7c537369" is_pre_election: true
I20260811 08:13:30.994571 23273 raft_consensus.cc:2454] T 66825f79f6144e0193d9b3fddfdbd9f7 P 3c430fcbb43d42adad7584c9e7bdd709 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47741f39b5d415e96527a962d15bbc4 in term 0.
I20260811 08:13:30.994580 23511 raft_consensus.cc:2454] T 66825f79f6144e0193d9b3fddfdbd9f7 P a8206c5ae15a4b91913d37ae7c537369 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e47741f39b5d415e96527a962d15bbc4 in term 0.
I20260811 08:13:30.994812 22933 leader_election.cc:302] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8206c5ae15a4b91913d37ae7c537369, e47741f39b5d415e96527a962d15bbc4; no voters:
I20260811 08:13:30.995042 23622 raft_consensus.cc:2781] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:13:30.995100 23622 raft_consensus.cc:482] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:13:30.995127 23622 raft_consensus.cc:3037] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:30.995898 23622 raft_consensus.cc:504] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } }
I20260811 08:13:30.996068 23622 leader_election.cc:288] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4 [CANDIDATE]: Term 1 election: Requested vote from peers 3c430fcbb43d42adad7584c9e7bdd709 (127.20.158.130:34739), a8206c5ae15a4b91913d37ae7c537369 (127.20.158.131:37701)
I20260811 08:13:30.996285 23511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66825f79f6144e0193d9b3fddfdbd9f7" candidate_uuid: "e47741f39b5d415e96527a962d15bbc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8206c5ae15a4b91913d37ae7c537369"
I20260811 08:13:30.996304 23273 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66825f79f6144e0193d9b3fddfdbd9f7" candidate_uuid: "e47741f39b5d415e96527a962d15bbc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c430fcbb43d42adad7584c9e7bdd709"
I20260811 08:13:30.996371 23273 raft_consensus.cc:3037] T 66825f79f6144e0193d9b3fddfdbd9f7 P 3c430fcbb43d42adad7584c9e7bdd709 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:30.996371 23511 raft_consensus.cc:3037] T 66825f79f6144e0193d9b3fddfdbd9f7 P a8206c5ae15a4b91913d37ae7c537369 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:30.997040 23511 raft_consensus.cc:2454] T 66825f79f6144e0193d9b3fddfdbd9f7 P a8206c5ae15a4b91913d37ae7c537369 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47741f39b5d415e96527a962d15bbc4 in term 1.
I20260811 08:13:30.997149 23273 raft_consensus.cc:2454] T 66825f79f6144e0193d9b3fddfdbd9f7 P 3c430fcbb43d42adad7584c9e7bdd709 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e47741f39b5d415e96527a962d15bbc4 in term 1.
I20260811 08:13:30.997233 22933 leader_election.cc:302] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a8206c5ae15a4b91913d37ae7c537369, e47741f39b5d415e96527a962d15bbc4; no voters:
I20260811 08:13:30.997344 23622 raft_consensus.cc:2781] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:30.997510 23622 raft_consensus.cc:686] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4 [term 1 LEADER]: Becoming Leader. State: Replica: e47741f39b5d415e96527a962d15bbc4, State: Running, Role: LEADER
I20260811 08:13:30.997651 23622 consensus_queue.cc:237] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } }
I20260811 08:13:30.998481 22804 catalog_manager.cc:5495] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to e47741f39b5d415e96527a962d15bbc4 (127.20.158.129). New cstate: current_term: 1 leader_uuid: "e47741f39b5d415e96527a962d15bbc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } health_report { overall_health: UNKNOWN } } }
Aug 11 08:13:31 dist-test-slave-gkw7 krb5kdc[22742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436009, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:31.034825 22877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:31.026478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46644 (local address 127.20.158.190:43777)
0811 08:13:31.026531 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:31.026534 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:31.026675 (+ 141us) server_negotiation.cc:407] Connection header received
0811 08:13:31.026748 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:31.026749 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:31.026759 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:31.026812 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:31.027454 (+ 642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:31.028016 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:31.029143 (+ 1127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:31.029427 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:31.029505 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:31.032090 (+ 2585us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:31.032091 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:31.032092 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:31.032100 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:31.033634 (+ 1534us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:31.034016 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:31.034017 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:31.034018 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:31.034080 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:31.034278 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:31.034279 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:31.034279 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:31.034393 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:31.034472 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:31.034627 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 08:13:31.034714 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 08:13:31.034906 23671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:31.026376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:43777 (local address 127.0.0.1:46644)
0811 08:13:31.026583 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:31.026597 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:31.026685 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:31.026847 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:31.026847 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:31.027289 (+ 442us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:31.027360 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:31.027363 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:31.028112 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:31.028113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:31.028970 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:31.028973 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:31.029548 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:31.029550 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:31.029627 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:31.030261 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:31.030268 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:31.031990 (+ 1722us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:31.033721 (+ 1731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:31.033730 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:31.033733 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:31.033939 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:31.034147 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:31.034148 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:31.034148 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:31.034214 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:31.034461 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:31.034469 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:31.034516 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 08:13:31.034605 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 08:13:31.034768 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"mutex_wait_us":59,"thread_start_us":96,"threads_started":1}
I20260811 08:13:31.037138 22804 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:46644:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 08:13:31.037425 22804 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:13:31.039026 23022 tablet_service.cc:1467] Processing CreateTablet for tablet 77206dc728cb43289b8abb7071e04ebd (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=43424c8d732245d29e984037f883670d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 08:13:31.039098 23470 tablet_service.cc:1467] Processing CreateTablet for tablet 77206dc728cb43289b8abb7071e04ebd (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=43424c8d732245d29e984037f883670d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 08:13:31.039192 23022 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77206dc728cb43289b8abb7071e04ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:31.039275 23470 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77206dc728cb43289b8abb7071e04ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:31.040921 23246 tablet_service.cc:1467] Processing CreateTablet for tablet 77206dc728cb43289b8abb7071e04ebd (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=43424c8d732245d29e984037f883670d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 08:13:31.041136 23246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 77206dc728cb43289b8abb7071e04ebd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:31.041690 23612 tablet_bootstrap.cc:492] T 77206dc728cb43289b8abb7071e04ebd P a8206c5ae15a4b91913d37ae7c537369: Bootstrap starting.
I20260811 08:13:31.042328 23612 tablet_bootstrap.cc:654] T 77206dc728cb43289b8abb7071e04ebd P a8206c5ae15a4b91913d37ae7c537369: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:31.043893 23615 tablet_bootstrap.cc:492] T 77206dc728cb43289b8abb7071e04ebd P e47741f39b5d415e96527a962d15bbc4: Bootstrap starting.
I20260811 08:13:31.044027 23617 tablet_bootstrap.cc:492] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709: Bootstrap starting.
I20260811 08:13:31.044345 23612 tablet_bootstrap.cc:492] T 77206dc728cb43289b8abb7071e04ebd P a8206c5ae15a4b91913d37ae7c537369: No bootstrap required, opened a new log
I20260811 08:13:31.044397 23612 ts_tablet_manager.cc:1397] T 77206dc728cb43289b8abb7071e04ebd P a8206c5ae15a4b91913d37ae7c537369: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 08:13:31.044456 23615 tablet_bootstrap.cc:654] T 77206dc728cb43289b8abb7071e04ebd P e47741f39b5d415e96527a962d15bbc4: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:31.044543 23612 raft_consensus.cc:348] T 77206dc728cb43289b8abb7071e04ebd P a8206c5ae15a4b91913d37ae7c537369 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } }
I20260811 08:13:31.044585 23617 tablet_bootstrap.cc:654] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:31.044632 23612 raft_consensus.cc:374] T 77206dc728cb43289b8abb7071e04ebd P a8206c5ae15a4b91913d37ae7c537369 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:31.044653 23612 raft_consensus.cc:729] T 77206dc728cb43289b8abb7071e04ebd P a8206c5ae15a4b91913d37ae7c537369 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8206c5ae15a4b91913d37ae7c537369, State: Initialized, Role: FOLLOWER
I20260811 08:13:31.044703 23612 consensus_queue.cc:260] T 77206dc728cb43289b8abb7071e04ebd P a8206c5ae15a4b91913d37ae7c537369 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } }
I20260811 08:13:31.044790 23612 ts_tablet_manager.cc:1428] T 77206dc728cb43289b8abb7071e04ebd P a8206c5ae15a4b91913d37ae7c537369: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:31.044924 23621 tablet_replica.cc:439] T 77206dc728cb43289b8abb7071e04ebd P a8206c5ae15a4b91913d37ae7c537369: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } } }
I20260811 08:13:31.044998 23621 tablet_replica.cc:442] T 77206dc728cb43289b8abb7071e04ebd P a8206c5ae15a4b91913d37ae7c537369: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:13:31.046115 23617 tablet_bootstrap.cc:492] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709: No bootstrap required, opened a new log
I20260811 08:13:31.046221 23617 ts_tablet_manager.cc:1397] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 08:13:31.046277 23615 tablet_bootstrap.cc:492] T 77206dc728cb43289b8abb7071e04ebd P e47741f39b5d415e96527a962d15bbc4: No bootstrap required, opened a new log
I20260811 08:13:31.046339 23615 ts_tablet_manager.cc:1397] T 77206dc728cb43289b8abb7071e04ebd P e47741f39b5d415e96527a962d15bbc4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:13:31.046414 23617 raft_consensus.cc:348] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } }
I20260811 08:13:31.046556 23617 raft_consensus.cc:374] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:31.046518 23615 raft_consensus.cc:348] T 77206dc728cb43289b8abb7071e04ebd P e47741f39b5d415e96527a962d15bbc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } }
I20260811 08:13:31.046588 23617 raft_consensus.cc:729] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c430fcbb43d42adad7584c9e7bdd709, State: Initialized, Role: FOLLOWER
I20260811 08:13:31.046599 23615 raft_consensus.cc:374] T 77206dc728cb43289b8abb7071e04ebd P e47741f39b5d415e96527a962d15bbc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:31.046622 23615 raft_consensus.cc:729] T 77206dc728cb43289b8abb7071e04ebd P e47741f39b5d415e96527a962d15bbc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e47741f39b5d415e96527a962d15bbc4, State: Initialized, Role: FOLLOWER
I20260811 08:13:31.046648 23617 consensus_queue.cc:260] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } }
I20260811 08:13:31.046684 23615 consensus_queue.cc:260] T 77206dc728cb43289b8abb7071e04ebd P e47741f39b5d415e96527a962d15bbc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } }
I20260811 08:13:31.046763 23617 ts_tablet_manager.cc:1428] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 08:13:31.046769 23615 ts_tablet_manager.cc:1428] T 77206dc728cb43289b8abb7071e04ebd P e47741f39b5d415e96527a962d15bbc4: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 08:13:31.046906 23623 tablet_replica.cc:439] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } } }
I20260811 08:13:31.046981 23623 tablet_replica.cc:442] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:13:31.047857 23622 tablet_replica.cc:439] T 77206dc728cb43289b8abb7071e04ebd P e47741f39b5d415e96527a962d15bbc4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } } }
I20260811 08:13:31.047973 23622 tablet_replica.cc:442] T 77206dc728cb43289b8abb7071e04ebd P e47741f39b5d415e96527a962d15bbc4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:13:31.186349 23623 raft_consensus.cc:482] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:13:31.186480 23623 raft_consensus.cc:504] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } }
I20260811 08:13:31.186708 23623 leader_election.cc:288] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e47741f39b5d415e96527a962d15bbc4 (127.20.158.129:37953), a8206c5ae15a4b91913d37ae7c537369 (127.20.158.131:37701)
I20260811 08:13:31.186981 23057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77206dc728cb43289b8abb7071e04ebd" candidate_uuid: "3c430fcbb43d42adad7584c9e7bdd709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47741f39b5d415e96527a962d15bbc4" is_pre_election: true
I20260811 08:13:31.186990 23511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77206dc728cb43289b8abb7071e04ebd" candidate_uuid: "3c430fcbb43d42adad7584c9e7bdd709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8206c5ae15a4b91913d37ae7c537369" is_pre_election: true
I20260811 08:13:31.187132 23057 raft_consensus.cc:2454] T 77206dc728cb43289b8abb7071e04ebd P e47741f39b5d415e96527a962d15bbc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c430fcbb43d42adad7584c9e7bdd709 in term 0.
I20260811 08:13:31.187134 23511 raft_consensus.cc:2454] T 77206dc728cb43289b8abb7071e04ebd P a8206c5ae15a4b91913d37ae7c537369 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c430fcbb43d42adad7584c9e7bdd709 in term 0.
I20260811 08:13:31.187314 23171 leader_election.cc:302] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c430fcbb43d42adad7584c9e7bdd709, e47741f39b5d415e96527a962d15bbc4; no voters:
I20260811 08:13:31.187484 23623 raft_consensus.cc:2781] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:13:31.187533 23623 raft_consensus.cc:482] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:13:31.187551 23623 raft_consensus.cc:3037] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:31.188536 23623 raft_consensus.cc:504] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } }
I20260811 08:13:31.188690 23623 leader_election.cc:288] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709 [CANDIDATE]: Term 1 election: Requested vote from peers e47741f39b5d415e96527a962d15bbc4 (127.20.158.129:37953), a8206c5ae15a4b91913d37ae7c537369 (127.20.158.131:37701)
I20260811 08:13:31.188910 23057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77206dc728cb43289b8abb7071e04ebd" candidate_uuid: "3c430fcbb43d42adad7584c9e7bdd709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e47741f39b5d415e96527a962d15bbc4"
I20260811 08:13:31.188853 23511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "77206dc728cb43289b8abb7071e04ebd" candidate_uuid: "3c430fcbb43d42adad7584c9e7bdd709" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8206c5ae15a4b91913d37ae7c537369"
I20260811 08:13:31.188978 23057 raft_consensus.cc:3037] T 77206dc728cb43289b8abb7071e04ebd P e47741f39b5d415e96527a962d15bbc4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:31.189000 23511 raft_consensus.cc:3037] T 77206dc728cb43289b8abb7071e04ebd P a8206c5ae15a4b91913d37ae7c537369 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:31.189667 23511 raft_consensus.cc:2454] T 77206dc728cb43289b8abb7071e04ebd P a8206c5ae15a4b91913d37ae7c537369 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c430fcbb43d42adad7584c9e7bdd709 in term 1.
I20260811 08:13:31.189730 23057 raft_consensus.cc:2454] T 77206dc728cb43289b8abb7071e04ebd P e47741f39b5d415e96527a962d15bbc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c430fcbb43d42adad7584c9e7bdd709 in term 1.
I20260811 08:13:31.189855 23168 leader_election.cc:302] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c430fcbb43d42adad7584c9e7bdd709, a8206c5ae15a4b91913d37ae7c537369; no voters:
I20260811 08:13:31.189976 23623 raft_consensus.cc:2781] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:31.190069 23623 raft_consensus.cc:686] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709 [term 1 LEADER]: Becoming Leader. State: Replica: 3c430fcbb43d42adad7584c9e7bdd709, State: Running, Role: LEADER
I20260811 08:13:31.190148 23623 consensus_queue.cc:237] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } }
I20260811 08:13:31.190434 23628 tablet_replica.cc:439] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709: TxnStatusTablet state changed. Reason: New leader 3c430fcbb43d42adad7584c9e7bdd709. Latest consensus state: current_term: 1 leader_uuid: "3c430fcbb43d42adad7584c9e7bdd709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } } }
I20260811 08:13:31.190532 23628 tablet_replica.cc:442] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709: This TxnStatusTablet replica's current role is: LEADER
I20260811 08:13:31.190750 23677 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 08:13:31.190783 22806 catalog_manager.cc:5495] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c430fcbb43d42adad7584c9e7bdd709 (127.20.158.130). New cstate: current_term: 1 leader_uuid: "3c430fcbb43d42adad7584c9e7bdd709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } health_report { overall_health: UNKNOWN } } }
I20260811 08:13:31.190897 23677 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 08:13:31.230015 23611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:31.227523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36132 (local address 127.20.158.130:34739)
0811 08:13:31.227594 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:31.227596 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:31.227606 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:13:31.227677 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:31.227678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:31.227689 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:31.227745 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:31.227889 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:31.228409 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:31.229198 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:31.229399 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:31.229476 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:31.229728 (+ 252us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:31.229775 (+ 47us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:31.229840 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:31.229913 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 08:13:31.229935 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 08:13:31.230036 23671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:31.227443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:34739 (local address 127.0.0.1:36132)
0811 08:13:31.227526 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:31.227539 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:31.227605 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:31.227752 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:31.227753 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:31.227755 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:13:31.227816 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:31.227818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:31.228506 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:31.228507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:31.229109 (+ 602us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:31.229111 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:31.229477 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:31.229478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:31.229605 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:31.229630 (+ 25us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:13:31.229843 (+ 213us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:13:31.229854 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 08:13:31.229908 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 08:13:31.229965 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 08:13:31.231297 23057 raft_consensus.cc:1261] T 77206dc728cb43289b8abb7071e04ebd P e47741f39b5d415e96527a962d15bbc4 [term 1 FOLLOWER]: Refusing update from remote peer 3c430fcbb43d42adad7584c9e7bdd709: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:31.231396 23511 raft_consensus.cc:1261] T 77206dc728cb43289b8abb7071e04ebd P a8206c5ae15a4b91913d37ae7c537369 [term 1 FOLLOWER]: Refusing update from remote peer 3c430fcbb43d42adad7584c9e7bdd709: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:31.231606 23623 consensus_queue.cc:1035] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:13:31.231709 23628 consensus_queue.cc:1035] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:13:31.232265 23621 tablet_replica.cc:439] T 77206dc728cb43289b8abb7071e04ebd P a8206c5ae15a4b91913d37ae7c537369: TxnStatusTablet state changed. Reason: New leader 3c430fcbb43d42adad7584c9e7bdd709. Latest consensus state: current_term: 1 leader_uuid: "3c430fcbb43d42adad7584c9e7bdd709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } } }
I20260811 08:13:31.232362 23621 tablet_replica.cc:442] T 77206dc728cb43289b8abb7071e04ebd P a8206c5ae15a4b91913d37ae7c537369: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:13:31.232298 23622 tablet_replica.cc:439] T 77206dc728cb43289b8abb7071e04ebd P e47741f39b5d415e96527a962d15bbc4: TxnStatusTablet state changed. Reason: New leader 3c430fcbb43d42adad7584c9e7bdd709. Latest consensus state: current_term: 1 leader_uuid: "3c430fcbb43d42adad7584c9e7bdd709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } } }
I20260811 08:13:31.232431 23622 tablet_replica.cc:442] T 77206dc728cb43289b8abb7071e04ebd P e47741f39b5d415e96527a962d15bbc4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:13:31.233278 23628 tablet_replica.cc:439] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3c430fcbb43d42adad7584c9e7bdd709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } } }
I20260811 08:13:31.233362 23628 tablet_replica.cc:442] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709: This TxnStatusTablet replica's current role is: LEADER
I20260811 08:13:31.233414 23631 mvcc.cc:205] Tried to move back new op lower bound from 7317241902001299456 to 7317241901835124736. Current Snapshot: MvccSnapshot[applied={T|T < 7317241902001299456 or (T in {7317241902001299456})}]
I20260811 08:13:31.233816 23628 tablet_replica.cc:439] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "3c430fcbb43d42adad7584c9e7bdd709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } } }
I20260811 08:13:31.233883 23628 tablet_replica.cc:442] T 77206dc728cb43289b8abb7071e04ebd P 3c430fcbb43d42adad7584c9e7bdd709: This TxnStatusTablet replica's current role is: LEADER
I20260811 08:13:31.234246 23637 mvcc.cc:205] Tried to move back new op lower bound from 7317241902001299456 to 7317241901835124736. Current Snapshot: MvccSnapshot[applied={T|T < 7317241902001299456 or (T in {7317241902001299456})}]
I20260811 08:13:31.234360 23621 tablet_replica.cc:439] T 77206dc728cb43289b8abb7071e04ebd P a8206c5ae15a4b91913d37ae7c537369: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3c430fcbb43d42adad7584c9e7bdd709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } } }
I20260811 08:13:31.234426 23621 tablet_replica.cc:442] T 77206dc728cb43289b8abb7071e04ebd P a8206c5ae15a4b91913d37ae7c537369: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:13:31.234817 23622 tablet_replica.cc:439] T 77206dc728cb43289b8abb7071e04ebd P e47741f39b5d415e96527a962d15bbc4: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "3c430fcbb43d42adad7584c9e7bdd709" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e47741f39b5d415e96527a962d15bbc4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 37953 } } peers { permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 } } peers { permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 } } }
I20260811 08:13:31.234916 23622 tablet_replica.cc:442] T 77206dc728cb43289b8abb7071e04ebd P e47741f39b5d415e96527a962d15bbc4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:13:31.238394 23607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:31.235652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50954 (local address 127.20.158.129:37953)
0811 08:13:31.235693 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:31.235696 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:31.235705 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:13:31.235743 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:31.235744 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:31.235765 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:31.235844 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:31.235988 (+ 144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:31.236461 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:31.237507 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:31.237771 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:31.237829 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:31.238004 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:31.238159 (+ 155us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:31.238215 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:31.238286 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 08:13:31.238304 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:13:31.244643 23611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:31.241667 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:60967 (local address 127.20.158.130:34739)
0811 08:13:31.241734 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:31.241737 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:31.241917 (+ 180us) server_negotiation.cc:407] Connection header received
0811 08:13:31.241986 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:31.241987 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:31.242000 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:31.242061 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:31.242237 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:31.242766 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:31.243852 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:31.244069 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:31.244158 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:31.244366 (+ 208us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:31.244404 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:31.244462 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:31.244530 (+ 68us) server_negotiation.cc:299] Negotiation successful
0811 08:13:31.244557 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:13:31.244918 23687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:31.241616 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:34739 (local address 127.20.158.129:60967)
0811 08:13:31.241836 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:31.241848 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:31.241917 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:31.242065 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:31.242066 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:31.242068 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:13:31.242134 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:31.242136 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:31.242870 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:31.242872 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:31.243742 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:31.243745 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:31.244157 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:31.244158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:31.244233 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:31.244259 (+ 26us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:13:31.244478 (+ 219us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:13:31.244480 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:13:31.244529 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 08:13:31.244580 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":98,"threads_started":1}
I20260811 08:13:31.247526 23511 raft_consensus.cc:1261] T 66825f79f6144e0193d9b3fddfdbd9f7 P a8206c5ae15a4b91913d37ae7c537369 [term 1 FOLLOWER]: Refusing update from remote peer e47741f39b5d415e96527a962d15bbc4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:31.247644 23273 raft_consensus.cc:1261] T 66825f79f6144e0193d9b3fddfdbd9f7 P 3c430fcbb43d42adad7584c9e7bdd709 [term 1 FOLLOWER]: Refusing update from remote peer e47741f39b5d415e96527a962d15bbc4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:31.247802 23661 consensus_queue.cc:1035] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8206c5ae15a4b91913d37ae7c537369" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37701 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:13:31.248152 23661 consensus_queue.cc:1035] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c430fcbb43d42adad7584c9e7bdd709" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 34739 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:13:31.258750 23697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:31.255698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:37953 (local address 127.20.158.130:54453)
0811 08:13:31.255924 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:31.255938 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:31.256007 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:31.256137 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:31.256138 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:31.256139 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:13:31.256193 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:31.256195 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:31.257016 (+ 821us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:31.257017 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:31.257766 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:31.257769 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:31.258246 (+ 477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:31.258248 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:31.258313 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:31.258334 (+ 21us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:13:31.258557 (+ 223us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:13:31.258560 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:13:31.258614 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 08:13:31.258666 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":103,"threads_started":1}
I20260811 08:13:31.258728 23607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:31.255862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:54453 (local address 127.20.158.129:37953)
0811 08:13:31.255923 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:31.255925 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:31.255991 (+ 66us) server_negotiation.cc:407] Connection header received
0811 08:13:31.256069 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:31.256070 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:31.256079 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:31.256132 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:31.256256 (+ 124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:31.256903 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:31.257890 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:31.258143 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:31.258242 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:31.258437 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:31.258476 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:31.258555 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:31.258618 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 08:13:31.258641 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 08:13:31.269188 22804 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:13:31.269299 22804 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46640:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:13:31.269990 22804 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 370c5bcd07dd4aa58b4fc628fcad4582: Sending DeleteTablet for 3 replicas of tablet 66825f79f6144e0193d9b3fddfdbd9f7
I20260811 08:13:31.270303 23246 tablet_service.cc:1514] Processing DeleteTablet for tablet 66825f79f6144e0193d9b3fddfdbd9f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:31 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:36116
I20260811 08:13:31.270332 23022 tablet_service.cc:1514] Processing DeleteTablet for tablet 66825f79f6144e0193d9b3fddfdbd9f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:31 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:50940
I20260811 08:13:31.270339 23470 tablet_service.cc:1514] Processing DeleteTablet for tablet 66825f79f6144e0193d9b3fddfdbd9f7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:31 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:56220
I20260811 08:13:31.270424 23645 tablet_replica.cc:330] T 66825f79f6144e0193d9b3fddfdbd9f7 P 3c430fcbb43d42adad7584c9e7bdd709: stopping tablet replica
I20260811 08:13:31.270474 23645 raft_consensus.cc:2229] T 66825f79f6144e0193d9b3fddfdbd9f7 P 3c430fcbb43d42adad7584c9e7bdd709 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:13:31.270458 23650 tablet_replica.cc:330] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4: stopping tablet replica
I20260811 08:13:31.270480 23649 tablet_replica.cc:330] T 66825f79f6144e0193d9b3fddfdbd9f7 P a8206c5ae15a4b91913d37ae7c537369: stopping tablet replica
I20260811 08:13:31.270519 23645 raft_consensus.cc:2258] T 66825f79f6144e0193d9b3fddfdbd9f7 P 3c430fcbb43d42adad7584c9e7bdd709 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:31.270529 23649 raft_consensus.cc:2229] T 66825f79f6144e0193d9b3fddfdbd9f7 P a8206c5ae15a4b91913d37ae7c537369 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:13:31.270534 23650 raft_consensus.cc:2229] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:13:31.270578 23649 raft_consensus.cc:2258] T 66825f79f6144e0193d9b3fddfdbd9f7 P a8206c5ae15a4b91913d37ae7c537369 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:31.270651 23650 raft_consensus.cc:2258] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:31.271001 23649 ts_tablet_manager.cc:1905] T 66825f79f6144e0193d9b3fddfdbd9f7 P a8206c5ae15a4b91913d37ae7c537369: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:13:31.271034 23650 ts_tablet_manager.cc:1905] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:13:31.271478 23645 ts_tablet_manager.cc:1905] T 66825f79f6144e0193d9b3fddfdbd9f7 P 3c430fcbb43d42adad7584c9e7bdd709: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:13:31.273205 23650 ts_tablet_manager.cc:1918] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:13:31.273212 23645 ts_tablet_manager.cc:1918] T 66825f79f6144e0193d9b3fddfdbd9f7 P 3c430fcbb43d42adad7584c9e7bdd709: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:13:31.273283 23650 log.cc:1196] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-0/wal/wals/66825f79f6144e0193d9b3fddfdbd9f7
I20260811 08:13:31.273283 23645 log.cc:1196] T 66825f79f6144e0193d9b3fddfdbd9f7 P 3c430fcbb43d42adad7584c9e7bdd709: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-1/wal/wals/66825f79f6144e0193d9b3fddfdbd9f7
I20260811 08:13:31.273520 23650 ts_tablet_manager.cc:1939] T 66825f79f6144e0193d9b3fddfdbd9f7 P e47741f39b5d415e96527a962d15bbc4: Deleting consensus metadata
I20260811 08:13:31.273520 23645 ts_tablet_manager.cc:1939] T 66825f79f6144e0193d9b3fddfdbd9f7 P 3c430fcbb43d42adad7584c9e7bdd709: Deleting consensus metadata
I20260811 08:13:31.273916 22780 catalog_manager.cc:4841] TS 3c430fcbb43d42adad7584c9e7bdd709 (127.20.158.130:34739): tablet 66825f79f6144e0193d9b3fddfdbd9f7 (table test-table [id=bf82be5854a248f992b3c0d907077bc2]) successfully deleted
I20260811 08:13:31.274078 23649 ts_tablet_manager.cc:1918] T 66825f79f6144e0193d9b3fddfdbd9f7 P a8206c5ae15a4b91913d37ae7c537369: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:13:31.274150 23649 log.cc:1196] T 66825f79f6144e0193d9b3fddfdbd9f7 P a8206c5ae15a4b91913d37ae7c537369: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786436003833085-21114-0/minicluster-data/ts-2/wal/wals/66825f79f6144e0193d9b3fddfdbd9f7
I20260811 08:13:31.274406 23649 ts_tablet_manager.cc:1939] T 66825f79f6144e0193d9b3fddfdbd9f7 P a8206c5ae15a4b91913d37ae7c537369: Deleting consensus metadata
I20260811 08:13:31.274740 22780 catalog_manager.cc:4841] TS a8206c5ae15a4b91913d37ae7c537369 (127.20.158.131:37701): tablet 66825f79f6144e0193d9b3fddfdbd9f7 (table test-table [id=bf82be5854a248f992b3c0d907077bc2]) successfully deleted
I20260811 08:13:31.281757 22785 catalog_manager.cc:4841] TS e47741f39b5d415e96527a962d15bbc4 (127.20.158.129:37953): tablet 66825f79f6144e0193d9b3fddfdbd9f7 (table test-table [id=bf82be5854a248f992b3c0d907077bc2]) successfully deleted
Aug 11 08:13:31 dist-test-slave-gkw7 krb5kdc[22742](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436010, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.158.129@KRBTEST.COM
I20260811 08:13:31.296375 23607 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:31.273825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50968 (local address 127.20.158.129:37953)
0811 08:13:31.274045 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:31.274047 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:31.281785 (+ 7738us) server_negotiation.cc:407] Connection header received
0811 08:13:31.281879 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:31.281881 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:31.281894 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:31.281967 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:31.286522 (+ 4555us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:31.287305 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:31.288455 (+ 1150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:31.288782 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:31.288865 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:31.292774 (+ 3909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:31.292786 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:31.292786 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:31.292795 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:31.294967 (+ 2172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:31.295405 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:31.295410 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:31.295411 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:31.295487 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:31.295708 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:31.295709 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:31.295709 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:31.295890 (+ 181us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:31.296086 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:31.296143 (+ 57us) server_negotiation.cc:299] Negotiation successful
0811 08:13:31.296231 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190}
W20260811 08:13:31.296797 23125 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50968
I20260811 08:13:31.308068 22877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:31.297929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46652 (local address 127.20.158.190:43777)
0811 08:13:31.297996 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:31.297998 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:31.301728 (+ 3730us) server_negotiation.cc:407] Connection header received
0811 08:13:31.301814 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:31.301815 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:31.301829 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:31.301880 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:31.302446 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:31.302958 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:31.303723 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:31.303936 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:31.304025 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:31.305260 (+ 1235us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:31.305262 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:31.305262 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:31.305270 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:31.306770 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:31.307138 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:31.307139 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:31.307139 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:31.307205 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:31.307477 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:31.307478 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:31.307478 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:31.307595 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:31.307710 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:31.307831 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 08:13:31.307944 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
W20260811 08:13:31.308311 22804 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46652
I20260811 08:13:31.309136 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 22909
I20260811 08:13:31.325567 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 23145
I20260811 08:13:31.338418 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 23367
I20260811 08:13:31.348948 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 22759
2026-08-11T08:13:31Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2939 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:13:31 dist-test-slave-gkw7 krb5kdc[23709](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:13:31 dist-test-slave-gkw7 krb5kdc[23709](info): set up 2 sockets
Aug 11 08:13:31 dist-test-slave-gkw7 krb5kdc[23709](info): commencing operation
krb5kdc: starting...
W20260811 08:13:32.686259 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.310s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:13:32 dist-test-slave-gkw7 krb5kdc[23709](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436012, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:13:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:13:32Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:13:32.813010 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:33335
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:37649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:33335
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:32.897234 23728 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:32.897469 23728 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:32.897493 23728 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:32.898774 23728 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:32.898823 23728 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 08:13:32.898837 23728 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:32.898851 23728 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:32.898864 23728 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:32.898876 23728 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:13:32.900477 23728 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:37649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:33335
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:33335
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23728
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:32.900745 23728 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:32.900997 23728 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:32.906270 23740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:32.906275 23736 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:32.906314 23738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:32.906415 23728 server_base.cc:1034] running on GCE node
I20260811 08:13:32.906810 23728 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:32.907143 23728 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:32.908324 23728 hybrid_clock.cc:648] HybridClock initialized: now 1786436012908318 us; error 36 us; skew 500 ppm
Aug 11 08:13:32 dist-test-slave-gkw7 krb5kdc[23709](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436012, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:32.910897 23728 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:13:32.911414 23728 webserver.cc:460] Webserver started at http://127.20.158.190:36553/ using document root <none> and password file <none>
I20260811 08:13:32.911650 23728 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:32.911722 23728 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:32.911882 23728 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:32.912966 23728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "63e00ed48aac4d66a871baa9f72f0b33"
format_stamp: "Formatted at 2026-08-11 08:13:32 on dist-test-slave-gkw7"
server_key: "cdaa5d1f9dc41193e8bfed79c026e03b"
server_key_iv: "5a009871108dffc4ee6644d61654459a"
server_key_version: "encryptionkey@0"
I20260811 08:13:32.913341 23728 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "63e00ed48aac4d66a871baa9f72f0b33"
format_stamp: "Formatted at 2026-08-11 08:13:32 on dist-test-slave-gkw7"
server_key: "cdaa5d1f9dc41193e8bfed79c026e03b"
server_key_iv: "5a009871108dffc4ee6644d61654459a"
server_key_version: "encryptionkey@0"
I20260811 08:13:32.914773 23728 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:32.915580 23749 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:32.915753 23728 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:32.915865 23728 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "63e00ed48aac4d66a871baa9f72f0b33"
format_stamp: "Formatted at 2026-08-11 08:13:32 on dist-test-slave-gkw7"
server_key: "cdaa5d1f9dc41193e8bfed79c026e03b"
server_key_iv: "5a009871108dffc4ee6644d61654459a"
server_key_version: "encryptionkey@0"
I20260811 08:13:32.915939 23728 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:32.950704 23728 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:32.953002 23728 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:32.953198 23728 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:32.958209 23728 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:33335
I20260811 08:13:32.958259 23857 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:33335 every 8 connection(s)
I20260811 08:13:32.958652 23728 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:13:32.959331 23859 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:32.961659 23859 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63e00ed48aac4d66a871baa9f72f0b33: Bootstrap starting.
I20260811 08:13:32.962261 23859 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 63e00ed48aac4d66a871baa9f72f0b33: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:32.962507 23859 log.cc:824] T 00000000000000000000000000000000 P 63e00ed48aac4d66a871baa9f72f0b33: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:32.963191 23859 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 63e00ed48aac4d66a871baa9f72f0b33: No bootstrap required, opened a new log
I20260811 08:13:32.965286 23859 raft_consensus.cc:348] T 00000000000000000000000000000000 P 63e00ed48aac4d66a871baa9f72f0b33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63e00ed48aac4d66a871baa9f72f0b33" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 33335 } }
I20260811 08:13:32.965432 23859 raft_consensus.cc:374] T 00000000000000000000000000000000 P 63e00ed48aac4d66a871baa9f72f0b33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:32.965457 23859 raft_consensus.cc:729] T 00000000000000000000000000000000 P 63e00ed48aac4d66a871baa9f72f0b33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 63e00ed48aac4d66a871baa9f72f0b33, State: Initialized, Role: FOLLOWER
I20260811 08:13:32.965641 23859 consensus_queue.cc:260] T 00000000000000000000000000000000 P 63e00ed48aac4d66a871baa9f72f0b33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63e00ed48aac4d66a871baa9f72f0b33" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 33335 } }
I20260811 08:13:32.965740 23859 raft_consensus.cc:388] T 00000000000000000000000000000000 P 63e00ed48aac4d66a871baa9f72f0b33 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:13:32.965764 23859 raft_consensus.cc:482] T 00000000000000000000000000000000 P 63e00ed48aac4d66a871baa9f72f0b33 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:13:32.965794 23859 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 63e00ed48aac4d66a871baa9f72f0b33 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:32.966279 23859 raft_consensus.cc:504] T 00000000000000000000000000000000 P 63e00ed48aac4d66a871baa9f72f0b33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63e00ed48aac4d66a871baa9f72f0b33" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 33335 } }
I20260811 08:13:32.966364 23859 leader_election.cc:302] T 00000000000000000000000000000000 P 63e00ed48aac4d66a871baa9f72f0b33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 63e00ed48aac4d66a871baa9f72f0b33; no voters:
I20260811 08:13:32.966485 23859 leader_election.cc:288] T 00000000000000000000000000000000 P 63e00ed48aac4d66a871baa9f72f0b33 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:13:32.966567 23863 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 63e00ed48aac4d66a871baa9f72f0b33 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:32.966778 23863 raft_consensus.cc:686] T 00000000000000000000000000000000 P 63e00ed48aac4d66a871baa9f72f0b33 [term 1 LEADER]: Becoming Leader. State: Replica: 63e00ed48aac4d66a871baa9f72f0b33, State: Running, Role: LEADER
I20260811 08:13:32.966781 23859 sys_catalog.cc:564] T 00000000000000000000000000000000 P 63e00ed48aac4d66a871baa9f72f0b33 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:32.966892 23863 consensus_queue.cc:237] T 00000000000000000000000000000000 P 63e00ed48aac4d66a871baa9f72f0b33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63e00ed48aac4d66a871baa9f72f0b33" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 33335 } }
I20260811 08:13:32.967381 23864 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63e00ed48aac4d66a871baa9f72f0b33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "63e00ed48aac4d66a871baa9f72f0b33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63e00ed48aac4d66a871baa9f72f0b33" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 33335 } } }
I20260811 08:13:32.967388 23865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 63e00ed48aac4d66a871baa9f72f0b33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 63e00ed48aac4d66a871baa9f72f0b33. Latest consensus state: current_term: 1 leader_uuid: "63e00ed48aac4d66a871baa9f72f0b33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "63e00ed48aac4d66a871baa9f72f0b33" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 33335 } } }
I20260811 08:13:32.967588 23865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63e00ed48aac4d66a871baa9f72f0b33 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:32.967809 23864 sys_catalog.cc:458] T 00000000000000000000000000000000 P 63e00ed48aac4d66a871baa9f72f0b33 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:32.967947 23874 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:13:32.968528 23874 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:13:32.968806 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 23728
I20260811 08:13:32.968906 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:13:32.969077 21114 external_mini_cluster.cc:1428] Setting key e7807735b7ee3bb9c295c753ea0cca11
I20260811 08:13:32.970399 23874 catalog_manager.cc:1347] Generated new cluster ID: 1eef7046e7f441ba8b5d4b7cdb8b36b0
I20260811 08:13:32.970572 23874 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:13:32 dist-test-slave-gkw7 krb5kdc[23709](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436012, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:32.979053 23898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:32.969736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49894 (local address 127.20.158.190:33335)
0811 08:13:32.969970 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:32.969978 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:32.970000 (+ 22us) server_negotiation.cc:407] Connection header received
0811 08:13:32.970096 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:32.970102 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:32.970172 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:32.970358 (+ 186us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:32.971071 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:32.971965 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:32.972755 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:32.973218 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:32.973352 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:32.975650 (+ 2298us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:32.975654 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:32.975655 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:32.975667 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:32.977425 (+ 1758us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:32.977839 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:32.977842 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:32.977843 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:32.977946 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:32.978165 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:32.978166 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:32.978166 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:32.978408 (+ 242us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:32.978583 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:32.978703 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 08:13:32.978862 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":108,"threads_started":1}
I20260811 08:13:32.983875 23874 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:13:32.984390 23874 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:13:32.988366 23874 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 63e00ed48aac4d66a871baa9f72f0b33: Generated new TSK 0
I20260811 08:13:32.988555 23874 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.158.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
I20260811 08:13:33.021404 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:0
--local_ip_for_outbound_sockets=127.20.158.129
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:33335
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:37649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:33.125671 23905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:33.125874 23905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:33.125898 23905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:33.126957 23905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:33.126991 23905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:33.127010 23905 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 08:13:33.127022 23905 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 08:13:33.127039 23905 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:13:33.128515 23905 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:37649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.158.190:33335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23905
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:33.128718 23905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:33.128896 23905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:33.133860 23915 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:33.133868 23913 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:33.133869 23912 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:33.134308 23905 server_base.cc:1034] running on GCE node
I20260811 08:13:33.134523 23905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:33.134745 23905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:33.135896 23905 hybrid_clock.cc:648] HybridClock initialized: now 1786436013135882 us; error 29 us; skew 500 ppm
Aug 11 08:13:33 dist-test-slave-gkw7 krb5kdc[23709](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436013, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:33.138478 23905 init.cc:377] Logged in from keytab as kudu/127.20.158.129@KRBTEST.COM (short username kudu)
I20260811 08:13:33.138970 23905 webserver.cc:460] Webserver started at http://127.20.158.129:36191/ using document root <none> and password file <none>
I20260811 08:13:33.139226 23905 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:33.139273 23905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:33.139446 23905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:33.140561 23905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-0/data/instance:
uuid: "49b30f1b46854ea18283ce2107786d31"
format_stamp: "Formatted at 2026-08-11 08:13:33 on dist-test-slave-gkw7"
server_key: "0947d1482957295be2edc205aa8a34d9"
server_key_iv: "48f79f8615c05ebffc9771d6cac0ff60"
server_key_version: "encryptionkey@0"
I20260811 08:13:33.140933 23905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance:
uuid: "49b30f1b46854ea18283ce2107786d31"
format_stamp: "Formatted at 2026-08-11 08:13:33 on dist-test-slave-gkw7"
server_key: "0947d1482957295be2edc205aa8a34d9"
server_key_iv: "48f79f8615c05ebffc9771d6cac0ff60"
server_key_version: "encryptionkey@0"
I20260811 08:13:33.142455 23905 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:13:33.143250 23927 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:33.143441 23905 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:33.143538 23905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "49b30f1b46854ea18283ce2107786d31"
format_stamp: "Formatted at 2026-08-11 08:13:33 on dist-test-slave-gkw7"
server_key: "0947d1482957295be2edc205aa8a34d9"
server_key_iv: "48f79f8615c05ebffc9771d6cac0ff60"
server_key_version: "encryptionkey@0"
I20260811 08:13:33.143615 23905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:33.156862 23905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:33.158900 23905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:33.159063 23905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:33.159638 23905 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:33.159679 23905 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:33.159701 23905 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:33.159739 23905 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 08:13:33 dist-test-slave-gkw7 krb5kdc[23709](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436013, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:33.167572 23905 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:41587
I20260811 08:13:33.167646 24108 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:41587 every 8 connection(s)
I20260811 08:13:33.168040 23905 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:13:33.168457 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 23905
I20260811 08:13:33.168583 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance
I20260811 08:13:33.168790 21114 external_mini_cluster.cc:1428] Setting key 236dfb62037d0371c8c7e82f80a01ef3
I20260811 08:13:33.170498 23898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.160044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:47537 (local address 127.20.158.190:33335)
0811 08:13:33.160111 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:33.160113 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:33.160348 (+ 235us) server_negotiation.cc:407] Connection header received
0811 08:13:33.160824 (+ 476us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:33.160826 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:33.160846 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:33.160923 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:33.161561 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.162444 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.163545 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.163767 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.163847 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.167107 (+ 3260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:33.167109 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:33.167109 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:33.167119 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:33.169020 (+ 1901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:33.169467 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:33.169469 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:33.169469 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:33.169557 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:33.169815 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:33.169817 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:33.169817 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:33.169938 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:33.170016 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:33.170298 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 08:13:33.170401 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 08:13:33.170651 23942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.160033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:33335 (local address 127.20.158.129:47537)
0811 08:13:33.160205 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:33.160239 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:33.160718 (+ 479us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:33.160992 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:33.160995 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:33.161247 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:33.161429 (+ 182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.161432 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.162564 (+ 1132us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.162565 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.163448 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.163451 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.163867 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.163868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.163984 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.164464 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:33.164474 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:33.167017 (+ 2543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:33.169102 (+ 2085us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:33.169110 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:33.169112 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:33.169394 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:33.169616 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:33.169617 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:33.169617 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:33.169742 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:33.170007 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:33.170014 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:33.170152 (+ 138us) client_negotiation.cc:769] Sending connection context
0811 08:13:33.170261 (+ 109us) client_negotiation.cc:240] Negotiation successful
0811 08:13:33.170414 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":88,"threads_started":1}
I20260811 08:13:33.171205 24109 heartbeater.cc:347] Connected to a master server at 127.20.158.190:33335
I20260811 08:13:33.171336 24109 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:33.171514 24109 heartbeater.cc:511] Master 127.20.158.190:33335 requested a full tablet report, sending...
I20260811 08:13:33.172062 23781 ts_manager.cc:194] Registered new tserver with Master: 49b30f1b46854ea18283ce2107786d31 (127.20.158.129:41587)
I20260811 08:13:33.172894 23781 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.129@KRBTEST.COM'} at 127.20.158.129:47537
I20260811 08:13:33.178270 24121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.172205 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:33335 (local address 127.20.158.129:38079)
0811 08:13:33.172365 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:33.172378 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:33.172464 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:33.172603 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:33.172603 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:33.172821 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:33.172887 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.172889 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.173711 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.173712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.174236 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.174257 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.174826 (+ 569us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.174827 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.174886 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.175318 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:33.175322 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:33.175582 (+ 260us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:33.177106 (+ 1524us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:33.177107 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:33.177107 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:33.177282 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:33.177487 (+ 205us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:33.177488 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:33.177489 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:33.177563 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:33.177919 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:33.177920 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:33.177968 (+ 48us) client_negotiation.cc:769] Sending connection context
0811 08:13:33.178065 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 08:13:33.178170 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":81,"threads_started":1}
I20260811 08:13:33.178292 23898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.172366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:38079 (local address 127.20.158.190:33335)
0811 08:13:33.172400 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:33.172401 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:33.172451 (+ 50us) server_negotiation.cc:407] Connection header received
0811 08:13:33.172523 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:33.172524 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:33.172532 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:33.172585 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:33.172972 (+ 387us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.173612 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.174399 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.174738 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.174811 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.175682 (+ 871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:33.175684 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:33.175684 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:33.175691 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:33.177021 (+ 1330us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:33.177359 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:33.177360 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:33.177361 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:33.177414 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:33.177613 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:33.177614 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:33.177614 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:33.177811 (+ 197us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:33.177926 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:33.178094 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 08:13:33.178207 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
WARNING: no policy specified for kudu/127.20.158.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
I20260811 08:13:33.196432 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:0
--local_ip_for_outbound_sockets=127.20.158.130
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:33335
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:37649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:33.286001 24124 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:33.286221 24124 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:33.286249 24124 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:33.287420 24124 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:33.287467 24124 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:33.287488 24124 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 08:13:33.287500 24124 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 08:13:33.287518 24124 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:13:33.289072 24124 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:37649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.158.190:33335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24124
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:33.289350 24124 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:33.289652 24124 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:33.294828 24135 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:33.294821 24130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:33.295018 24124 server_base.cc:1034] running on GCE node
W20260811 08:13:33.295051 24132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:33.295270 24124 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:33.295518 24124 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:33.296690 24124 hybrid_clock.cc:648] HybridClock initialized: now 1786436013296677 us; error 45 us; skew 500 ppm
Aug 11 08:13:33 dist-test-slave-gkw7 krb5kdc[23709](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436013, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:33.299441 24124 init.cc:377] Logged in from keytab as kudu/127.20.158.130@KRBTEST.COM (short username kudu)
I20260811 08:13:33.300005 24124 webserver.cc:460] Webserver started at http://127.20.158.130:42045/ using document root <none> and password file <none>
I20260811 08:13:33.300285 24124 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:33.300356 24124 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:33.300520 24124 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:33.301643 24124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-1/data/instance:
uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe"
format_stamp: "Formatted at 2026-08-11 08:13:33 on dist-test-slave-gkw7"
server_key: "a63d7001eefd145ec800d48cd6e7638b"
server_key_iv: "dc2c9a3bbece458575116b561585bcea"
server_key_version: "encryptionkey@0"
I20260811 08:13:33.302034 24124 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance:
uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe"
format_stamp: "Formatted at 2026-08-11 08:13:33 on dist-test-slave-gkw7"
server_key: "a63d7001eefd145ec800d48cd6e7638b"
server_key_iv: "dc2c9a3bbece458575116b561585bcea"
server_key_version: "encryptionkey@0"
I20260811 08:13:33.303399 24124 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:13:33.304188 24144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:33.304395 24124 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:33.304507 24124 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe"
format_stamp: "Formatted at 2026-08-11 08:13:33 on dist-test-slave-gkw7"
server_key: "a63d7001eefd145ec800d48cd6e7638b"
server_key_iv: "dc2c9a3bbece458575116b561585bcea"
server_key_version: "encryptionkey@0"
I20260811 08:13:33.304580 24124 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:33.317044 24124 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:33.319396 24124 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:33.319562 24124 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:33.320204 24124 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:33.320258 24124 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:33.320295 24124 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:33.320319 24124 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 08:13:33 dist-test-slave-gkw7 krb5kdc[23709](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436013, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:33.327684 24124 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:36117
I20260811 08:13:33.327770 24340 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:36117 every 8 connection(s)
I20260811 08:13:33.328099 24124 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
I20260811 08:13:33.330742 23898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.320632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:49793 (local address 127.20.158.190:33335)
0811 08:13:33.320713 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:33.320716 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:33.320944 (+ 228us) server_negotiation.cc:407] Connection header received
0811 08:13:33.321524 (+ 580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:33.321525 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:33.321562 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:33.321616 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:33.322356 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.323050 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.324743 (+ 1693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.325104 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.325215 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.327640 (+ 2425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:33.327643 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:33.327643 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:33.327652 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:33.329205 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:33.329712 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:33.329714 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:33.329714 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:33.329783 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:33.330045 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:33.330046 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:33.330046 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:33.330183 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:33.330267 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:33.330563 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 08:13:33.330648 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 08:13:33.330945 24160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.320618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:33335 (local address 127.20.158.130:49793)
0811 08:13:33.320808 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:33.320849 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:33.321403 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:33.321690 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:33.321697 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:33.322042 (+ 345us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:33.322255 (+ 213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.322260 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.323155 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.323156 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.324625 (+ 1469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.324629 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.325231 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.325232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.325387 (+ 155us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.325990 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:33.325998 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:33.327538 (+ 1540us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:33.329304 (+ 1766us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:33.329310 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:33.329312 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:33.329621 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:33.329854 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:33.329854 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:33.329855 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:33.329973 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:33.330268 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:33.330276 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:33.330419 (+ 143us) client_negotiation.cc:769] Sending connection context
0811 08:13:33.330538 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 08:13:33.330706 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":119,"threads_started":1}
I20260811 08:13:33.331489 24342 heartbeater.cc:347] Connected to a master server at 127.20.158.190:33335
I20260811 08:13:33.331566 24342 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:33.331753 24342 heartbeater.cc:511] Master 127.20.158.190:33335 requested a full tablet report, sending...
I20260811 08:13:33.332130 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 24124
I20260811 08:13:33.332206 23782 ts_manager.cc:194] Registered new tserver with Master: 65e96adaf18f4dbeb6ebba3f5f34d6fe (127.20.158.130:36117)
I20260811 08:13:33.332233 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance
I20260811 08:13:33.332403 21114 external_mini_cluster.cc:1428] Setting key 8c175a2bc4d73e74e22afea6fccd49a1
I20260811 08:13:33.332695 23782 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.130@KRBTEST.COM'} at 127.20.158.130:49793
I20260811 08:13:33.339262 23898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.332718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:58539 (local address 127.20.158.190:33335)
0811 08:13:33.332760 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:33.332762 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:33.332845 (+ 83us) server_negotiation.cc:407] Connection header received
0811 08:13:33.332929 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:33.332930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:33.332941 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:33.333000 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:33.333914 (+ 914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.334409 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.335108 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.335318 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.335391 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.336314 (+ 923us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:33.336315 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:33.336316 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:33.336322 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:33.337942 (+ 1620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:33.338349 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:33.338351 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:33.338351 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:33.338417 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:33.338658 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:33.338659 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:33.338659 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:33.338820 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:33.338910 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:33.339081 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 08:13:33.339164 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:13:33.339263 24349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.332654 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:33335 (local address 127.20.158.130:58539)
0811 08:13:33.332789 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:33.332800 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:33.332872 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:33.333589 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:33.333590 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:33.333771 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:33.333823 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.333825 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.334509 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.334510 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.335025 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.335026 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.335402 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.335403 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.335482 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.335917 (+ 435us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:33.335922 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:33.336207 (+ 285us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:33.338049 (+ 1842us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:33.338051 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:33.338051 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:33.338251 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:33.338500 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:33.338501 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:33.338502 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:33.338586 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:33.338901 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:33.338901 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:33.338953 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 08:13:33.339053 (+ 100us) client_negotiation.cc:240] Negotiation successful
0811 08:13:33.339164 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":72,"threads_started":1}
WARNING: no policy specified for kudu/127.20.158.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
I20260811 08:13:33.360862 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:0
--local_ip_for_outbound_sockets=127.20.158.131
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:33335
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:37649
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:33.446503 24356 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:33.446797 24356 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:33.446828 24356 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:33.447989 24356 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:33.448035 24356 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:33.448055 24356 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260811 08:13:33.448067 24356 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 08:13:33.448086 24356 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:13:33.449582 24356 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:37649
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.158.190:33335
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24356
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:33.449857 24356 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:33.450096 24356 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:33.455245 24364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:33.455288 24366 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:33.455245 24368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:33.455523 24356 server_base.cc:1034] running on GCE node
I20260811 08:13:33.455758 24356 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:33.456029 24356 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:33.457198 24356 hybrid_clock.cc:648] HybridClock initialized: now 1786436013457206 us; error 69 us; skew 500 ppm
Aug 11 08:13:33 dist-test-slave-gkw7 krb5kdc[23709](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436013, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:33.460150 24356 init.cc:377] Logged in from keytab as kudu/127.20.158.131@KRBTEST.COM (short username kudu)
I20260811 08:13:33.460558 24356 webserver.cc:460] Webserver started at http://127.20.158.131:45981/ using document root <none> and password file <none>
I20260811 08:13:33.460794 24356 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:33.460842 24356 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:33.461002 24356 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:33.462211 24356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-2/data/instance:
uuid: "242ede39785f459586517b1297d71edb"
format_stamp: "Formatted at 2026-08-11 08:13:33 on dist-test-slave-gkw7"
server_key: "2e6f1933976b5184a062546fc4c100a0"
server_key_iv: "4656808a56452db0a9ae2167300da4c2"
server_key_version: "encryptionkey@0"
I20260811 08:13:33.462585 24356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance:
uuid: "242ede39785f459586517b1297d71edb"
format_stamp: "Formatted at 2026-08-11 08:13:33 on dist-test-slave-gkw7"
server_key: "2e6f1933976b5184a062546fc4c100a0"
server_key_iv: "4656808a56452db0a9ae2167300da4c2"
server_key_version: "encryptionkey@0"
I20260811 08:13:33.464061 24356 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:13:33.464891 24378 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:33.465107 24356 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:33.465251 24356 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "242ede39785f459586517b1297d71edb"
format_stamp: "Formatted at 2026-08-11 08:13:33 on dist-test-slave-gkw7"
server_key: "2e6f1933976b5184a062546fc4c100a0"
server_key_iv: "4656808a56452db0a9ae2167300da4c2"
server_key_version: "encryptionkey@0"
I20260811 08:13:33.465329 24356 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:33.478853 24356 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:33.481225 24356 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:33.481390 24356 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:33.482050 24356 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:33.482116 24356 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:33.482167 24356 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:33.482195 24356 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:33.489464 24356 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:46663
Aug 11 08:13:33 dist-test-slave-gkw7 krb5kdc[23709](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436013, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:33.489559 24562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:46663 every 8 connection(s)
I20260811 08:13:33.489897 24356 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
I20260811 08:13:33.492785 23898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.482584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:42301 (local address 127.20.158.190:33335)
0811 08:13:33.482666 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:33.482670 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:33.482856 (+ 186us) server_negotiation.cc:407] Connection header received
0811 08:13:33.483365 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:33.483367 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:33.483382 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:33.483471 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:33.484355 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.485223 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.486850 (+ 1627us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.487197 (+ 347us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.487284 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.490100 (+ 2816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:33.490116 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:33.490116 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:33.490126 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:33.491608 (+ 1482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:33.491984 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:33.491985 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:33.491985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:33.492039 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:33.492268 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:33.492268 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:33.492269 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:33.492375 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:33.492429 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:33.492659 (+ 230us) server_negotiation.cc:299] Negotiation successful
0811 08:13:33.492723 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 08:13:33.492961 24390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.482544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:33335 (local address 127.20.158.131:42301)
0811 08:13:33.482719 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:33.482759 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:33.483264 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:33.483525 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:33.483528 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:33.483917 (+ 389us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:33.484243 (+ 326us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.484250 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.485338 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.485340 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.486748 (+ 1408us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.486752 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.487300 (+ 548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.487301 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.487449 (+ 148us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.488010 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:33.488022 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:33.489990 (+ 1968us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:33.491685 (+ 1695us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:33.491690 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:33.491692 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:33.491918 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:33.492100 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:33.492101 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:33.492101 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:33.492209 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:33.492434 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:33.492438 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:33.492549 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 08:13:33.492648 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 08:13:33.492766 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":102,"threads_started":1}
I20260811 08:13:33.493574 24563 heartbeater.cc:347] Connected to a master server at 127.20.158.190:33335
I20260811 08:13:33.493669 24563 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:33.493868 24563 heartbeater.cc:511] Master 127.20.158.190:33335 requested a full tablet report, sending...
I20260811 08:13:33.494241 23781 ts_manager.cc:194] Registered new tserver with Master: 242ede39785f459586517b1297d71edb (127.20.158.131:46663)
I20260811 08:13:33.494634 23781 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.131@KRBTEST.COM'} at 127.20.158.131:42301
I20260811 08:13:33.496654 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 24356
I20260811 08:13:33.496726 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance
I20260811 08:13:33.496909 21114 external_mini_cluster.cc:1428] Setting key 04453319bd417bae8a487e45eeeb2a8a
I20260811 08:13:33.497684 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:13:33.500758 23898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.494776 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:48789 (local address 127.20.158.190:33335)
0811 08:13:33.494816 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:33.494818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:33.494947 (+ 129us) server_negotiation.cc:407] Connection header received
0811 08:13:33.495020 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:33.495021 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:33.495030 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:33.495074 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:33.495385 (+ 311us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.495854 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.496583 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.496832 (+ 249us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.496889 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.497972 (+ 1083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:33.497973 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:33.497973 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:33.497981 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:33.499552 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:33.499901 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:33.499902 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:33.499903 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:33.499964 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:33.500197 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:33.500198 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:33.500198 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:33.500354 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:33.500426 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:33.500637 (+ 211us) server_negotiation.cc:299] Negotiation successful
0811 08:13:33.500700 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:13:33.500857 24570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.494725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:33335 (local address 127.20.158.131:48789)
0811 08:13:33.494872 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:33.494887 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:33.494962 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:33.495078 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:33.495078 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:33.495258 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:33.495306 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.495308 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.495950 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.495951 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.496493 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.496496 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.496908 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.496909 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.496990 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.497490 (+ 500us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:33.497495 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:33.497894 (+ 399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:33.499653 (+ 1759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:33.499654 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:33.499654 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:33.499823 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:33.500052 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:33.500053 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:33.500053 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:33.500121 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:33.500453 (+ 332us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:33.500454 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:33.500521 (+ 67us) client_negotiation.cc:769] Sending connection context
0811 08:13:33.500615 (+ 94us) client_negotiation.cc:240] Negotiation successful
0811 08:13:33.500730 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":66,"threads_started":1}
Aug 11 08:13:33 dist-test-slave-gkw7 krb5kdc[23709](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436013, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 08:13:33 dist-test-slave-gkw7 krb5kdc[23709](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436013, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:33.523764 23898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.516048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49908 (local address 127.20.158.190:33335)
0811 08:13:33.516121 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:33.516123 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:33.516132 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:13:33.516164 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:33.516165 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:33.516174 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:33.516237 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:33.516822 (+ 585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.517316 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.518319 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.518569 (+ 250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.518655 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.521034 (+ 2379us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:33.521036 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:33.521036 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:33.521054 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:33.522522 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:33.522897 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:33.522898 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:33.522899 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:33.522967 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:33.523201 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:33.523202 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:33.523202 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:33.523325 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:33.523433 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:33.523568 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 08:13:33.523655 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 08:13:33.525614 23781 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49908:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:13:33.527209 23781 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:13:33.534337 24588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.529719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:41587 (local address 127.0.0.1:43398)
0811 08:13:33.529908 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:33.529953 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:33.530026 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:33.530574 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:33.530575 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:33.530577 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:33.530643 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.530645 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.532134 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.532135 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.533223 (+ 1088us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.533225 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.534026 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.534028 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.534109 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.534123 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 08:13:33.534195 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 08:13:33.534250 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"mutex_wait_us":11,"thread_start_us":90,"threads_started":1}
I20260811 08:13:33.534425 24591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.529970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:36117 (local address 127.0.0.1:60716)
0811 08:13:33.530111 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:33.530121 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:33.530176 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:33.530510 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:33.530514 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:33.530516 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:33.530596 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.530599 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.531752 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.531753 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.533138 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.533141 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.534168 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.534169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.534231 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.534234 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:13:33.534286 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 08:13:33.534320 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":80,"threads_started":1}
I20260811 08:13:33.534619 24587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.529756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:46663 (local address 127.0.0.1:60422)
0811 08:13:33.529920 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:33.530045 (+ 125us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:33.530088 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:33.530810 (+ 722us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:33.530811 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:33.530813 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:33.530895 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.530897 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.532258 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.532259 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.533135 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.533138 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.534226 (+ 1088us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.534227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.534298 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.534302 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:13:33.534354 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 08:13:33.534393 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":1,"thread_start_us":94,"threads_started":1}
I20260811 08:13:33.534770 24590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.529859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43398 (local address 127.20.158.129:41587)
0811 08:13:33.530377 (+ 518us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:33.530382 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:33.530394 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:13:33.530440 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:33.530442 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:33.530459 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:33.530723 (+ 264us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:33.530788 (+ 65us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.532032 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.533309 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.533907 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.534027 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.534092 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:33.534595 (+ 503us) server_negotiation.cc:299] Negotiation successful
0811 08:13:33.534629 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":474,"thread_start_us":83,"threads_started":1}
I20260811 08:13:33.535018 24592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.530093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60716 (local address 127.20.158.130:36117)
0811 08:13:33.530293 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:33.530299 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:33.530310 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:13:33.530354 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:33.530356 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:33.530371 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:33.530682 (+ 311us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:33.530740 (+ 58us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.531669 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.533236 (+ 1567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.534038 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.534164 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.534216 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:33.534299 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 08:13:33.534349 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":102,"threads_started":1}
I20260811 08:13:33.535145 24593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.530229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60422 (local address 127.20.158.131:46663)
0811 08:13:33.530626 (+ 397us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:33.530630 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:33.530640 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:13:33.530681 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:33.530683 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:33.530699 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:33.530792 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:33.530981 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.532164 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.533279 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.534038 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.534118 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.534187 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:33.534808 (+ 621us) server_negotiation.cc:299] Negotiation successful
0811 08:13:33.534956 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":214,"thread_start_us":112,"threads_started":1}
I20260811 08:13:33.535524 24006 tablet_service.cc:1467] Processing CreateTablet for tablet 1647ecafafe54c9f9cbef5704b44752e (DEFAULT_TABLE table=test-table [id=8ede8def83d6471485ba1ee3ad7db11a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:33.535607 24224 tablet_service.cc:1467] Processing CreateTablet for tablet 1647ecafafe54c9f9cbef5704b44752e (DEFAULT_TABLE table=test-table [id=8ede8def83d6471485ba1ee3ad7db11a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:33.535804 24459 tablet_service.cc:1467] Processing CreateTablet for tablet 1647ecafafe54c9f9cbef5704b44752e (DEFAULT_TABLE table=test-table [id=8ede8def83d6471485ba1ee3ad7db11a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:33.535938 24006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1647ecafafe54c9f9cbef5704b44752e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:33.535938 24224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1647ecafafe54c9f9cbef5704b44752e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:33.536144 24459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1647ecafafe54c9f9cbef5704b44752e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:33.538883 24594 tablet_bootstrap.cc:492] T 1647ecafafe54c9f9cbef5704b44752e P 242ede39785f459586517b1297d71edb: Bootstrap starting.
I20260811 08:13:33.539680 24595 tablet_bootstrap.cc:492] T 1647ecafafe54c9f9cbef5704b44752e P 49b30f1b46854ea18283ce2107786d31: Bootstrap starting.
I20260811 08:13:33.539860 24596 tablet_bootstrap.cc:492] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Bootstrap starting.
I20260811 08:13:33.539958 24594 tablet_bootstrap.cc:654] T 1647ecafafe54c9f9cbef5704b44752e P 242ede39785f459586517b1297d71edb: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:33.540315 24594 log.cc:824] T 1647ecafafe54c9f9cbef5704b44752e P 242ede39785f459586517b1297d71edb: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:33.540359 24595 tablet_bootstrap.cc:654] T 1647ecafafe54c9f9cbef5704b44752e P 49b30f1b46854ea18283ce2107786d31: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:33.540485 24596 tablet_bootstrap.cc:654] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:33.540688 24595 log.cc:824] T 1647ecafafe54c9f9cbef5704b44752e P 49b30f1b46854ea18283ce2107786d31: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:33.540828 24596 log.cc:824] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:33.541290 24594 tablet_bootstrap.cc:492] T 1647ecafafe54c9f9cbef5704b44752e P 242ede39785f459586517b1297d71edb: No bootstrap required, opened a new log
I20260811 08:13:33.541383 24594 ts_tablet_manager.cc:1397] T 1647ecafafe54c9f9cbef5704b44752e P 242ede39785f459586517b1297d71edb: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 08:13:33.541702 24596 tablet_bootstrap.cc:492] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe: No bootstrap required, opened a new log
I20260811 08:13:33.541783 24596 ts_tablet_manager.cc:1397] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:13:33.542835 24594 raft_consensus.cc:348] T 1647ecafafe54c9f9cbef5704b44752e P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:33.542968 24594 raft_consensus.cc:374] T 1647ecafafe54c9f9cbef5704b44752e P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:33.542990 24594 raft_consensus.cc:729] T 1647ecafafe54c9f9cbef5704b44752e P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 242ede39785f459586517b1297d71edb, State: Initialized, Role: FOLLOWER
I20260811 08:13:33.543113 24594 consensus_queue.cc:260] T 1647ecafafe54c9f9cbef5704b44752e P 242ede39785f459586517b1297d71edb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:33.543220 24596 raft_consensus.cc:348] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:33.543382 24594 ts_tablet_manager.cc:1428] T 1647ecafafe54c9f9cbef5704b44752e P 242ede39785f459586517b1297d71edb: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 08:13:33.543383 24596 raft_consensus.cc:374] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:33.543423 24563 heartbeater.cc:503] Master 127.20.158.190:33335 was elected leader, sending a full tablet report...
I20260811 08:13:33.543427 24596 raft_consensus.cc:729] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65e96adaf18f4dbeb6ebba3f5f34d6fe, State: Initialized, Role: FOLLOWER
I20260811 08:13:33.543542 24596 consensus_queue.cc:260] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:33.543818 24595 tablet_bootstrap.cc:492] T 1647ecafafe54c9f9cbef5704b44752e P 49b30f1b46854ea18283ce2107786d31: No bootstrap required, opened a new log
I20260811 08:13:33.543810 24596 ts_tablet_manager.cc:1428] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:13:33.543872 24595 ts_tablet_manager.cc:1397] T 1647ecafafe54c9f9cbef5704b44752e P 49b30f1b46854ea18283ce2107786d31: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260811 08:13:33.543962 24342 heartbeater.cc:503] Master 127.20.158.190:33335 was elected leader, sending a full tablet report...
I20260811 08:13:33.545537 24595 raft_consensus.cc:348] T 1647ecafafe54c9f9cbef5704b44752e P 49b30f1b46854ea18283ce2107786d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:33.545740 24595 raft_consensus.cc:374] T 1647ecafafe54c9f9cbef5704b44752e P 49b30f1b46854ea18283ce2107786d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:33.545776 24595 raft_consensus.cc:729] T 1647ecafafe54c9f9cbef5704b44752e P 49b30f1b46854ea18283ce2107786d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49b30f1b46854ea18283ce2107786d31, State: Initialized, Role: FOLLOWER
I20260811 08:13:33.545889 24595 consensus_queue.cc:260] T 1647ecafafe54c9f9cbef5704b44752e P 49b30f1b46854ea18283ce2107786d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:33.546142 24595 ts_tablet_manager.cc:1428] T 1647ecafafe54c9f9cbef5704b44752e P 49b30f1b46854ea18283ce2107786d31: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 08:13:33.546207 24109 heartbeater.cc:503] Master 127.20.158.190:33335 was elected leader, sending a full tablet report...
I20260811 08:13:33.550843 24605 raft_consensus.cc:482] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:13:33.551025 24605 raft_consensus.cc:504] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:33.551468 24605 leader_election.cc:288] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49b30f1b46854ea18283ce2107786d31 (127.20.158.129:41587), 242ede39785f459586517b1297d71edb (127.20.158.131:46663)
I20260811 08:13:33.555351 24593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.551721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:44789 (local address 127.20.158.131:46663)
0811 08:13:33.551776 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:33.551778 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:33.551900 (+ 122us) server_negotiation.cc:407] Connection header received
0811 08:13:33.551971 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:33.551971 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:33.551979 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:33.552036 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:33.552150 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.552857 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.554408 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.554972 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.555053 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.555061 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:33.555244 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 08:13:33.555283 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 08:13:33.555351 24590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.551665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:46353 (local address 127.20.158.129:41587)
0811 08:13:33.551813 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:33.551815 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:33.551821 (+ 6us) server_negotiation.cc:407] Connection header received
0811 08:13:33.551845 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:33.551846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:33.551860 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:33.551926 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:33.552112 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.552878 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.554408 (+ 1530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.554972 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.555053 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.555061 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:33.555244 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 08:13:33.555283 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":129}
I20260811 08:13:33.555365 24160 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.551627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:41587 (local address 127.20.158.130:46353)
0811 08:13:33.551690 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:33.551701 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:33.551741 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:33.551954 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:33.551955 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:33.551957 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:33.552035 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.552037 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.552959 (+ 922us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.552960 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.554311 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.554314 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.555060 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.555061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.555161 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.555164 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:13:33.555222 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 08:13:33.555267 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":59}
I20260811 08:13:33.555377 24610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.551646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:46663 (local address 127.20.158.130:44789)
0811 08:13:33.551822 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:33.551835 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:33.551893 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:33.552032 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:33.552032 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:33.552033 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:33.552090 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.552091 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.552959 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.552960 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.554311 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.554314 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.555060 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.555061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.555137 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.555143 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 08:13:33.555232 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 08:13:33.555267 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":67,"thread_start_us":125,"threads_started":1}
I20260811 08:13:33.555835 24491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1647ecafafe54c9f9cbef5704b44752e" candidate_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "242ede39785f459586517b1297d71edb" is_pre_election: true
I20260811 08:13:33.555853 24043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1647ecafafe54c9f9cbef5704b44752e" candidate_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49b30f1b46854ea18283ce2107786d31" is_pre_election: true
I20260811 08:13:33.555995 24491 raft_consensus.cc:2454] T 1647ecafafe54c9f9cbef5704b44752e P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65e96adaf18f4dbeb6ebba3f5f34d6fe in term 0.
I20260811 08:13:33.555995 24043 raft_consensus.cc:2454] T 1647ecafafe54c9f9cbef5704b44752e P 49b30f1b46854ea18283ce2107786d31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65e96adaf18f4dbeb6ebba3f5f34d6fe in term 0.
I20260811 08:13:33.556237 24146 leader_election.cc:302] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 242ede39785f459586517b1297d71edb, 65e96adaf18f4dbeb6ebba3f5f34d6fe; no voters:
I20260811 08:13:33.556423 24605 raft_consensus.cc:2781] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:13:33.556469 24605 raft_consensus.cc:482] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:13:33.556485 24605 raft_consensus.cc:3037] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:33.557161 24605 raft_consensus.cc:504] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:33.557386 24605 leader_election.cc:288] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe [CANDIDATE]: Term 1 election: Requested vote from peers 49b30f1b46854ea18283ce2107786d31 (127.20.158.129:41587), 242ede39785f459586517b1297d71edb (127.20.158.131:46663)
I20260811 08:13:33.557462 24491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1647ecafafe54c9f9cbef5704b44752e" candidate_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "242ede39785f459586517b1297d71edb"
I20260811 08:13:33.557554 24491 raft_consensus.cc:3037] T 1647ecafafe54c9f9cbef5704b44752e P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:33.557505 24043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1647ecafafe54c9f9cbef5704b44752e" candidate_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49b30f1b46854ea18283ce2107786d31"
I20260811 08:13:33.557634 24043 raft_consensus.cc:3037] T 1647ecafafe54c9f9cbef5704b44752e P 49b30f1b46854ea18283ce2107786d31 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:33.558274 24491 raft_consensus.cc:2454] T 1647ecafafe54c9f9cbef5704b44752e P 242ede39785f459586517b1297d71edb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e96adaf18f4dbeb6ebba3f5f34d6fe in term 1.
I20260811 08:13:33.558350 24043 raft_consensus.cc:2454] T 1647ecafafe54c9f9cbef5704b44752e P 49b30f1b46854ea18283ce2107786d31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e96adaf18f4dbeb6ebba3f5f34d6fe in term 1.
I20260811 08:13:33.558475 24146 leader_election.cc:302] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 242ede39785f459586517b1297d71edb, 65e96adaf18f4dbeb6ebba3f5f34d6fe; no voters:
I20260811 08:13:33.558559 24605 raft_consensus.cc:2781] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:33.558730 24605 raft_consensus.cc:686] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 1 LEADER]: Becoming Leader. State: Replica: 65e96adaf18f4dbeb6ebba3f5f34d6fe, State: Running, Role: LEADER
I20260811 08:13:33.558826 24605 consensus_queue.cc:237] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:33.559648 23781 catalog_manager.cc:5495] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe reported cstate change: term changed from 0 to 1, leader changed from <none> to 65e96adaf18f4dbeb6ebba3f5f34d6fe (127.20.158.130). New cstate: current_term: 1 leader_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } health_report { overall_health: UNKNOWN } } }
W20260811 08:13:33.578962 24343 tablet.cc:2369] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 11 08:13:33 dist-test-slave-gkw7 krb5kdc[23709](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436012, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:33.605509 23898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.598513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49914 (local address 127.20.158.190:33335)
0811 08:13:33.598613 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:33.598615 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:33.598735 (+ 120us) server_negotiation.cc:407] Connection header received
0811 08:13:33.598820 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:33.598821 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:33.598833 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:33.598907 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:33.599398 (+ 491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.599895 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.600719 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.600898 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.600975 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.603108 (+ 2133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:33.603110 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:33.603110 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:33.603118 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:33.604336 (+ 1218us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:33.604712 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:33.604713 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:33.604714 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:33.604769 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:33.604961 (+ 192us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:33.604962 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:33.604962 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:33.605073 (+ 111us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:33.605151 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:33.605308 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 08:13:33.605396 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 08:13:33.605618 24627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.598408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:33335 (local address 127.0.0.1:49914)
0811 08:13:33.598646 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:33.598664 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:33.598756 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:33.598912 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:33.598913 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:33.599251 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:33.599301 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.599304 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.599985 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.599987 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.600628 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.600631 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.600974 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.600974 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.601027 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.601589 (+ 562us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:33.601594 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:33.603019 (+ 1425us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:33.604433 (+ 1414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:33.604440 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:33.604443 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:33.604633 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:33.604837 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:33.604837 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:33.604838 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:33.604898 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:33.605140 (+ 242us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:33.605148 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:33.605203 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 08:13:33.605284 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 08:13:33.605466 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":204,"mutex_wait_us":79,"thread_start_us":131,"threads_started":1}
I20260811 08:13:33.607884 23781 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:49914:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 08:13:33.608114 23781 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:13:33.609650 24006 tablet_service.cc:1467] Processing CreateTablet for tablet 896d220459de40b090e9c99adfbcba48 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=93b95a280914418f92e89f2529d110ea]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 08:13:33.609685 24224 tablet_service.cc:1467] Processing CreateTablet for tablet 896d220459de40b090e9c99adfbcba48 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=93b95a280914418f92e89f2529d110ea]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 08:13:33.609685 24459 tablet_service.cc:1467] Processing CreateTablet for tablet 896d220459de40b090e9c99adfbcba48 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=93b95a280914418f92e89f2529d110ea]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 08:13:33.609835 24006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 896d220459de40b090e9c99adfbcba48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:33.609848 24224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 896d220459de40b090e9c99adfbcba48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:33.609848 24459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 896d220459de40b090e9c99adfbcba48. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:33.611104 24595 tablet_bootstrap.cc:492] T 896d220459de40b090e9c99adfbcba48 P 49b30f1b46854ea18283ce2107786d31: Bootstrap starting.
I20260811 08:13:33.611418 24594 tablet_bootstrap.cc:492] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb: Bootstrap starting.
I20260811 08:13:33.611867 24595 tablet_bootstrap.cc:654] T 896d220459de40b090e9c99adfbcba48 P 49b30f1b46854ea18283ce2107786d31: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:33.611987 24594 tablet_bootstrap.cc:654] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:33.612356 24596 tablet_bootstrap.cc:492] T 896d220459de40b090e9c99adfbcba48 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Bootstrap starting.
I20260811 08:13:33.612738 24594 tablet_bootstrap.cc:492] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb: No bootstrap required, opened a new log
I20260811 08:13:33.612802 24596 tablet_bootstrap.cc:654] T 896d220459de40b090e9c99adfbcba48 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:33.612802 24594 ts_tablet_manager.cc:1397] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 08:13:33.612963 24594 raft_consensus.cc:348] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:33.613068 24594 raft_consensus.cc:374] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:33.613098 24594 raft_consensus.cc:729] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 242ede39785f459586517b1297d71edb, State: Initialized, Role: FOLLOWER
I20260811 08:13:33.613161 24594 consensus_queue.cc:260] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:33.613266 24594 ts_tablet_manager.cc:1428] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 08:13:33.613334 24604 tablet_replica.cc:439] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } } }
I20260811 08:13:33.613423 24604 tablet_replica.cc:442] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:13:33.613507 24595 tablet_bootstrap.cc:492] T 896d220459de40b090e9c99adfbcba48 P 49b30f1b46854ea18283ce2107786d31: No bootstrap required, opened a new log
I20260811 08:13:33.613574 24595 ts_tablet_manager.cc:1397] T 896d220459de40b090e9c99adfbcba48 P 49b30f1b46854ea18283ce2107786d31: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:13:33.613746 24595 raft_consensus.cc:348] T 896d220459de40b090e9c99adfbcba48 P 49b30f1b46854ea18283ce2107786d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:33.613863 24595 raft_consensus.cc:374] T 896d220459de40b090e9c99adfbcba48 P 49b30f1b46854ea18283ce2107786d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:33.613895 24595 raft_consensus.cc:729] T 896d220459de40b090e9c99adfbcba48 P 49b30f1b46854ea18283ce2107786d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49b30f1b46854ea18283ce2107786d31, State: Initialized, Role: FOLLOWER
I20260811 08:13:33.613947 24595 consensus_queue.cc:260] T 896d220459de40b090e9c99adfbcba48 P 49b30f1b46854ea18283ce2107786d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:33.613997 24596 tablet_bootstrap.cc:492] T 896d220459de40b090e9c99adfbcba48 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: No bootstrap required, opened a new log
I20260811 08:13:33.614048 24595 ts_tablet_manager.cc:1428] T 896d220459de40b090e9c99adfbcba48 P 49b30f1b46854ea18283ce2107786d31: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:33.614046 24596 ts_tablet_manager.cc:1397] T 896d220459de40b090e9c99adfbcba48 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:13:33.614192 24607 tablet_replica.cc:439] T 896d220459de40b090e9c99adfbcba48 P 49b30f1b46854ea18283ce2107786d31: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } } }
I20260811 08:13:33.614208 24596 raft_consensus.cc:348] T 896d220459de40b090e9c99adfbcba48 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:33.614283 24596 raft_consensus.cc:374] T 896d220459de40b090e9c99adfbcba48 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:33.614271 24607 tablet_replica.cc:442] T 896d220459de40b090e9c99adfbcba48 P 49b30f1b46854ea18283ce2107786d31: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:13:33.614312 24596 raft_consensus.cc:729] T 896d220459de40b090e9c99adfbcba48 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65e96adaf18f4dbeb6ebba3f5f34d6fe, State: Initialized, Role: FOLLOWER
I20260811 08:13:33.614357 24596 consensus_queue.cc:260] T 896d220459de40b090e9c99adfbcba48 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:33.614463 24596 ts_tablet_manager.cc:1428] T 896d220459de40b090e9c99adfbcba48 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:33.614492 24605 tablet_replica.cc:439] T 896d220459de40b090e9c99adfbcba48 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } } }
I20260811 08:13:33.614575 24605 tablet_replica.cc:442] T 896d220459de40b090e9c99adfbcba48 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:13:33.643903 24604 raft_consensus.cc:482] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:13:33.644032 24604 raft_consensus.cc:504] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:33.644429 24604 leader_election.cc:288] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49b30f1b46854ea18283ce2107786d31 (127.20.158.129:41587), 65e96adaf18f4dbeb6ebba3f5f34d6fe (127.20.158.130:36117)
I20260811 08:13:33.647537 24590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.644709 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:47611 (local address 127.20.158.129:41587)
0811 08:13:33.644779 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:33.644781 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:33.644798 (+ 17us) server_negotiation.cc:407] Connection header received
0811 08:13:33.644830 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:33.644831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:33.644841 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:33.644914 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:33.645110 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.645655 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.646808 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.647176 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.647265 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.647273 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:33.647435 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 08:13:33.647471 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 08:13:33.647552 24390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.644631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:41587 (local address 127.20.158.131:47611)
0811 08:13:33.644709 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:33.644723 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:33.644771 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:33.644938 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:33.644939 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:33.644941 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:33.645019 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.645021 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.645737 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.645738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.646718 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.646720 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.647264 (+ 544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.647265 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.647355 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.647358 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:13:33.647426 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 08:13:33.647469 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260811 08:13:33.647898 24043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "896d220459de40b090e9c99adfbcba48" candidate_uuid: "242ede39785f459586517b1297d71edb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49b30f1b46854ea18283ce2107786d31" is_pre_election: true
I20260811 08:13:33.648036 24043 raft_consensus.cc:2454] T 896d220459de40b090e9c99adfbcba48 P 49b30f1b46854ea18283ce2107786d31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 242ede39785f459586517b1297d71edb in term 0.
I20260811 08:13:33.648046 24636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.644748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:36117 (local address 127.20.158.131:43001)
0811 08:13:33.645011 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:33.645021 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:33.645094 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:33.645270 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:33.645271 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:33.645273 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:33.645361 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.645363 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.646084 (+ 721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.646085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.646991 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.646995 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.647821 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.647822 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.647896 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.647905 (+ 9us) client_negotiation.cc:769] Sending connection context
0811 08:13:33.647947 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 08:13:33.647974 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":247,"thread_start_us":177,"threads_started":1}
I20260811 08:13:33.648093 24592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.644882 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:43001 (local address 127.20.158.130:36117)
0811 08:13:33.644931 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:33.644933 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:33.645079 (+ 146us) server_negotiation.cc:407] Connection header received
0811 08:13:33.645180 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:33.645181 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:33.645192 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:33.645264 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:33.645434 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.645995 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.647085 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.647558 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.647647 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.647657 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:33.647978 (+ 321us) server_negotiation.cc:299] Negotiation successful
0811 08:13:33.648023 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 08:13:33.648329 24379 leader_election.cc:302] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 242ede39785f459586517b1297d71edb, 49b30f1b46854ea18283ce2107786d31; no voters:
I20260811 08:13:33.648365 24264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "896d220459de40b090e9c99adfbcba48" candidate_uuid: "242ede39785f459586517b1297d71edb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" is_pre_election: true
I20260811 08:13:33.648489 24264 raft_consensus.cc:2454] T 896d220459de40b090e9c99adfbcba48 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 242ede39785f459586517b1297d71edb in term 0.
I20260811 08:13:33.648490 24604 raft_consensus.cc:2781] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:13:33.648528 24604 raft_consensus.cc:482] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:13:33.648546 24604 raft_consensus.cc:3037] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:33.649260 24604 raft_consensus.cc:504] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:33.649387 24604 leader_election.cc:288] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb [CANDIDATE]: Term 1 election: Requested vote from peers 49b30f1b46854ea18283ce2107786d31 (127.20.158.129:41587), 65e96adaf18f4dbeb6ebba3f5f34d6fe (127.20.158.130:36117)
I20260811 08:13:33.649616 24264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "896d220459de40b090e9c99adfbcba48" candidate_uuid: "242ede39785f459586517b1297d71edb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe"
I20260811 08:13:33.649633 24043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "896d220459de40b090e9c99adfbcba48" candidate_uuid: "242ede39785f459586517b1297d71edb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49b30f1b46854ea18283ce2107786d31"
I20260811 08:13:33.649704 24043 raft_consensus.cc:3037] T 896d220459de40b090e9c99adfbcba48 P 49b30f1b46854ea18283ce2107786d31 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:33.649704 24264 raft_consensus.cc:3037] T 896d220459de40b090e9c99adfbcba48 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:33.650543 24264 raft_consensus.cc:2454] T 896d220459de40b090e9c99adfbcba48 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 242ede39785f459586517b1297d71edb in term 1.
I20260811 08:13:33.650543 24043 raft_consensus.cc:2454] T 896d220459de40b090e9c99adfbcba48 P 49b30f1b46854ea18283ce2107786d31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 242ede39785f459586517b1297d71edb in term 1.
I20260811 08:13:33.650738 24379 leader_election.cc:302] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 242ede39785f459586517b1297d71edb, 49b30f1b46854ea18283ce2107786d31; no voters:
I20260811 08:13:33.650857 24604 raft_consensus.cc:2781] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:33.651012 24604 raft_consensus.cc:686] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb [term 1 LEADER]: Becoming Leader. State: Replica: 242ede39785f459586517b1297d71edb, State: Running, Role: LEADER
I20260811 08:13:33.651118 24604 consensus_queue.cc:237] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:33.651674 24637 tablet_replica.cc:439] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb: TxnStatusTablet state changed. Reason: New leader 242ede39785f459586517b1297d71edb. Latest consensus state: current_term: 1 leader_uuid: "242ede39785f459586517b1297d71edb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } } }
I20260811 08:13:33.651754 24637 tablet_replica.cc:442] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb: This TxnStatusTablet replica's current role is: LEADER
I20260811 08:13:33.652005 24639 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 08:13:33.652128 24639 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 08:13:33.652112 23781 catalog_manager.cc:5495] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb reported cstate change: term changed from 0 to 1, leader changed from <none> to 242ede39785f459586517b1297d71edb (127.20.158.131). New cstate: current_term: 1 leader_uuid: "242ede39785f459586517b1297d71edb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } health_report { overall_health: HEALTHY } } }
I20260811 08:13:33.660759 24593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.658261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60428 (local address 127.20.158.131:46663)
0811 08:13:33.658309 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:33.658311 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:33.658324 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:13:33.658431 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:33.658432 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:33.658450 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:33.658515 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:33.658667 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.659145 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.659918 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.660128 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.660214 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.660420 (+ 206us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:33.660530 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:33.660623 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:33.660676 (+ 53us) server_negotiation.cc:299] Negotiation successful
0811 08:13:33.660695 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:13:33.660797 24627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.658200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:46663 (local address 127.0.0.1:60428)
0811 08:13:33.658279 (+ 79us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:33.658292 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:33.658342 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:33.658521 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:33.658522 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:33.658523 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:13:33.658597 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.658600 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.659234 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.659236 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.659814 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.659816 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.660217 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.660219 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.660300 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.660315 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:13:33.660606 (+ 291us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:13:33.660616 (+ 10us) client_negotiation.cc:769] Sending connection context
0811 08:13:33.660670 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 08:13:33.660721 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 08:13:33.662675 24043 raft_consensus.cc:1261] T 896d220459de40b090e9c99adfbcba48 P 49b30f1b46854ea18283ce2107786d31 [term 1 FOLLOWER]: Refusing update from remote peer 242ede39785f459586517b1297d71edb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:33.662680 24264 raft_consensus.cc:1261] T 896d220459de40b090e9c99adfbcba48 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 1 FOLLOWER]: Refusing update from remote peer 242ede39785f459586517b1297d71edb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:33.662956 24637 consensus_queue.cc:1035] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb [LEADER]: Connected to new peer: Peer: permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:13:33.663110 24604 consensus_queue.cc:1035] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb [LEADER]: Connected to new peer: Peer: permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:13:33.664315 24605 tablet_replica.cc:439] T 896d220459de40b090e9c99adfbcba48 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: TxnStatusTablet state changed. Reason: New leader 242ede39785f459586517b1297d71edb. Latest consensus state: current_term: 1 leader_uuid: "242ede39785f459586517b1297d71edb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } } }
I20260811 08:13:33.664423 24605 tablet_replica.cc:442] T 896d220459de40b090e9c99adfbcba48 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:13:33.664340 24607 tablet_replica.cc:439] T 896d220459de40b090e9c99adfbcba48 P 49b30f1b46854ea18283ce2107786d31: TxnStatusTablet state changed. Reason: New leader 242ede39785f459586517b1297d71edb. Latest consensus state: current_term: 1 leader_uuid: "242ede39785f459586517b1297d71edb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } } }
I20260811 08:13:33.664459 24607 tablet_replica.cc:442] T 896d220459de40b090e9c99adfbcba48 P 49b30f1b46854ea18283ce2107786d31: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:13:33.665329 24604 tablet_replica.cc:439] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "242ede39785f459586517b1297d71edb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } } }
I20260811 08:13:33.665426 24604 tablet_replica.cc:442] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb: This TxnStatusTablet replica's current role is: LEADER
I20260811 08:13:33.665436 24637 tablet_replica.cc:439] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "242ede39785f459586517b1297d71edb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } } }
I20260811 08:13:33.665573 24637 tablet_replica.cc:442] T 896d220459de40b090e9c99adfbcba48 P 242ede39785f459586517b1297d71edb: This TxnStatusTablet replica's current role is: LEADER
I20260811 08:13:33.665637 24605 tablet_replica.cc:439] T 896d220459de40b090e9c99adfbcba48 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "242ede39785f459586517b1297d71edb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } } }
I20260811 08:13:33.665724 24605 tablet_replica.cc:442] T 896d220459de40b090e9c99adfbcba48 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:13:33.666533 24607 tablet_replica.cc:439] T 896d220459de40b090e9c99adfbcba48 P 49b30f1b46854ea18283ce2107786d31: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "242ede39785f459586517b1297d71edb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } } }
I20260811 08:13:33.666635 24607 tablet_replica.cc:442] T 896d220459de40b090e9c99adfbcba48 P 49b30f1b46854ea18283ce2107786d31: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:13:33.666572 24644 mvcc.cc:205] Tried to move back new op lower bound from 7317241911959674880 to 7317241911916015616. Current Snapshot: MvccSnapshot[applied={T|T < 7317241911959674880}]
I20260811 08:13:33.666203 24643 mvcc.cc:205] Tried to move back new op lower bound from 7317241911959674880 to 7317241911916015616. Current Snapshot: MvccSnapshot[applied={T|T < 7317241911959674880}]
W20260811 08:13:33.668987 24110 tablet.cc:2369] T 1647ecafafe54c9f9cbef5704b44752e P 49b30f1b46854ea18283ce2107786d31: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:13:33.670967 24592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.667946 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60724 (local address 127.20.158.130:36117)
0811 08:13:33.667989 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:33.667991 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:33.668070 (+ 79us) server_negotiation.cc:407] Connection header received
0811 08:13:33.668191 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:33.668191 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:33.668209 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:33.668283 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:33.668417 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.669180 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.670055 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.670369 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.670444 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.670588 (+ 144us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:33.670704 (+ 116us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:33.670780 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:33.670865 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 08:13:33.670889 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:13:33.675947 24349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.673383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:46663 (local address 127.20.158.130:33737)
0811 08:13:33.673457 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:33.673468 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:33.673510 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:33.673652 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:33.673653 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:33.673654 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:13:33.673699 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.673700 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.674572 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.674572 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.675132 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.675133 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.675589 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.675590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.675642 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.675655 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:13:33.675833 (+ 178us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:13:33.675835 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:13:33.675866 (+ 31us) client_negotiation.cc:240] Negotiation successful
0811 08:13:33.675901 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 08:13:33.675964 24593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.673475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:33737 (local address 127.20.158.131:46663)
0811 08:13:33.673547 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:33.673549 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:33.673557 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:13:33.673583 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:33.673583 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:33.673593 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:33.673651 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:33.673757 (+ 106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.674489 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.675213 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.675515 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.675584 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.675741 (+ 157us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:33.675774 (+ 33us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:33.675827 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:33.675878 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 08:13:33.675898 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 08:13:33.678814 24043 raft_consensus.cc:1261] T 1647ecafafe54c9f9cbef5704b44752e P 49b30f1b46854ea18283ce2107786d31 [term 1 FOLLOWER]: Refusing update from remote peer 65e96adaf18f4dbeb6ebba3f5f34d6fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:33.678946 24491 raft_consensus.cc:1261] T 1647ecafafe54c9f9cbef5704b44752e P 242ede39785f459586517b1297d71edb [term 1 FOLLOWER]: Refusing update from remote peer 65e96adaf18f4dbeb6ebba3f5f34d6fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:33.679095 24611 consensus_queue.cc:1035] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:13:33.679196 24605 consensus_queue.cc:1035] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:13:33.680735 24642 mvcc.cc:205] Tried to move back new op lower bound from 7317241912026693632 to 7317241911537577984. Current Snapshot: MvccSnapshot[applied={T|T < 7317241912026693632}]
I20260811 08:13:33.687879 24592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.685430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:52535 (local address 127.20.158.130:36117)
0811 08:13:33.685503 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:33.685505 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:33.685512 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:13:33.685553 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:33.685554 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:33.685563 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:33.685623 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:33.685764 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.686222 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.687148 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.687393 (+ 245us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.687472 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.687650 (+ 178us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:33.687684 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:33.687732 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:33.687788 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 08:13:33.687808 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 08:13:33.687888 24570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.685258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:36117 (local address 127.20.158.131:52535)
0811 08:13:33.685316 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:33.685328 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:33.685373 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:33.685627 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:33.685628 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:33.685629 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:13:33.685688 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.685690 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.686311 (+ 621us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.686312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.687062 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.687064 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.687472 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.687473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.687541 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.687564 (+ 23us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:13:33.687732 (+ 168us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:13:33.687734 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:13:33.687784 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 08:13:33.687825 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260811 08:13:33.697306 23782 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49908:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:13:33.697431 23782 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49908:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:13:33.698251 23782 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 63e00ed48aac4d66a871baa9f72f0b33: Sending DeleteTablet for 3 replicas of tablet 1647ecafafe54c9f9cbef5704b44752e
I20260811 08:13:33.698588 24459 tablet_service.cc:1514] Processing DeleteTablet for tablet 1647ecafafe54c9f9cbef5704b44752e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:33 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:60422
I20260811 08:13:33.698625 24006 tablet_service.cc:1514] Processing DeleteTablet for tablet 1647ecafafe54c9f9cbef5704b44752e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:33 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:43398
I20260811 08:13:33.698859 24224 tablet_service.cc:1514] Processing DeleteTablet for tablet 1647ecafafe54c9f9cbef5704b44752e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:33 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:60716
I20260811 08:13:33.698879 23782 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49908:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:13:33.699023 23782 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:13:33.699070 24674 tablet_replica.cc:330] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe: stopping tablet replica
I20260811 08:13:33.699399 24674 raft_consensus.cc:2229] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:13:33.699533 24674 raft_consensus.cc:2258] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:33.700289 24224 tablet_service.cc:1467] Processing CreateTablet for tablet 10ea886bd68c43be9e525c727d3a9a07 (DEFAULT_TABLE table=test-table [id=1a10b4089dda43169d4bd28cb8547acc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:33.700306 24006 tablet_service.cc:1467] Processing CreateTablet for tablet 10ea886bd68c43be9e525c727d3a9a07 (DEFAULT_TABLE table=test-table [id=1a10b4089dda43169d4bd28cb8547acc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:33.700416 24006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10ea886bd68c43be9e525c727d3a9a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:33.700416 24224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10ea886bd68c43be9e525c727d3a9a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:33.701716 24459 tablet_service.cc:1467] Processing CreateTablet for tablet 10ea886bd68c43be9e525c727d3a9a07 (DEFAULT_TABLE table=test-table [id=1a10b4089dda43169d4bd28cb8547acc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:33.701846 24459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10ea886bd68c43be9e525c727d3a9a07. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:33.703081 24594 tablet_bootstrap.cc:492] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb: Bootstrap starting.
I20260811 08:13:33.703092 24596 tablet_bootstrap.cc:492] T 10ea886bd68c43be9e525c727d3a9a07 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Bootstrap starting.
I20260811 08:13:33.703552 24596 tablet_bootstrap.cc:654] T 10ea886bd68c43be9e525c727d3a9a07 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:33.703552 24594 tablet_bootstrap.cc:654] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:33.704478 24595 tablet_bootstrap.cc:492] T 10ea886bd68c43be9e525c727d3a9a07 P 49b30f1b46854ea18283ce2107786d31: Bootstrap starting.
I20260811 08:13:33.704882 24594 tablet_bootstrap.cc:492] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb: No bootstrap required, opened a new log
I20260811 08:13:33.704905 24595 tablet_bootstrap.cc:654] T 10ea886bd68c43be9e525c727d3a9a07 P 49b30f1b46854ea18283ce2107786d31: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:33.704932 24594 ts_tablet_manager.cc:1397] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 08:13:33.705102 24594 raft_consensus.cc:348] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:33.705173 24594 raft_consensus.cc:374] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:33.705199 24594 raft_consensus.cc:729] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 242ede39785f459586517b1297d71edb, State: Initialized, Role: FOLLOWER
I20260811 08:13:33.705245 24594 consensus_queue.cc:260] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:33.705358 24594 ts_tablet_manager.cc:1428] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:33.705866 24674 ts_tablet_manager.cc:1905] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:13:33.706805 24672 tablet_replica.cc:330] T 1647ecafafe54c9f9cbef5704b44752e P 242ede39785f459586517b1297d71edb: stopping tablet replica
I20260811 08:13:33.706939 24672 raft_consensus.cc:2229] T 1647ecafafe54c9f9cbef5704b44752e P 242ede39785f459586517b1297d71edb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:13:33.707005 24672 raft_consensus.cc:2258] T 1647ecafafe54c9f9cbef5704b44752e P 242ede39785f459586517b1297d71edb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:33.707177 24673 tablet_replica.cc:330] T 1647ecafafe54c9f9cbef5704b44752e P 49b30f1b46854ea18283ce2107786d31: stopping tablet replica
I20260811 08:13:33.707298 24673 raft_consensus.cc:2229] T 1647ecafafe54c9f9cbef5704b44752e P 49b30f1b46854ea18283ce2107786d31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:13:33.707363 24673 raft_consensus.cc:2258] T 1647ecafafe54c9f9cbef5704b44752e P 49b30f1b46854ea18283ce2107786d31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:33.707767 24674 ts_tablet_manager.cc:1918] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:13:33.707847 24674 log.cc:1196] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-1/wal/wals/1647ecafafe54c9f9cbef5704b44752e
I20260811 08:13:33.708014 24672 ts_tablet_manager.cc:1905] T 1647ecafafe54c9f9cbef5704b44752e P 242ede39785f459586517b1297d71edb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:13:33.708066 24673 ts_tablet_manager.cc:1905] T 1647ecafafe54c9f9cbef5704b44752e P 49b30f1b46854ea18283ce2107786d31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:13:33.708149 24674 ts_tablet_manager.cc:1939] T 1647ecafafe54c9f9cbef5704b44752e P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Deleting consensus metadata
I20260811 08:13:33.708597 23750 catalog_manager.cc:4841] TS 65e96adaf18f4dbeb6ebba3f5f34d6fe (127.20.158.130:36117): tablet 1647ecafafe54c9f9cbef5704b44752e (table test-table [id=8ede8def83d6471485ba1ee3ad7db11a]) successfully deleted
I20260811 08:13:33.709029 24596 tablet_bootstrap.cc:492] T 10ea886bd68c43be9e525c727d3a9a07 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: No bootstrap required, opened a new log
I20260811 08:13:33.709108 24596 ts_tablet_manager.cc:1397] T 10ea886bd68c43be9e525c727d3a9a07 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260811 08:13:33.709262 24596 raft_consensus.cc:348] T 10ea886bd68c43be9e525c727d3a9a07 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:33.709347 24596 raft_consensus.cc:374] T 10ea886bd68c43be9e525c727d3a9a07 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:33.709371 24596 raft_consensus.cc:729] T 10ea886bd68c43be9e525c727d3a9a07 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65e96adaf18f4dbeb6ebba3f5f34d6fe, State: Initialized, Role: FOLLOWER
I20260811 08:13:33.709436 24596 consensus_queue.cc:260] T 10ea886bd68c43be9e525c727d3a9a07 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:33.709708 24673 ts_tablet_manager.cc:1918] T 1647ecafafe54c9f9cbef5704b44752e P 49b30f1b46854ea18283ce2107786d31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:13:33.709750 24596 ts_tablet_manager.cc:1428] T 10ea886bd68c43be9e525c727d3a9a07 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:33.709796 24673 log.cc:1196] T 1647ecafafe54c9f9cbef5704b44752e P 49b30f1b46854ea18283ce2107786d31: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-0/wal/wals/1647ecafafe54c9f9cbef5704b44752e
I20260811 08:13:33.710105 24673 ts_tablet_manager.cc:1939] T 1647ecafafe54c9f9cbef5704b44752e P 49b30f1b46854ea18283ce2107786d31: Deleting consensus metadata
I20260811 08:13:33.710559 23750 catalog_manager.cc:4841] TS 49b30f1b46854ea18283ce2107786d31 (127.20.158.129:41587): tablet 1647ecafafe54c9f9cbef5704b44752e (table test-table [id=8ede8def83d6471485ba1ee3ad7db11a]) successfully deleted
I20260811 08:13:33.710698 24672 ts_tablet_manager.cc:1918] T 1647ecafafe54c9f9cbef5704b44752e P 242ede39785f459586517b1297d71edb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:13:33.710831 24672 log.cc:1196] T 1647ecafafe54c9f9cbef5704b44752e P 242ede39785f459586517b1297d71edb: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-2/wal/wals/1647ecafafe54c9f9cbef5704b44752e
I20260811 08:13:33.710923 24595 tablet_bootstrap.cc:492] T 10ea886bd68c43be9e525c727d3a9a07 P 49b30f1b46854ea18283ce2107786d31: No bootstrap required, opened a new log
I20260811 08:13:33.710995 24595 ts_tablet_manager.cc:1397] T 10ea886bd68c43be9e525c727d3a9a07 P 49b30f1b46854ea18283ce2107786d31: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.001s
I20260811 08:13:33.711150 24595 raft_consensus.cc:348] T 10ea886bd68c43be9e525c727d3a9a07 P 49b30f1b46854ea18283ce2107786d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:33.711237 24595 raft_consensus.cc:374] T 10ea886bd68c43be9e525c727d3a9a07 P 49b30f1b46854ea18283ce2107786d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:33.711277 24595 raft_consensus.cc:729] T 10ea886bd68c43be9e525c727d3a9a07 P 49b30f1b46854ea18283ce2107786d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49b30f1b46854ea18283ce2107786d31, State: Initialized, Role: FOLLOWER
I20260811 08:13:33.711359 24672 ts_tablet_manager.cc:1939] T 1647ecafafe54c9f9cbef5704b44752e P 242ede39785f459586517b1297d71edb: Deleting consensus metadata
I20260811 08:13:33.711333 24595 consensus_queue.cc:260] T 10ea886bd68c43be9e525c727d3a9a07 P 49b30f1b46854ea18283ce2107786d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:33.711436 24595 ts_tablet_manager.cc:1428] T 10ea886bd68c43be9e525c727d3a9a07 P 49b30f1b46854ea18283ce2107786d31: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 08:13:33.711925 23753 catalog_manager.cc:4841] TS 242ede39785f459586517b1297d71edb (127.20.158.131:46663): tablet 1647ecafafe54c9f9cbef5704b44752e (table test-table [id=8ede8def83d6471485ba1ee3ad7db11a]) successfully deleted
W20260811 08:13:33.740540 24564 tablet.cc:2369] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:13:33.915100 24658 raft_consensus.cc:482] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:13:33.915242 24658 raft_consensus.cc:504] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:33.915429 24658 leader_election.cc:288] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49b30f1b46854ea18283ce2107786d31 (127.20.158.129:41587), 65e96adaf18f4dbeb6ebba3f5f34d6fe (127.20.158.130:36117)
I20260811 08:13:33.915757 24040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10ea886bd68c43be9e525c727d3a9a07" candidate_uuid: "242ede39785f459586517b1297d71edb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49b30f1b46854ea18283ce2107786d31" is_pre_election: true
I20260811 08:13:33.915894 24040 raft_consensus.cc:2454] T 10ea886bd68c43be9e525c727d3a9a07 P 49b30f1b46854ea18283ce2107786d31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 242ede39785f459586517b1297d71edb in term 0.
I20260811 08:13:33.915824 24264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10ea886bd68c43be9e525c727d3a9a07" candidate_uuid: "242ede39785f459586517b1297d71edb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" is_pre_election: true
I20260811 08:13:33.915988 24264 raft_consensus.cc:2454] T 10ea886bd68c43be9e525c727d3a9a07 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 242ede39785f459586517b1297d71edb in term 0.
I20260811 08:13:33.916126 24379 leader_election.cc:302] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 242ede39785f459586517b1297d71edb, 49b30f1b46854ea18283ce2107786d31; no voters:
I20260811 08:13:33.916249 24658 raft_consensus.cc:2781] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:13:33.916296 24658 raft_consensus.cc:482] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:13:33.916333 24658 raft_consensus.cc:3037] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:33.917117 24658 raft_consensus.cc:504] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:33.917268 24658 leader_election.cc:288] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb [CANDIDATE]: Term 1 election: Requested vote from peers 49b30f1b46854ea18283ce2107786d31 (127.20.158.129:41587), 65e96adaf18f4dbeb6ebba3f5f34d6fe (127.20.158.130:36117)
I20260811 08:13:33.917456 24040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10ea886bd68c43be9e525c727d3a9a07" candidate_uuid: "242ede39785f459586517b1297d71edb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49b30f1b46854ea18283ce2107786d31"
I20260811 08:13:33.917474 24264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10ea886bd68c43be9e525c727d3a9a07" candidate_uuid: "242ede39785f459586517b1297d71edb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe"
I20260811 08:13:33.917591 24040 raft_consensus.cc:3037] T 10ea886bd68c43be9e525c727d3a9a07 P 49b30f1b46854ea18283ce2107786d31 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:33.917596 24264 raft_consensus.cc:3037] T 10ea886bd68c43be9e525c727d3a9a07 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:33.918320 24264 raft_consensus.cc:2454] T 10ea886bd68c43be9e525c727d3a9a07 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 242ede39785f459586517b1297d71edb in term 1.
I20260811 08:13:33.918437 24040 raft_consensus.cc:2454] T 10ea886bd68c43be9e525c727d3a9a07 P 49b30f1b46854ea18283ce2107786d31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 242ede39785f459586517b1297d71edb in term 1.
I20260811 08:13:33.918645 24379 leader_election.cc:302] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 242ede39785f459586517b1297d71edb, 65e96adaf18f4dbeb6ebba3f5f34d6fe; no voters:
I20260811 08:13:33.918769 24658 raft_consensus.cc:2781] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:33.918830 24658 raft_consensus.cc:686] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb [term 1 LEADER]: Becoming Leader. State: Replica: 242ede39785f459586517b1297d71edb, State: Running, Role: LEADER
I20260811 08:13:33.918897 24658 consensus_queue.cc:237] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:33.919704 23782 catalog_manager.cc:5495] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb reported cstate change: term changed from 0 to 1, leader changed from <none> to 242ede39785f459586517b1297d71edb (127.20.158.131). New cstate: current_term: 1 leader_uuid: "242ede39785f459586517b1297d71edb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } health_report { overall_health: HEALTHY } } }
I20260811 08:13:33.933264 24593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.930760 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60434 (local address 127.20.158.131:46663)
0811 08:13:33.930806 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:33.930808 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:33.930835 (+ 27us) server_negotiation.cc:407] Connection header received
0811 08:13:33.930911 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:33.930911 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:33.930921 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:33.930988 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:33.931153 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.931958 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.932680 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.932861 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.932912 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.933039 (+ 127us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:33.933065 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:33.933105 (+ 40us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:33.933152 (+ 47us) server_negotiation.cc:299] Negotiation successful
0811 08:13:33.933170 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:13:33.937428 24593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.935397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:52279 (local address 127.20.158.131:46663)
0811 08:13:33.935427 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:33.935429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:33.935439 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:13:33.935506 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:33.935507 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:33.935516 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:33.935569 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:33.935654 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.936071 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.936750 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.936924 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.937003 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.937164 (+ 161us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:33.937193 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:33.937257 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:33.937307 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 08:13:33.937331 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":15}
I20260811 08:13:33.937430 24570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:33.935340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:46663 (local address 127.20.158.131:52279)
0811 08:13:33.935398 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:33.935410 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:33.935455 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:33.935571 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:33.935572 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:33.935573 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:13:33.935608 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.935609 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.936147 (+ 538us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.936148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.936666 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:33.936668 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:33.937004 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:33.937005 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:33.937060 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:33.937064 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:13:33.937258 (+ 194us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:13:33.937260 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:13:33.937306 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 08:13:33.937351 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36,"mutex_wait_us":4}
I20260811 08:13:33.939282 24264 raft_consensus.cc:1261] T 10ea886bd68c43be9e525c727d3a9a07 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 1 FOLLOWER]: Refusing update from remote peer 242ede39785f459586517b1297d71edb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:33.939282 24040 raft_consensus.cc:1261] T 10ea886bd68c43be9e525c727d3a9a07 P 49b30f1b46854ea18283ce2107786d31 [term 1 FOLLOWER]: Refusing update from remote peer 242ede39785f459586517b1297d71edb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:33.939536 24658 consensus_queue.cc:1035] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb [LEADER]: Connected to new peer: Peer: permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:13:33.939684 24651 consensus_queue.cc:1035] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb [LEADER]: Connected to new peer: Peer: permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 08:13:33.944205 24642 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 08:13:35.462826 23781 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49908:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:13:35.462949 23781 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:49908:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:13:35.463814 23781 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 63e00ed48aac4d66a871baa9f72f0b33: Sending DeleteTablet for 3 replicas of tablet 10ea886bd68c43be9e525c727d3a9a07
I20260811 08:13:35.464125 24457 tablet_service.cc:1514] Processing DeleteTablet for tablet 10ea886bd68c43be9e525c727d3a9a07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:35 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:60422
I20260811 08:13:35.464102 24006 tablet_service.cc:1514] Processing DeleteTablet for tablet 10ea886bd68c43be9e525c727d3a9a07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:35 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:43398
I20260811 08:13:35.464354 24224 tablet_service.cc:1514] Processing DeleteTablet for tablet 10ea886bd68c43be9e525c727d3a9a07 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:35 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:60716
I20260811 08:13:35.464574 24727 tablet_replica.cc:330] T 10ea886bd68c43be9e525c727d3a9a07 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: stopping tablet replica
I20260811 08:13:35.464648 24727 raft_consensus.cc:2229] T 10ea886bd68c43be9e525c727d3a9a07 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:13:35.464685 24727 raft_consensus.cc:2258] T 10ea886bd68c43be9e525c727d3a9a07 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:35.464722 24725 tablet_replica.cc:330] T 10ea886bd68c43be9e525c727d3a9a07 P 49b30f1b46854ea18283ce2107786d31: stopping tablet replica
I20260811 08:13:35.464785 24725 raft_consensus.cc:2229] T 10ea886bd68c43be9e525c727d3a9a07 P 49b30f1b46854ea18283ce2107786d31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:13:35.464823 24725 raft_consensus.cc:2258] T 10ea886bd68c43be9e525c727d3a9a07 P 49b30f1b46854ea18283ce2107786d31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:35.464942 24727 ts_tablet_manager.cc:1905] T 10ea886bd68c43be9e525c727d3a9a07 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:13:35.465056 24725 ts_tablet_manager.cc:1905] T 10ea886bd68c43be9e525c727d3a9a07 P 49b30f1b46854ea18283ce2107786d31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:13:35.466557 24727 ts_tablet_manager.cc:1918] T 10ea886bd68c43be9e525c727d3a9a07 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 08:13:35.466645 24727 log.cc:1196] T 10ea886bd68c43be9e525c727d3a9a07 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-1/wal/wals/10ea886bd68c43be9e525c727d3a9a07
I20260811 08:13:35.466883 24727 ts_tablet_manager.cc:1939] T 10ea886bd68c43be9e525c727d3a9a07 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Deleting consensus metadata
I20260811 08:13:35.467080 24725 ts_tablet_manager.cc:1918] T 10ea886bd68c43be9e525c727d3a9a07 P 49b30f1b46854ea18283ce2107786d31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 08:13:35.467151 24725 log.cc:1196] T 10ea886bd68c43be9e525c727d3a9a07 P 49b30f1b46854ea18283ce2107786d31: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-0/wal/wals/10ea886bd68c43be9e525c727d3a9a07
I20260811 08:13:35.467283 23750 catalog_manager.cc:4841] TS 65e96adaf18f4dbeb6ebba3f5f34d6fe (127.20.158.130:36117): tablet 10ea886bd68c43be9e525c727d3a9a07 (table test-table [id=1a10b4089dda43169d4bd28cb8547acc]) successfully deleted
I20260811 08:13:35.467404 24725 ts_tablet_manager.cc:1939] T 10ea886bd68c43be9e525c727d3a9a07 P 49b30f1b46854ea18283ce2107786d31: Deleting consensus metadata
I20260811 08:13:35.467674 24724 tablet_replica.cc:330] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb: stopping tablet replica
I20260811 08:13:35.467731 23750 catalog_manager.cc:4841] TS 49b30f1b46854ea18283ce2107786d31 (127.20.158.129:41587): tablet 10ea886bd68c43be9e525c727d3a9a07 (table test-table [id=1a10b4089dda43169d4bd28cb8547acc]) successfully deleted
I20260811 08:13:35.467756 24724 raft_consensus.cc:2229] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:13:35.467859 24724 raft_consensus.cc:2258] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:35.468120 24724 ts_tablet_manager.cc:1905] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:13:35.469978 24724 ts_tablet_manager.cc:1918] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 08:13:35.470052 24724 log.cc:1196] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-2/wal/wals/10ea886bd68c43be9e525c727d3a9a07
I20260811 08:13:35.470306 24724 ts_tablet_manager.cc:1939] T 10ea886bd68c43be9e525c727d3a9a07 P 242ede39785f459586517b1297d71edb: Deleting consensus metadata
I20260811 08:13:35.470702 23753 catalog_manager.cc:4841] TS 242ede39785f459586517b1297d71edb (127.20.158.131:46663): tablet 10ea886bd68c43be9e525c727d3a9a07 (table test-table [id=1a10b4089dda43169d4bd28cb8547acc]) successfully deleted
Aug 11 08:13:35 dist-test-slave-gkw7 krb5kdc[23709](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436015, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 08:13:35 dist-test-slave-gkw7 krb5kdc[23709](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436015, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:35.497442 24739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:35.484296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49918 (local address 127.20.158.190:33335)
0811 08:13:35.484565 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:35.484567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:35.484664 (+ 97us) server_negotiation.cc:407] Connection header received
0811 08:13:35.484779 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:35.484780 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:35.484796 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:35.484884 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:35.485725 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:35.486278 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:35.487016 (+ 738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:35.487229 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:35.487282 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:35.494569 (+ 7287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:35.494572 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:35.494572 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:35.494581 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:35.496192 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:35.496582 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:35.496583 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:35.496584 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:35.496662 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:35.496875 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:35.496876 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:35.496876 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:35.497003 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:35.497123 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:35.497230 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 08:13:35.497326 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":226,"thread_start_us":166,"threads_started":1}
I20260811 08:13:35.499163 23781 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49918:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:13:35.499320 23781 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:13:35.500887 24457 tablet_service.cc:1467] Processing CreateTablet for tablet f7ca7d90d3864658a0c8ccaf904b7233 (DEFAULT_TABLE table=test-table [id=b144033ecf4047aa991cd3005a72d027]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:35.500887 24006 tablet_service.cc:1467] Processing CreateTablet for tablet f7ca7d90d3864658a0c8ccaf904b7233 (DEFAULT_TABLE table=test-table [id=b144033ecf4047aa991cd3005a72d027]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:35.501046 24006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7ca7d90d3864658a0c8ccaf904b7233. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:35.501046 24457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7ca7d90d3864658a0c8ccaf904b7233. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:35.501662 24224 tablet_service.cc:1467] Processing CreateTablet for tablet f7ca7d90d3864658a0c8ccaf904b7233 (DEFAULT_TABLE table=test-table [id=b144033ecf4047aa991cd3005a72d027]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:35.501821 24224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f7ca7d90d3864658a0c8ccaf904b7233. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:35.502769 24740 tablet_bootstrap.cc:492] T f7ca7d90d3864658a0c8ccaf904b7233 P 242ede39785f459586517b1297d71edb: Bootstrap starting.
I20260811 08:13:35.502851 24743 tablet_bootstrap.cc:492] T f7ca7d90d3864658a0c8ccaf904b7233 P 49b30f1b46854ea18283ce2107786d31: Bootstrap starting.
I20260811 08:13:35.503041 24744 tablet_bootstrap.cc:492] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Bootstrap starting.
I20260811 08:13:35.503306 24743 tablet_bootstrap.cc:654] T f7ca7d90d3864658a0c8ccaf904b7233 P 49b30f1b46854ea18283ce2107786d31: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:35.503430 24740 tablet_bootstrap.cc:654] T f7ca7d90d3864658a0c8ccaf904b7233 P 242ede39785f459586517b1297d71edb: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:35.503508 24744 tablet_bootstrap.cc:654] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:35.504011 24743 tablet_bootstrap.cc:492] T f7ca7d90d3864658a0c8ccaf904b7233 P 49b30f1b46854ea18283ce2107786d31: No bootstrap required, opened a new log
I20260811 08:13:35.504097 24743 ts_tablet_manager.cc:1397] T f7ca7d90d3864658a0c8ccaf904b7233 P 49b30f1b46854ea18283ce2107786d31: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:35.504107 24740 tablet_bootstrap.cc:492] T f7ca7d90d3864658a0c8ccaf904b7233 P 242ede39785f459586517b1297d71edb: No bootstrap required, opened a new log
I20260811 08:13:35.504158 24740 ts_tablet_manager.cc:1397] T f7ca7d90d3864658a0c8ccaf904b7233 P 242ede39785f459586517b1297d71edb: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:35.504235 24744 tablet_bootstrap.cc:492] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: No bootstrap required, opened a new log
I20260811 08:13:35.504287 24744 ts_tablet_manager.cc:1397] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:35.504266 24740 raft_consensus.cc:348] T f7ca7d90d3864658a0c8ccaf904b7233 P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:35.504328 24740 raft_consensus.cc:374] T f7ca7d90d3864658a0c8ccaf904b7233 P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:35.504285 24743 raft_consensus.cc:348] T f7ca7d90d3864658a0c8ccaf904b7233 P 49b30f1b46854ea18283ce2107786d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:35.504347 24740 raft_consensus.cc:729] T f7ca7d90d3864658a0c8ccaf904b7233 P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 242ede39785f459586517b1297d71edb, State: Initialized, Role: FOLLOWER
I20260811 08:13:35.504366 24743 raft_consensus.cc:374] T f7ca7d90d3864658a0c8ccaf904b7233 P 49b30f1b46854ea18283ce2107786d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:35.504392 24743 raft_consensus.cc:729] T f7ca7d90d3864658a0c8ccaf904b7233 P 49b30f1b46854ea18283ce2107786d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49b30f1b46854ea18283ce2107786d31, State: Initialized, Role: FOLLOWER
I20260811 08:13:35.504396 24740 consensus_queue.cc:260] T f7ca7d90d3864658a0c8ccaf904b7233 P 242ede39785f459586517b1297d71edb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:35.504438 24743 consensus_queue.cc:260] T f7ca7d90d3864658a0c8ccaf904b7233 P 49b30f1b46854ea18283ce2107786d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:35.504478 24740 ts_tablet_manager.cc:1428] T f7ca7d90d3864658a0c8ccaf904b7233 P 242ede39785f459586517b1297d71edb: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 08:13:35.504437 24744 raft_consensus.cc:348] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:35.504505 24744 raft_consensus.cc:374] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:35.504639 24743 ts_tablet_manager.cc:1428] T f7ca7d90d3864658a0c8ccaf904b7233 P 49b30f1b46854ea18283ce2107786d31: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 08:13:35.504662 24744 raft_consensus.cc:729] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65e96adaf18f4dbeb6ebba3f5f34d6fe, State: Initialized, Role: FOLLOWER
I20260811 08:13:35.504717 24744 consensus_queue.cc:260] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:35.504940 24744 ts_tablet_manager.cc:1428] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:35.694510 24751 raft_consensus.cc:482] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:13:35.694608 24751 raft_consensus.cc:504] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:35.694777 24751 leader_election.cc:288] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49b30f1b46854ea18283ce2107786d31 (127.20.158.129:41587), 242ede39785f459586517b1297d71edb (127.20.158.131:46663)
I20260811 08:13:35.695053 24040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ca7d90d3864658a0c8ccaf904b7233" candidate_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49b30f1b46854ea18283ce2107786d31" is_pre_election: true
I20260811 08:13:35.695106 24491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ca7d90d3864658a0c8ccaf904b7233" candidate_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "242ede39785f459586517b1297d71edb" is_pre_election: true
I20260811 08:13:35.695195 24040 raft_consensus.cc:2454] T f7ca7d90d3864658a0c8ccaf904b7233 P 49b30f1b46854ea18283ce2107786d31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65e96adaf18f4dbeb6ebba3f5f34d6fe in term 0.
I20260811 08:13:35.695194 24491 raft_consensus.cc:2454] T f7ca7d90d3864658a0c8ccaf904b7233 P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65e96adaf18f4dbeb6ebba3f5f34d6fe in term 0.
I20260811 08:13:35.695384 24145 leader_election.cc:302] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49b30f1b46854ea18283ce2107786d31, 65e96adaf18f4dbeb6ebba3f5f34d6fe; no voters:
I20260811 08:13:35.695520 24751 raft_consensus.cc:2781] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:13:35.695555 24751 raft_consensus.cc:482] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:13:35.695580 24751 raft_consensus.cc:3037] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:35.696376 24751 raft_consensus.cc:504] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:35.696542 24751 leader_election.cc:288] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [CANDIDATE]: Term 1 election: Requested vote from peers 49b30f1b46854ea18283ce2107786d31 (127.20.158.129:41587), 242ede39785f459586517b1297d71edb (127.20.158.131:46663)
I20260811 08:13:35.696759 24040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ca7d90d3864658a0c8ccaf904b7233" candidate_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49b30f1b46854ea18283ce2107786d31"
I20260811 08:13:35.696722 24491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7ca7d90d3864658a0c8ccaf904b7233" candidate_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "242ede39785f459586517b1297d71edb"
I20260811 08:13:35.696827 24491 raft_consensus.cc:3037] T f7ca7d90d3864658a0c8ccaf904b7233 P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:35.696848 24040 raft_consensus.cc:3037] T f7ca7d90d3864658a0c8ccaf904b7233 P 49b30f1b46854ea18283ce2107786d31 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:35.697507 24040 raft_consensus.cc:2454] T f7ca7d90d3864658a0c8ccaf904b7233 P 49b30f1b46854ea18283ce2107786d31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e96adaf18f4dbeb6ebba3f5f34d6fe in term 1.
I20260811 08:13:35.697608 24491 raft_consensus.cc:2454] T f7ca7d90d3864658a0c8ccaf904b7233 P 242ede39785f459586517b1297d71edb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e96adaf18f4dbeb6ebba3f5f34d6fe in term 1.
I20260811 08:13:35.697728 24145 leader_election.cc:302] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49b30f1b46854ea18283ce2107786d31, 65e96adaf18f4dbeb6ebba3f5f34d6fe; no voters:
I20260811 08:13:35.697840 24751 raft_consensus.cc:2781] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:35.698015 24751 raft_consensus.cc:686] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 1 LEADER]: Becoming Leader. State: Replica: 65e96adaf18f4dbeb6ebba3f5f34d6fe, State: Running, Role: LEADER
I20260811 08:13:35.698074 24751 consensus_queue.cc:237] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:35.698832 23780 catalog_manager.cc:5495] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe reported cstate change: term changed from 0 to 1, leader changed from <none> to 65e96adaf18f4dbeb6ebba3f5f34d6fe (127.20.158.130). New cstate: current_term: 1 leader_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } health_report { overall_health: UNKNOWN } } }
I20260811 08:13:35.736168 24759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:35.733900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60730 (local address 127.20.158.130:36117)
0811 08:13:35.734059 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:35.734060 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:35.734066 (+ 6us) server_negotiation.cc:407] Connection header received
0811 08:13:35.734087 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:35.734087 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:35.734096 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:35.734148 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:35.734318 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:35.734800 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:35.735552 (+ 752us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:35.735753 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:35.735806 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:35.735926 (+ 120us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:35.735949 (+ 23us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:35.735982 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:35.736041 (+ 59us) server_negotiation.cc:299] Negotiation successful
0811 08:13:35.736056 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":104,"threads_started":1}
I20260811 08:13:35.738727 24040 raft_consensus.cc:1261] T f7ca7d90d3864658a0c8ccaf904b7233 P 49b30f1b46854ea18283ce2107786d31 [term 1 FOLLOWER]: Refusing update from remote peer 65e96adaf18f4dbeb6ebba3f5f34d6fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:35.738729 24491 raft_consensus.cc:1261] T f7ca7d90d3864658a0c8ccaf904b7233 P 242ede39785f459586517b1297d71edb [term 1 FOLLOWER]: Refusing update from remote peer 65e96adaf18f4dbeb6ebba3f5f34d6fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:35.738961 24752 consensus_queue.cc:1035] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:13:35.739099 24751 consensus_queue.cc:1035] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:13:35.749022 23781 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49918:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:13:35.749150 23781 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49918:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:13:35.749851 23781 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 63e00ed48aac4d66a871baa9f72f0b33: Sending DeleteTablet for 3 replicas of tablet f7ca7d90d3864658a0c8ccaf904b7233
I20260811 08:13:35.750195 24006 tablet_service.cc:1514] Processing DeleteTablet for tablet f7ca7d90d3864658a0c8ccaf904b7233 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:35 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:43398
I20260811 08:13:35.750202 24457 tablet_service.cc:1514] Processing DeleteTablet for tablet f7ca7d90d3864658a0c8ccaf904b7233 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:35 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:60422
I20260811 08:13:35.750236 24224 tablet_service.cc:1514] Processing DeleteTablet for tablet f7ca7d90d3864658a0c8ccaf904b7233 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:35 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:60716
I20260811 08:13:35.750310 24725 tablet_replica.cc:330] T f7ca7d90d3864658a0c8ccaf904b7233 P 49b30f1b46854ea18283ce2107786d31: stopping tablet replica
I20260811 08:13:35.750322 24727 tablet_replica.cc:330] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: stopping tablet replica
I20260811 08:13:35.750334 24724 tablet_replica.cc:330] T f7ca7d90d3864658a0c8ccaf904b7233 P 242ede39785f459586517b1297d71edb: stopping tablet replica
I20260811 08:13:35.750365 24725 raft_consensus.cc:2229] T f7ca7d90d3864658a0c8ccaf904b7233 P 49b30f1b46854ea18283ce2107786d31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:13:35.750371 24727 raft_consensus.cc:2229] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:13:35.750383 24724 raft_consensus.cc:2229] T f7ca7d90d3864658a0c8ccaf904b7233 P 242ede39785f459586517b1297d71edb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:13:35.750407 24725 raft_consensus.cc:2258] T f7ca7d90d3864658a0c8ccaf904b7233 P 49b30f1b46854ea18283ce2107786d31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:35.750417 24724 raft_consensus.cc:2258] T f7ca7d90d3864658a0c8ccaf904b7233 P 242ede39785f459586517b1297d71edb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:35.750425 24727 raft_consensus.cc:2258] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:35.750748 24727 ts_tablet_manager.cc:1905] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:13:35.750748 23781 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49918:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 08:13:35.750857 24724 ts_tablet_manager.cc:1905] T f7ca7d90d3864658a0c8ccaf904b7233 P 242ede39785f459586517b1297d71edb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 08:13:35.750898 23781 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:13:35.750916 24725 ts_tablet_manager.cc:1905] T f7ca7d90d3864658a0c8ccaf904b7233 P 49b30f1b46854ea18283ce2107786d31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:13:35.752123 24006 tablet_service.cc:1467] Processing CreateTablet for tablet b8484bdb5e3f4628b10990abbb886c24 (DEFAULT_TABLE table=test-table [id=f0ee3583c9634bf6937650432b5902c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:35.752233 24006 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8484bdb5e3f4628b10990abbb886c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:35.752743 24727 ts_tablet_manager.cc:1918] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:13:35.752781 24725 ts_tablet_manager.cc:1918] T f7ca7d90d3864658a0c8ccaf904b7233 P 49b30f1b46854ea18283ce2107786d31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:13:35.752808 24727 log.cc:1196] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-1/wal/wals/f7ca7d90d3864658a0c8ccaf904b7233
I20260811 08:13:35.752851 24725 log.cc:1196] T f7ca7d90d3864658a0c8ccaf904b7233 P 49b30f1b46854ea18283ce2107786d31: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-0/wal/wals/f7ca7d90d3864658a0c8ccaf904b7233
I20260811 08:13:35.753050 24727 ts_tablet_manager.cc:1939] T f7ca7d90d3864658a0c8ccaf904b7233 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Deleting consensus metadata
I20260811 08:13:35.753124 24725 ts_tablet_manager.cc:1939] T f7ca7d90d3864658a0c8ccaf904b7233 P 49b30f1b46854ea18283ce2107786d31: Deleting consensus metadata
I20260811 08:13:35.753454 23750 catalog_manager.cc:4841] TS 49b30f1b46854ea18283ce2107786d31 (127.20.158.129:41587): tablet f7ca7d90d3864658a0c8ccaf904b7233 (table test-table [id=b144033ecf4047aa991cd3005a72d027]) successfully deleted
I20260811 08:13:35.753707 24743 tablet_bootstrap.cc:492] T b8484bdb5e3f4628b10990abbb886c24 P 49b30f1b46854ea18283ce2107786d31: Bootstrap starting.
I20260811 08:13:35.753757 24457 tablet_service.cc:1467] Processing CreateTablet for tablet b8484bdb5e3f4628b10990abbb886c24 (DEFAULT_TABLE table=test-table [id=f0ee3583c9634bf6937650432b5902c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:35.754043 23750 catalog_manager.cc:4841] TS 65e96adaf18f4dbeb6ebba3f5f34d6fe (127.20.158.130:36117): tablet f7ca7d90d3864658a0c8ccaf904b7233 (table test-table [id=b144033ecf4047aa991cd3005a72d027]) successfully deleted
I20260811 08:13:35.754133 24224 tablet_service.cc:1467] Processing CreateTablet for tablet b8484bdb5e3f4628b10990abbb886c24 (DEFAULT_TABLE table=test-table [id=f0ee3583c9634bf6937650432b5902c2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:35.754242 24224 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8484bdb5e3f4628b10990abbb886c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:35.754319 24743 tablet_bootstrap.cc:654] T b8484bdb5e3f4628b10990abbb886c24 P 49b30f1b46854ea18283ce2107786d31: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:35.754994 24743 tablet_bootstrap.cc:492] T b8484bdb5e3f4628b10990abbb886c24 P 49b30f1b46854ea18283ce2107786d31: No bootstrap required, opened a new log
I20260811 08:13:35.755052 24743 ts_tablet_manager.cc:1397] T b8484bdb5e3f4628b10990abbb886c24 P 49b30f1b46854ea18283ce2107786d31: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:35.755192 24743 raft_consensus.cc:348] T b8484bdb5e3f4628b10990abbb886c24 P 49b30f1b46854ea18283ce2107786d31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:35.755264 24743 raft_consensus.cc:374] T b8484bdb5e3f4628b10990abbb886c24 P 49b30f1b46854ea18283ce2107786d31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:35.755290 24743 raft_consensus.cc:729] T b8484bdb5e3f4628b10990abbb886c24 P 49b30f1b46854ea18283ce2107786d31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49b30f1b46854ea18283ce2107786d31, State: Initialized, Role: FOLLOWER
I20260811 08:13:35.755342 24743 consensus_queue.cc:260] T b8484bdb5e3f4628b10990abbb886c24 P 49b30f1b46854ea18283ce2107786d31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:35.755455 24743 ts_tablet_manager.cc:1428] T b8484bdb5e3f4628b10990abbb886c24 P 49b30f1b46854ea18283ce2107786d31: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:35.755509 24744 tablet_bootstrap.cc:492] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Bootstrap starting.
I20260811 08:13:35.755944 24744 tablet_bootstrap.cc:654] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:35.756354 24457 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b8484bdb5e3f4628b10990abbb886c24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:35.756709 24744 tablet_bootstrap.cc:492] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: No bootstrap required, opened a new log
I20260811 08:13:35.756786 24744 ts_tablet_manager.cc:1397] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:35.756908 24744 raft_consensus.cc:348] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:35.756994 24744 raft_consensus.cc:374] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:35.757031 24744 raft_consensus.cc:729] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65e96adaf18f4dbeb6ebba3f5f34d6fe, State: Initialized, Role: FOLLOWER
I20260811 08:13:35.757097 24744 consensus_queue.cc:260] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:35.757195 24744 ts_tablet_manager.cc:1428] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:35.756354 24724 ts_tablet_manager.cc:1918] T f7ca7d90d3864658a0c8ccaf904b7233 P 242ede39785f459586517b1297d71edb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:13:35.757709 24740 tablet_bootstrap.cc:492] T b8484bdb5e3f4628b10990abbb886c24 P 242ede39785f459586517b1297d71edb: Bootstrap starting.
I20260811 08:13:35.757776 24724 log.cc:1196] T f7ca7d90d3864658a0c8ccaf904b7233 P 242ede39785f459586517b1297d71edb: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-2/wal/wals/f7ca7d90d3864658a0c8ccaf904b7233
I20260811 08:13:35.758096 24740 tablet_bootstrap.cc:654] T b8484bdb5e3f4628b10990abbb886c24 P 242ede39785f459586517b1297d71edb: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:35.758095 24724 ts_tablet_manager.cc:1939] T f7ca7d90d3864658a0c8ccaf904b7233 P 242ede39785f459586517b1297d71edb: Deleting consensus metadata
I20260811 08:13:35.758451 23753 catalog_manager.cc:4841] TS 242ede39785f459586517b1297d71edb (127.20.158.131:46663): tablet f7ca7d90d3864658a0c8ccaf904b7233 (table test-table [id=b144033ecf4047aa991cd3005a72d027]) successfully deleted
I20260811 08:13:35.758735 24740 tablet_bootstrap.cc:492] T b8484bdb5e3f4628b10990abbb886c24 P 242ede39785f459586517b1297d71edb: No bootstrap required, opened a new log
I20260811 08:13:35.758780 24740 ts_tablet_manager.cc:1397] T b8484bdb5e3f4628b10990abbb886c24 P 242ede39785f459586517b1297d71edb: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:35.758884 24740 raft_consensus.cc:348] T b8484bdb5e3f4628b10990abbb886c24 P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:35.758939 24740 raft_consensus.cc:374] T b8484bdb5e3f4628b10990abbb886c24 P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:35.758955 24740 raft_consensus.cc:729] T b8484bdb5e3f4628b10990abbb886c24 P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 242ede39785f459586517b1297d71edb, State: Initialized, Role: FOLLOWER
I20260811 08:13:35.759013 24740 consensus_queue.cc:260] T b8484bdb5e3f4628b10990abbb886c24 P 242ede39785f459586517b1297d71edb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:35.759130 24740 ts_tablet_manager.cc:1428] T b8484bdb5e3f4628b10990abbb886c24 P 242ede39785f459586517b1297d71edb: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:35.807374 24752 raft_consensus.cc:482] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:13:35.807518 24752 raft_consensus.cc:504] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:35.807736 24752 leader_election.cc:288] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49b30f1b46854ea18283ce2107786d31 (127.20.158.129:41587), 242ede39785f459586517b1297d71edb (127.20.158.131:46663)
I20260811 08:13:35.807971 24491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8484bdb5e3f4628b10990abbb886c24" candidate_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "242ede39785f459586517b1297d71edb" is_pre_election: true
I20260811 08:13:35.807992 24040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8484bdb5e3f4628b10990abbb886c24" candidate_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49b30f1b46854ea18283ce2107786d31" is_pre_election: true
I20260811 08:13:35.808135 24491 raft_consensus.cc:2454] T b8484bdb5e3f4628b10990abbb886c24 P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65e96adaf18f4dbeb6ebba3f5f34d6fe in term 0.
I20260811 08:13:35.808142 24040 raft_consensus.cc:2454] T b8484bdb5e3f4628b10990abbb886c24 P 49b30f1b46854ea18283ce2107786d31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65e96adaf18f4dbeb6ebba3f5f34d6fe in term 0.
I20260811 08:13:35.808336 24145 leader_election.cc:302] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 242ede39785f459586517b1297d71edb, 49b30f1b46854ea18283ce2107786d31, 65e96adaf18f4dbeb6ebba3f5f34d6fe; no voters:
I20260811 08:13:35.808466 24752 raft_consensus.cc:2781] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:13:35.808519 24752 raft_consensus.cc:482] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:13:35.808547 24752 raft_consensus.cc:3037] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:35.809288 24752 raft_consensus.cc:504] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:35.809437 24752 leader_election.cc:288] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [CANDIDATE]: Term 1 election: Requested vote from peers 49b30f1b46854ea18283ce2107786d31 (127.20.158.129:41587), 242ede39785f459586517b1297d71edb (127.20.158.131:46663)
I20260811 08:13:35.809617 24491 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8484bdb5e3f4628b10990abbb886c24" candidate_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "242ede39785f459586517b1297d71edb"
I20260811 08:13:35.809635 24040 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b8484bdb5e3f4628b10990abbb886c24" candidate_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49b30f1b46854ea18283ce2107786d31"
I20260811 08:13:35.809738 24040 raft_consensus.cc:3037] T b8484bdb5e3f4628b10990abbb886c24 P 49b30f1b46854ea18283ce2107786d31 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:35.809741 24491 raft_consensus.cc:3037] T b8484bdb5e3f4628b10990abbb886c24 P 242ede39785f459586517b1297d71edb [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:35.810364 24040 raft_consensus.cc:2454] T b8484bdb5e3f4628b10990abbb886c24 P 49b30f1b46854ea18283ce2107786d31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e96adaf18f4dbeb6ebba3f5f34d6fe in term 1.
I20260811 08:13:35.810467 24491 raft_consensus.cc:2454] T b8484bdb5e3f4628b10990abbb886c24 P 242ede39785f459586517b1297d71edb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 65e96adaf18f4dbeb6ebba3f5f34d6fe in term 1.
I20260811 08:13:35.810528 24145 leader_election.cc:302] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 49b30f1b46854ea18283ce2107786d31, 65e96adaf18f4dbeb6ebba3f5f34d6fe; no voters:
I20260811 08:13:35.810629 24752 raft_consensus.cc:2781] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:35.810690 24752 raft_consensus.cc:686] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 1 LEADER]: Becoming Leader. State: Replica: 65e96adaf18f4dbeb6ebba3f5f34d6fe, State: Running, Role: LEADER
I20260811 08:13:35.810743 24752 consensus_queue.cc:237] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } }
I20260811 08:13:35.811342 23781 catalog_manager.cc:5495] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe reported cstate change: term changed from 0 to 1, leader changed from <none> to 65e96adaf18f4dbeb6ebba3f5f34d6fe (127.20.158.130). New cstate: current_term: 1 leader_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "65e96adaf18f4dbeb6ebba3f5f34d6fe" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36117 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 } health_report { overall_health: UNKNOWN } } }
I20260811 08:13:35.818177 24040 raft_consensus.cc:1261] T b8484bdb5e3f4628b10990abbb886c24 P 49b30f1b46854ea18283ce2107786d31 [term 1 FOLLOWER]: Refusing update from remote peer 65e96adaf18f4dbeb6ebba3f5f34d6fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:35.818208 24491 raft_consensus.cc:1261] T b8484bdb5e3f4628b10990abbb886c24 P 242ede39785f459586517b1297d71edb [term 1 FOLLOWER]: Refusing update from remote peer 65e96adaf18f4dbeb6ebba3f5f34d6fe: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:35.818424 24751 consensus_queue.cc:1035] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "242ede39785f459586517b1297d71edb" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:13:35.818516 24752 consensus_queue.cc:1035] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [LEADER]: Connected to new peer: Peer: permanent_uuid: "49b30f1b46854ea18283ce2107786d31" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41587 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 08:13:35.822849 24696 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260811 08:13:37.340939 23781 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49918:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:13:37.341053 23781 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49918:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:13:37.341984 23781 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 63e00ed48aac4d66a871baa9f72f0b33: Sending DeleteTablet for 3 replicas of tablet b8484bdb5e3f4628b10990abbb886c24
I20260811 08:13:37.342321 24006 tablet_service.cc:1514] Processing DeleteTablet for tablet b8484bdb5e3f4628b10990abbb886c24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:37 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:43398
I20260811 08:13:37.342339 24457 tablet_service.cc:1514] Processing DeleteTablet for tablet b8484bdb5e3f4628b10990abbb886c24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:37 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:60422
I20260811 08:13:37.342351 24224 tablet_service.cc:1514] Processing DeleteTablet for tablet b8484bdb5e3f4628b10990abbb886c24 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:37 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:60716
I20260811 08:13:37.342466 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 23905
I20260811 08:13:37.353695 24810 tablet_replica.cc:330] T b8484bdb5e3f4628b10990abbb886c24 P 242ede39785f459586517b1297d71edb: stopping tablet replica
I20260811 08:13:37.353783 24810 raft_consensus.cc:2229] T b8484bdb5e3f4628b10990abbb886c24 P 242ede39785f459586517b1297d71edb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:13:37.353844 24810 raft_consensus.cc:2258] T b8484bdb5e3f4628b10990abbb886c24 P 242ede39785f459586517b1297d71edb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:37.353981 24812 tablet_replica.cc:330] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: stopping tablet replica
I20260811 08:13:37.354141 24812 raft_consensus.cc:2229] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:13:37.354152 24810 ts_tablet_manager.cc:1905] T b8484bdb5e3f4628b10990abbb886c24 P 242ede39785f459586517b1297d71edb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:13:37.354233 24812 raft_consensus.cc:2258] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:37.354497 24812 ts_tablet_manager.cc:1905] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:13:37.356050 24810 ts_tablet_manager.cc:1918] T b8484bdb5e3f4628b10990abbb886c24 P 242ede39785f459586517b1297d71edb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 08:13:37.356125 24810 log.cc:1196] T b8484bdb5e3f4628b10990abbb886c24 P 242ede39785f459586517b1297d71edb: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-2/wal/wals/b8484bdb5e3f4628b10990abbb886c24
I20260811 08:13:37.356329 24812 ts_tablet_manager.cc:1918] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260811 08:13:37.356397 24812 log.cc:1196] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786436003833085-21114-0/minicluster-data/ts-1/wal/wals/b8484bdb5e3f4628b10990abbb886c24
I20260811 08:13:37.356437 24810 ts_tablet_manager.cc:1939] T b8484bdb5e3f4628b10990abbb886c24 P 242ede39785f459586517b1297d71edb: Deleting consensus metadata
I20260811 08:13:37.356689 24812 ts_tablet_manager.cc:1939] T b8484bdb5e3f4628b10990abbb886c24 P 65e96adaf18f4dbeb6ebba3f5f34d6fe: Deleting consensus metadata
W20260811 08:13:37.356989 23750 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.158.129:41587 (error 108)
I20260811 08:13:37.357033 23753 catalog_manager.cc:4841] TS 242ede39785f459586517b1297d71edb (127.20.158.131:46663): tablet b8484bdb5e3f4628b10990abbb886c24 (table test-table [id=f0ee3583c9634bf6937650432b5902c2]) successfully deleted
I20260811 08:13:37.357195 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 24124
I20260811 08:13:37.359660 24814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:37.359392 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:41587 (local address 127.0.0.1:33580)
0811 08:13:37.359548 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:37.359608 (+ 60us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.129:41587: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":82,"threads_started":1}
W20260811 08:13:37.359958 23750 catalog_manager.cc:4584] TS 49b30f1b46854ea18283ce2107786d31 (127.20.158.129:41587): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b8484bdb5e3f4628b10990abbb886c24: Network error: Client connection negotiation failed: client connection to 127.20.158.129:41587: connect: Connection refused (error 111)
I20260811 08:13:37.367208 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 24356
I20260811 08:13:37.367307 24814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:37.367061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:36117 (local address 127.0.0.1:53474)
0811 08:13:37.367236 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:37.367268 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.130:36117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149}
I20260811 08:13:37.379794 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 23728
2026-08-11T08:13:37Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (6033 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:13:37 dist-test-slave-gkw7 krb5kdc[24818](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:13:37 dist-test-slave-gkw7 krb5kdc[24818](info): set up 2 sockets
Aug 11 08:13:37 dist-test-slave-gkw7 krb5kdc[24818](info): commencing operation
krb5kdc: starting...
W20260811 08:13:38.635816 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.226s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:13:38 dist-test-slave-gkw7 krb5kdc[24818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:13:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:13:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:13:38.760340 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:34557
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:41431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:34557
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:38.845628 24834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:38.845896 24834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:38.845932 24834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:38.847107 24834 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:38.847191 24834 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:38.847213 24834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:38.847234 24834 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:38.847265 24834 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:13:38.848752 24834 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:41431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:34557
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:34557
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24834
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:38.849045 24834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:38.849301 24834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:38.854835 24841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:38.854835 24844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:38.854868 24834 server_base.cc:1034] running on GCE node
W20260811 08:13:38.854836 24842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:38.855381 24834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:38.855687 24834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:38.856865 24834 hybrid_clock.cc:648] HybridClock initialized: now 1786436018856851 us; error 31 us; skew 500 ppm
Aug 11 08:13:38 dist-test-slave-gkw7 krb5kdc[24818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436018, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:38.859680 24834 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:13:38.860105 24834 webserver.cc:460] Webserver started at http://127.20.158.190:36967/ using document root <none> and password file <none>
I20260811 08:13:38.860339 24834 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:38.860388 24834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:38.860488 24834 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:38.861716 24834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "ace2f93ebd4f4622a6c4ac998b19ca32"
format_stamp: "Formatted at 2026-08-11 08:13:38 on dist-test-slave-gkw7"
server_key: "c796b5ac776ac0b5c71a68fe0b05da34"
server_key_iv: "5ca2689597b4ecf0c894e7eb5614fcd1"
server_key_version: "encryptionkey@0"
I20260811 08:13:38.862078 24834 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "ace2f93ebd4f4622a6c4ac998b19ca32"
format_stamp: "Formatted at 2026-08-11 08:13:38 on dist-test-slave-gkw7"
server_key: "c796b5ac776ac0b5c71a68fe0b05da34"
server_key_iv: "5ca2689597b4ecf0c894e7eb5614fcd1"
server_key_version: "encryptionkey@0"
I20260811 08:13:38.863598 24834 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 08:13:38.864430 24857 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:38.864672 24834 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:38.864790 24834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "ace2f93ebd4f4622a6c4ac998b19ca32"
format_stamp: "Formatted at 2026-08-11 08:13:38 on dist-test-slave-gkw7"
server_key: "c796b5ac776ac0b5c71a68fe0b05da34"
server_key_iv: "5ca2689597b4ecf0c894e7eb5614fcd1"
server_key_version: "encryptionkey@0"
I20260811 08:13:38.864871 24834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:38.896147 24834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:38.898579 24834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:38.898763 24834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:38.903141 24834 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:34557
I20260811 08:13:38.903198 24940 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:34557 every 8 connection(s)
I20260811 08:13:38.903625 24834 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:13:38.904666 24941 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:38.906430 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 24834
I20260811 08:13:38.906544 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:13:38.906731 21114 external_mini_cluster.cc:1428] Setting key edbc9f865d40ea9fed3042d4212ff01e
I20260811 08:13:38.907910 24941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ace2f93ebd4f4622a6c4ac998b19ca32: Bootstrap starting.
I20260811 08:13:38.908704 24941 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ace2f93ebd4f4622a6c4ac998b19ca32: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:38.909089 24941 log.cc:824] T 00000000000000000000000000000000 P ace2f93ebd4f4622a6c4ac998b19ca32: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:38.910028 24941 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ace2f93ebd4f4622a6c4ac998b19ca32: No bootstrap required, opened a new log
I20260811 08:13:38.912585 24941 raft_consensus.cc:348] T 00000000000000000000000000000000 P ace2f93ebd4f4622a6c4ac998b19ca32 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ace2f93ebd4f4622a6c4ac998b19ca32" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34557 } }
I20260811 08:13:38.912768 24941 raft_consensus.cc:374] T 00000000000000000000000000000000 P ace2f93ebd4f4622a6c4ac998b19ca32 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:38.912837 24941 raft_consensus.cc:729] T 00000000000000000000000000000000 P ace2f93ebd4f4622a6c4ac998b19ca32 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ace2f93ebd4f4622a6c4ac998b19ca32, State: Initialized, Role: FOLLOWER
I20260811 08:13:38.912992 24941 consensus_queue.cc:260] T 00000000000000000000000000000000 P ace2f93ebd4f4622a6c4ac998b19ca32 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ace2f93ebd4f4622a6c4ac998b19ca32" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34557 } }
I20260811 08:13:38.913107 24941 raft_consensus.cc:388] T 00000000000000000000000000000000 P ace2f93ebd4f4622a6c4ac998b19ca32 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:13:38.913161 24941 raft_consensus.cc:482] T 00000000000000000000000000000000 P ace2f93ebd4f4622a6c4ac998b19ca32 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:13:38.913233 24941 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ace2f93ebd4f4622a6c4ac998b19ca32 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:38.914011 24941 raft_consensus.cc:504] T 00000000000000000000000000000000 P ace2f93ebd4f4622a6c4ac998b19ca32 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ace2f93ebd4f4622a6c4ac998b19ca32" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34557 } }
I20260811 08:13:38.914109 24941 leader_election.cc:302] T 00000000000000000000000000000000 P ace2f93ebd4f4622a6c4ac998b19ca32 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ace2f93ebd4f4622a6c4ac998b19ca32; no voters:
I20260811 08:13:38.914330 24941 leader_election.cc:288] T 00000000000000000000000000000000 P ace2f93ebd4f4622a6c4ac998b19ca32 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:13:38.914376 24947 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ace2f93ebd4f4622a6c4ac998b19ca32 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:38.914562 24947 raft_consensus.cc:686] T 00000000000000000000000000000000 P ace2f93ebd4f4622a6c4ac998b19ca32 [term 1 LEADER]: Becoming Leader. State: Replica: ace2f93ebd4f4622a6c4ac998b19ca32, State: Running, Role: LEADER
I20260811 08:13:38.914666 24941 sys_catalog.cc:564] T 00000000000000000000000000000000 P ace2f93ebd4f4622a6c4ac998b19ca32 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:38.914714 24947 consensus_queue.cc:237] T 00000000000000000000000000000000 P ace2f93ebd4f4622a6c4ac998b19ca32 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ace2f93ebd4f4622a6c4ac998b19ca32" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34557 } }
Aug 11 08:13:38 dist-test-slave-gkw7 krb5kdc[24818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436018, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:38.915050 24947 sys_catalog.cc:455] T 00000000000000000000000000000000 P ace2f93ebd4f4622a6c4ac998b19ca32 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ace2f93ebd4f4622a6c4ac998b19ca32. Latest consensus state: current_term: 1 leader_uuid: "ace2f93ebd4f4622a6c4ac998b19ca32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ace2f93ebd4f4622a6c4ac998b19ca32" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34557 } } }
I20260811 08:13:38.915169 24947 sys_catalog.cc:458] T 00000000000000000000000000000000 P ace2f93ebd4f4622a6c4ac998b19ca32 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:38.915061 24948 sys_catalog.cc:455] T 00000000000000000000000000000000 P ace2f93ebd4f4622a6c4ac998b19ca32 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ace2f93ebd4f4622a6c4ac998b19ca32" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ace2f93ebd4f4622a6c4ac998b19ca32" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34557 } } }
I20260811 08:13:38.915354 24948 sys_catalog.cc:458] T 00000000000000000000000000000000 P ace2f93ebd4f4622a6c4ac998b19ca32 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:38.916476 24962 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:13:38.917277 24962 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:13:38.919162 24962 catalog_manager.cc:1347] Generated new cluster ID: 11db21039c3c43abbae22e1f0bcf2879
I20260811 08:13:38.919224 24962 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:13:38.920567 24944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:38.907381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50618 (local address 127.20.158.190:34557)
0811 08:13:38.907568 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:38.907579 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:38.907620 (+ 41us) server_negotiation.cc:407] Connection header received
0811 08:13:38.908153 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:38.908162 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:38.908216 (+ 54us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:38.908357 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:38.909308 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:38.910545 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:38.911767 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:38.912176 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:38.912283 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:38.915512 (+ 3229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:38.915516 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:38.915517 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:38.915540 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:38.918094 (+ 2554us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:38.918564 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:38.918567 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:38.918568 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:38.918689 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:38.918982 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:38.918983 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:38.918984 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:38.919456 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:38.920067 (+ 611us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:38.920164 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 08:13:38.920325 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":97,"threads_started":1}
I20260811 08:13:38.926689 24962 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:13:38.927294 24962 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:13:38.933202 24962 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ace2f93ebd4f4622a6c4ac998b19ca32: Generated new TSK 0
I20260811 08:13:38.933398 24962 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.158.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
I20260811 08:13:38.964305 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:0
--local_ip_for_outbound_sockets=127.20.158.129
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:34557
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:41431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:39.049824 24982 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:39.050033 24982 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:39.050057 24982 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:39.051270 24982 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:39.051313 24982 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:39.051342 24982 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:13:39.052831 24982 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:41431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:34557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24982
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:39.053102 24982 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:39.053354 24982 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:39.058681 24992 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:39.058796 24996 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:39.058706 24989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:39.058758 24982 server_base.cc:1034] running on GCE node
I20260811 08:13:39.059100 24982 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:39.059415 24982 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:39.060597 24982 hybrid_clock.cc:648] HybridClock initialized: now 1786436019060571 us; error 42 us; skew 500 ppm
Aug 11 08:13:39 dist-test-slave-gkw7 krb5kdc[24818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436019, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:39.063414 24982 init.cc:377] Logged in from keytab as kudu/127.20.158.129@KRBTEST.COM (short username kudu)
I20260811 08:13:39.063903 24982 webserver.cc:460] Webserver started at http://127.20.158.129:33711/ using document root <none> and password file <none>
I20260811 08:13:39.064146 24982 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:39.064224 24982 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:39.064378 24982 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:39.065464 24982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/data/instance:
uuid: "8b6434937a7f4b5cb59a49fa6d8da1af"
format_stamp: "Formatted at 2026-08-11 08:13:39 on dist-test-slave-gkw7"
server_key: "ece994d70a58d7e4e699c040270ba4d4"
server_key_iv: "97d18bbae86045b1a1c746b7a6bd221a"
server_key_version: "encryptionkey@0"
I20260811 08:13:39.065905 24982 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance:
uuid: "8b6434937a7f4b5cb59a49fa6d8da1af"
format_stamp: "Formatted at 2026-08-11 08:13:39 on dist-test-slave-gkw7"
server_key: "ece994d70a58d7e4e699c040270ba4d4"
server_key_iv: "97d18bbae86045b1a1c746b7a6bd221a"
server_key_version: "encryptionkey@0"
I20260811 08:13:39.067294 24982 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:39.068147 25004 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:39.068323 24982 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:39.068435 24982 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "8b6434937a7f4b5cb59a49fa6d8da1af"
format_stamp: "Formatted at 2026-08-11 08:13:39 on dist-test-slave-gkw7"
server_key: "ece994d70a58d7e4e699c040270ba4d4"
server_key_iv: "97d18bbae86045b1a1c746b7a6bd221a"
server_key_version: "encryptionkey@0"
I20260811 08:13:39.068511 24982 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:39.078248 24982 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:39.080749 24982 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:39.080929 24982 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:39.081198 24982 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:39.081617 24982 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:39.081681 24982 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:39.081722 24982 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:39.081749 24982 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:39.087872 24982 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:38507
I20260811 08:13:39.087921 25179 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:38507 every 8 connection(s)
I20260811 08:13:39.088258 24982 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:13:39.090186 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 24982
I20260811 08:13:39.090277 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance
I20260811 08:13:39.090467 21114 external_mini_cluster.cc:1428] Setting key c6c3befd2072fdceccb3ea6a0d218efe
Aug 11 08:13:39 dist-test-slave-gkw7 krb5kdc[24818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436019, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:39.099712 24944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:39.089016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:52645 (local address 127.20.158.190:34557)
0811 08:13:39.089087 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:39.089089 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:39.089380 (+ 291us) server_negotiation.cc:407] Connection header received
0811 08:13:39.090061 (+ 681us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:39.090063 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:39.090076 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:39.090142 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:39.091439 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:39.091974 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:39.093227 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:39.093444 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:39.093507 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:39.096339 (+ 2832us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:39.096340 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:39.096341 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:39.096348 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:39.097976 (+ 1628us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:39.098568 (+ 592us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:39.098569 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:39.098570 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:39.098634 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:39.098947 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:39.098948 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:39.098949 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:39.099091 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:39.099149 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:39.099526 (+ 377us) server_negotiation.cc:299] Negotiation successful
0811 08:13:39.099631 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 08:13:39.099974 25186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:39.088988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:34557 (local address 127.20.158.129:52645)
0811 08:13:39.089236 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:39.089293 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:39.089895 (+ 602us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:39.090235 (+ 340us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:39.090239 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:39.091022 (+ 783us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:39.091310 (+ 288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:39.091318 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:39.092085 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:39.092086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:39.093120 (+ 1034us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:39.093123 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:39.093557 (+ 434us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:39.093558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:39.093719 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:39.094399 (+ 680us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:39.094408 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:39.096241 (+ 1833us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:39.098064 (+ 1823us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:39.098071 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:39.098074 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:39.098403 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:39.098717 (+ 314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:39.098718 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:39.098719 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:39.098869 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:39.099166 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:39.099173 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:39.099358 (+ 185us) client_negotiation.cc:769] Sending connection context
0811 08:13:39.099496 (+ 138us) client_negotiation.cc:240] Negotiation successful
0811 08:13:39.099707 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":95,"threads_started":1}
WARNING: no policy specified for kudu/127.20.158.130@KRBTEST.COM; defaulting to no policy
I20260811 08:13:39.100581 25182 heartbeater.cc:347] Connected to a master server at 127.20.158.190:34557
I20260811 08:13:39.100689 25182 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:39.100848 25182 heartbeater.cc:511] Master 127.20.158.190:34557 requested a full tablet report, sending...
I20260811 08:13:39.101459 24884 ts_manager.cc:194] Registered new tserver with Master: 8b6434937a7f4b5cb59a49fa6d8da1af (127.20.158.129:38507)
I20260811 08:13:39.102136 24884 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.129@KRBTEST.COM'} at 127.20.158.129:52645
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
I20260811 08:13:39.120414 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:0
--local_ip_for_outbound_sockets=127.20.158.130
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:34557
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:41431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:39.203752 25189 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:39.203953 25189 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:39.203976 25189 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:39.205065 25189 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:39.205098 25189 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:39.205124 25189 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:13:39.206606 25189 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:41431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:34557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25189
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:39.206809 25189 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:39.206987 25189 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:39.212025 25198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:39.212040 25204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:39.212133 25200 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:39.212360 25189 server_base.cc:1034] running on GCE node
I20260811 08:13:39.212604 25189 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:39.212807 25189 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:39.213940 25189 hybrid_clock.cc:648] HybridClock initialized: now 1786436019213912 us; error 37 us; skew 500 ppm
Aug 11 08:13:39 dist-test-slave-gkw7 krb5kdc[24818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436019, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:39.216823 25189 init.cc:377] Logged in from keytab as kudu/127.20.158.130@KRBTEST.COM (short username kudu)
I20260811 08:13:39.217274 25189 webserver.cc:460] Webserver started at http://127.20.158.130:36729/ using document root <none> and password file <none>
I20260811 08:13:39.217482 25189 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:39.217566 25189 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:39.217689 25189 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:39.218686 25189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/data/instance:
uuid: "e8adb09ed3114720a6cf5c00cf9bde49"
format_stamp: "Formatted at 2026-08-11 08:13:39 on dist-test-slave-gkw7"
server_key: "ca4ab31784bc5f270c1207b65895c412"
server_key_iv: "8e6d62f9c2c5cc6f9a0a6df07fc53f1d"
server_key_version: "encryptionkey@0"
I20260811 08:13:39.218982 25189 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance:
uuid: "e8adb09ed3114720a6cf5c00cf9bde49"
format_stamp: "Formatted at 2026-08-11 08:13:39 on dist-test-slave-gkw7"
server_key: "ca4ab31784bc5f270c1207b65895c412"
server_key_iv: "8e6d62f9c2c5cc6f9a0a6df07fc53f1d"
server_key_version: "encryptionkey@0"
I20260811 08:13:39.220259 25189 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:13:39.220973 25217 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:39.221256 25189 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:39.221370 25189 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "e8adb09ed3114720a6cf5c00cf9bde49"
format_stamp: "Formatted at 2026-08-11 08:13:39 on dist-test-slave-gkw7"
server_key: "ca4ab31784bc5f270c1207b65895c412"
server_key_iv: "8e6d62f9c2c5cc6f9a0a6df07fc53f1d"
server_key_version: "encryptionkey@0"
I20260811 08:13:39.221448 25189 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:39.237095 25189 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:39.239392 25189 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:39.239566 25189 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:39.239867 25189 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:39.240293 25189 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:39.240341 25189 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:39.240371 25189 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:39.240389 25189 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:39.247152 25189 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:45091
I20260811 08:13:39.247193 25393 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:45091 every 8 connection(s)
I20260811 08:13:39.247587 25189 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
Aug 11 08:13:39 dist-test-slave-gkw7 krb5kdc[24818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436019, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:39.256372 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 25189
I20260811 08:13:39.256464 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance
I20260811 08:13:39.256705 21114 external_mini_cluster.cc:1428] Setting key e060993dae96750d26382d9c72bfee38
I20260811 08:13:39.258288 24944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:39.248505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:45219 (local address 127.20.158.190:34557)
0811 08:13:39.248617 (+ 112us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:39.248619 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:39.248841 (+ 222us) server_negotiation.cc:407] Connection header received
0811 08:13:39.249431 (+ 590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:39.249433 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:39.249448 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:39.249515 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:39.250567 (+ 1052us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:39.251120 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:39.252225 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:39.252434 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:39.252536 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:39.254909 (+ 2373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:39.254910 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:39.254910 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:39.254918 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:39.256613 (+ 1695us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:39.257145 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:39.257146 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:39.257147 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:39.257216 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:39.257487 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:39.257488 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:39.257488 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:39.257663 (+ 175us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:39.257743 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:39.258039 (+ 296us) server_negotiation.cc:299] Negotiation successful
0811 08:13:39.258144 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260811 08:13:39.258381 25396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:39.248429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:34557 (local address 127.20.158.130:45219)
0811 08:13:39.248696 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:39.248746 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:39.249304 (+ 558us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:39.249609 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:39.249614 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:39.250233 (+ 619us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:39.250441 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:39.250447 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:39.251230 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:39.251232 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:39.252104 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:39.252106 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:39.252561 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:39.252562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:39.252693 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:39.253209 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:39.253218 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:39.254780 (+ 1562us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:39.256697 (+ 1917us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:39.256705 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:39.256707 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:39.257005 (+ 298us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:39.257294 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:39.257295 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:39.257295 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:39.257408 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:39.257744 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:39.257750 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:39.257887 (+ 137us) client_negotiation.cc:769] Sending connection context
0811 08:13:39.257990 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 08:13:39.258168 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":130,"threads_started":1}
I20260811 08:13:39.258929 25394 heartbeater.cc:347] Connected to a master server at 127.20.158.190:34557
I20260811 08:13:39.259052 25394 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:39.259258 25394 heartbeater.cc:511] Master 127.20.158.190:34557 requested a full tablet report, sending...
I20260811 08:13:39.259763 24884 ts_manager.cc:194] Registered new tserver with Master: e8adb09ed3114720a6cf5c00cf9bde49 (127.20.158.130:45091)
I20260811 08:13:39.260182 24884 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.130@KRBTEST.COM'} at 127.20.158.130:45219
WARNING: no policy specified for kudu/127.20.158.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
I20260811 08:13:39.288983 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:0
--local_ip_for_outbound_sockets=127.20.158.131
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:34557
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:41431
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:39.374927 25402 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:39.375126 25402 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:39.375149 25402 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:39.376353 25402 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:39.376397 25402 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:39.376422 25402 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:13:39.377874 25402 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:41431
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:34557
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25402
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:39.378116 25402 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:39.378360 25402 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:39.383520 25413 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:39.383658 25410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:39.383592 25409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:39.383695 25402 server_base.cc:1034] running on GCE node
I20260811 08:13:39.383986 25402 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:39.384265 25402 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:39.385429 25402 hybrid_clock.cc:648] HybridClock initialized: now 1786436019385405 us; error 38 us; skew 500 ppm
Aug 11 08:13:39 dist-test-slave-gkw7 krb5kdc[24818](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436019, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:39.388242 25402 init.cc:377] Logged in from keytab as kudu/127.20.158.131@KRBTEST.COM (short username kudu)
I20260811 08:13:39.388674 25402 webserver.cc:460] Webserver started at http://127.20.158.131:41319/ using document root <none> and password file <none>
I20260811 08:13:39.388921 25402 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:39.389010 25402 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:39.389161 25402 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:39.390301 25402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/data/instance:
uuid: "a9c24b61a81e42f295dabafe280ee8d5"
format_stamp: "Formatted at 2026-08-11 08:13:39 on dist-test-slave-gkw7"
server_key: "ad2951ade0ffdd49242c9ec0cc804472"
server_key_iv: "2f9b636100637e41fd86b7836a01ed36"
server_key_version: "encryptionkey@0"
I20260811 08:13:39.390664 25402 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance:
uuid: "a9c24b61a81e42f295dabafe280ee8d5"
format_stamp: "Formatted at 2026-08-11 08:13:39 on dist-test-slave-gkw7"
server_key: "ad2951ade0ffdd49242c9ec0cc804472"
server_key_iv: "2f9b636100637e41fd86b7836a01ed36"
server_key_version: "encryptionkey@0"
I20260811 08:13:39.392045 25402 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:13:39.392838 25421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:39.393013 25402 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:13:39.393127 25402 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "a9c24b61a81e42f295dabafe280ee8d5"
format_stamp: "Formatted at 2026-08-11 08:13:39 on dist-test-slave-gkw7"
server_key: "ad2951ade0ffdd49242c9ec0cc804472"
server_key_iv: "2f9b636100637e41fd86b7836a01ed36"
server_key_version: "encryptionkey@0"
I20260811 08:13:39.393206 25402 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:39.410779 25402 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:39.413193 25402 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:39.413378 25402 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:39.413738 25402 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:39.414076 25402 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:39.414134 25402 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:39.414217 25402 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:39.414243 25402 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:39.421159 25402 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:35367
I20260811 08:13:39.421265 25594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:35367 every 8 connection(s)
I20260811 08:13:39.421658 25402 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
I20260811 08:13:39.425320 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 25402
I20260811 08:13:39.425405 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance
I20260811 08:13:39.425665 21114 external_mini_cluster.cc:1428] Setting key 87037b87cad5f7630e06b4eae6aa6e58
Aug 11 08:13:39 dist-test-slave-gkw7 krb5kdc[24818](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436019, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:39.431408 24944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:39.422445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:33451 (local address 127.20.158.190:34557)
0811 08:13:39.422513 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:39.422515 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:39.422699 (+ 184us) server_negotiation.cc:407] Connection header received
0811 08:13:39.423183 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:39.423184 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:39.423196 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:39.423262 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:39.424301 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:39.424821 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:39.426203 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:39.426469 (+ 266us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:39.426557 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:39.428758 (+ 2201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:39.428759 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:39.428760 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:39.428768 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:39.430138 (+ 1370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:39.430517 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:39.430518 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:39.430519 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:39.430582 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:39.430830 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:39.430831 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:39.430831 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:39.430960 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:39.431034 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:39.431273 (+ 239us) server_negotiation.cc:299] Negotiation successful
0811 08:13:39.431344 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 08:13:39.431589 25600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:39.422429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:34557 (local address 127.20.158.131:33451)
0811 08:13:39.422589 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:39.422626 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:39.423092 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:39.423323 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:39.423327 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:39.423933 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:39.424204 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:39.424210 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:39.424907 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:39.424908 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:39.426122 (+ 1214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:39.426125 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:39.426594 (+ 469us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:39.426595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:39.426736 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:39.427304 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:39.427313 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:39.428652 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:39.430216 (+ 1564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:39.430222 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:39.430224 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:39.430446 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:39.430647 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:39.430648 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:39.430648 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:39.430745 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:39.431031 (+ 286us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:39.431036 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:39.431147 (+ 111us) client_negotiation.cc:769] Sending connection context
0811 08:13:39.431230 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 08:13:39.431359 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":96,"threads_started":1}
I20260811 08:13:39.432101 25597 heartbeater.cc:347] Connected to a master server at 127.20.158.190:34557
I20260811 08:13:39.432207 25597 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:39.432359 25597 heartbeater.cc:511] Master 127.20.158.190:34557 requested a full tablet report, sending...
I20260811 08:13:39.432765 24884 ts_manager.cc:194] Registered new tserver with Master: a9c24b61a81e42f295dabafe280ee8d5 (127.20.158.131:35367)
I20260811 08:13:39.433281 24884 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.131@KRBTEST.COM'} at 127.20.158.131:33451
I20260811 08:13:39.437475 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 08:13:39.450690 24944 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:39.449629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50634 (local address 127.20.158.190:34557)
0811 08:13:39.449712 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:39.449715 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:39.449821 (+ 106us) server_negotiation.cc:407] Connection header received
0811 08:13:39.449913 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:39.449914 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:39.449925 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:39.450003 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:39.450595 (+ 592us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50634: BlockingRecv error: recv got EOF from 127.0.0.1:50634 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 08:13:39.451676 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 24982
I20260811 08:13:39.470264 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 25189
I20260811 08:13:39.488018 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 25402
I20260811 08:13:39.503451 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 24834
2026-08-11T08:13:39Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (2119 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:13:39 dist-test-slave-gkw7 krb5kdc[25617](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:13:39 dist-test-slave-gkw7 krb5kdc[25617](info): set up 2 sockets
Aug 11 08:13:39 dist-test-slave-gkw7 krb5kdc[25617](info): commencing operation
krb5kdc: starting...
W20260811 08:13:40.806747 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.278s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:13:40 dist-test-slave-gkw7 krb5kdc[25617](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436020, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:13:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:13:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:13:40.945178 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:45503
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:43953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:45503
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:41.031931 25642 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:41.032253 25642 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:41.032303 25642 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:41.033517 25642 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:41.033622 25642 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:41.033649 25642 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:41.033675 25642 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:41.033723 25642 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:13:41.035301 25642 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:43953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:45503
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:45503
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25642
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:41.035609 25642 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:41.035858 25642 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:41.041091 25648 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:41.041136 25649 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:41.041246 25642 server_base.cc:1034] running on GCE node
W20260811 08:13:41.041378 25652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:41.041718 25642 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:41.042075 25642 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:41.043260 25642 hybrid_clock.cc:648] HybridClock initialized: now 1786436021043218 us; error 59 us; skew 500 ppm
Aug 11 08:13:41 dist-test-slave-gkw7 krb5kdc[25617](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436021, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:41.046060 25642 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:13:41.046550 25642 webserver.cc:460] Webserver started at http://127.20.158.190:37913/ using document root <none> and password file <none>
I20260811 08:13:41.046746 25642 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:41.046793 25642 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:41.046887 25642 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:41.047950 25642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "0c969395a5074468a51d3c8bb7267075"
format_stamp: "Formatted at 2026-08-11 08:13:41 on dist-test-slave-gkw7"
server_key: "315305b44b8b9dda4c3762da5b3b5854"
server_key_iv: "77866557512ba88fe80ca0c4dbbd2521"
server_key_version: "encryptionkey@0"
I20260811 08:13:41.048264 25642 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "0c969395a5074468a51d3c8bb7267075"
format_stamp: "Formatted at 2026-08-11 08:13:41 on dist-test-slave-gkw7"
server_key: "315305b44b8b9dda4c3762da5b3b5854"
server_key_iv: "77866557512ba88fe80ca0c4dbbd2521"
server_key_version: "encryptionkey@0"
I20260811 08:13:41.049667 25642 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:13:41.050483 25665 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:41.050684 25642 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:41.050797 25642 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "0c969395a5074468a51d3c8bb7267075"
format_stamp: "Formatted at 2026-08-11 08:13:41 on dist-test-slave-gkw7"
server_key: "315305b44b8b9dda4c3762da5b3b5854"
server_key_iv: "77866557512ba88fe80ca0c4dbbd2521"
server_key_version: "encryptionkey@0"
I20260811 08:13:41.050873 25642 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:41.064922 25642 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:41.067544 25642 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:41.067692 25642 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:41.072005 25642 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:45503
I20260811 08:13:41.072134 25753 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:45503 every 8 connection(s)
I20260811 08:13:41.072629 25642 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:13:41.073436 25754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:41.076126 25754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c969395a5074468a51d3c8bb7267075: Bootstrap starting.
I20260811 08:13:41.076944 25754 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c969395a5074468a51d3c8bb7267075: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:41.077316 25754 log.cc:824] T 00000000000000000000000000000000 P 0c969395a5074468a51d3c8bb7267075: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:41.078135 25754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c969395a5074468a51d3c8bb7267075: No bootstrap required, opened a new log
I20260811 08:13:41.079957 25754 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c969395a5074468a51d3c8bb7267075 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c969395a5074468a51d3c8bb7267075" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 45503 } }
I20260811 08:13:41.080118 25754 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c969395a5074468a51d3c8bb7267075 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:41.080153 25754 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c969395a5074468a51d3c8bb7267075 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c969395a5074468a51d3c8bb7267075, State: Initialized, Role: FOLLOWER
I20260811 08:13:41.080358 25754 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c969395a5074468a51d3c8bb7267075 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c969395a5074468a51d3c8bb7267075" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 45503 } }
I20260811 08:13:41.080432 25754 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c969395a5074468a51d3c8bb7267075 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:13:41.080478 25754 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c969395a5074468a51d3c8bb7267075 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:13:41.080533 25754 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c969395a5074468a51d3c8bb7267075 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:41.081640 25754 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c969395a5074468a51d3c8bb7267075 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c969395a5074468a51d3c8bb7267075" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 45503 } }
I20260811 08:13:41.081775 25754 leader_election.cc:302] T 00000000000000000000000000000000 P 0c969395a5074468a51d3c8bb7267075 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c969395a5074468a51d3c8bb7267075; no voters:
I20260811 08:13:41.082010 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 25642
I20260811 08:13:41.082047 25754 leader_election.cc:288] T 00000000000000000000000000000000 P 0c969395a5074468a51d3c8bb7267075 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:13:41.082085 25759 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c969395a5074468a51d3c8bb7267075 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:41.082120 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:13:41.082234 25759 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c969395a5074468a51d3c8bb7267075 [term 1 LEADER]: Becoming Leader. State: Replica: 0c969395a5074468a51d3c8bb7267075, State: Running, Role: LEADER
I20260811 08:13:41.082307 21114 external_mini_cluster.cc:1428] Setting key 1b792f9e61a1b7f0661d48f07111727e
I20260811 08:13:41.082335 25759 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c969395a5074468a51d3c8bb7267075 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c969395a5074468a51d3c8bb7267075" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 45503 } }
I20260811 08:13:41.082415 25754 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c969395a5074468a51d3c8bb7267075 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:41.082697 25761 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c969395a5074468a51d3c8bb7267075 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c969395a5074468a51d3c8bb7267075" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c969395a5074468a51d3c8bb7267075" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 45503 } } }
I20260811 08:13:41.082698 25762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c969395a5074468a51d3c8bb7267075 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c969395a5074468a51d3c8bb7267075. Latest consensus state: current_term: 1 leader_uuid: "0c969395a5074468a51d3c8bb7267075" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c969395a5074468a51d3c8bb7267075" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 45503 } } }
I20260811 08:13:41.082906 25761 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c969395a5074468a51d3c8bb7267075 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:41.082934 25762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c969395a5074468a51d3c8bb7267075 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:41.083477 25770 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:13:41.084134 25770 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:13:41.085898 25770 catalog_manager.cc:1347] Generated new cluster ID: 0dc88c0bf19545b5b07d6fd510c30e7a
I20260811 08:13:41.085960 25770 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:13:41 dist-test-slave-gkw7 krb5kdc[25617](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436020, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:41.095300 25769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:41.082850 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42804 (local address 127.20.158.190:45503)
0811 08:13:41.083333 (+ 483us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:41.083344 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:41.083384 (+ 40us) server_negotiation.cc:407] Connection header received
0811 08:13:41.083522 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:41.083530 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:41.083595 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:41.084747 (+ 1152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:41.084869 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:41.086428 (+ 1559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:41.087483 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:41.088244 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:41.088366 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:41.091375 (+ 3009us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:41.091380 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:41.091380 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:41.091394 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:41.093464 (+ 2070us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:41.093958 (+ 494us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:41.093961 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:41.093962 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:41.094074 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:41.094311 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:41.094312 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:41.094313 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:41.094635 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:41.094788 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:41.094930 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 08:13:41.095068 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":233,"threads_started":1}
I20260811 08:13:41.096558 21114 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:13:41.104399 25770 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:13:41.105257 25770 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:13:41.113240 25770 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0c969395a5074468a51d3c8bb7267075: Generated new TSK 0
I20260811 08:13:41.113490 25770 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:13:41.116997 25769 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:41.113154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42806 (local address 127.20.158.190:45503)
0811 08:13:41.113195 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:41.113197 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:41.113385 (+ 188us) server_negotiation.cc:407] Connection header received
0811 08:13:41.113517 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:41.113518 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:41.113577 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:41.113635 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:41.114108 (+ 473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:41.114611 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:41.115383 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:41.115617 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:41.115699 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:41.116488 (+ 789us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:41.116489 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:41.116490 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:13:41.116685 (+ 195us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:41.116701 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:13:41.116708 (+ 7us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:41.116779 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:41.116879 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 08:13:41.116906 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:13:41.120113 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 25642
2026-08-11T08:13:41Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1618 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:13:41 dist-test-slave-gkw7 krb5kdc[25800](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:13:41 dist-test-slave-gkw7 krb5kdc[25800](info): set up 2 sockets
Aug 11 08:13:41 dist-test-slave-gkw7 krb5kdc[25800](info): commencing operation
krb5kdc: starting...
W20260811 08:13:42.371379 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.224s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:13:42 dist-test-slave-gkw7 krb5kdc[25800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:13:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:13:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:13:42.500258 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:37961
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:33965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:37961
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:42.588100 25819 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:42.588327 25819 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:42.588352 25819 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:42.589445 25819 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:42.589486 25819 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:42.589504 25819 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:42.589517 25819 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:42.589594 25819 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:13:42.591123 25819 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:33965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:37961
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:37961
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25819
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:42.591389 25819 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:42.591670 25819 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:42.597055 25833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:42.597090 25819 server_base.cc:1034] running on GCE node
W20260811 08:13:42.597056 25831 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:42.597047 25836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:42.597513 25819 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:42.597885 25819 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:42.599036 25819 hybrid_clock.cc:648] HybridClock initialized: now 1786436022599023 us; error 29 us; skew 500 ppm
Aug 11 08:13:42 dist-test-slave-gkw7 krb5kdc[25800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436022, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:42.601613 25819 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:13:42.602118 25819 webserver.cc:460] Webserver started at http://127.20.158.190:41981/ using document root <none> and password file <none>
I20260811 08:13:42.602386 25819 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:42.602458 25819 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:42.602617 25819 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:42.603754 25819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "c81da0c746ad403a851b0d8f857f9edc"
format_stamp: "Formatted at 2026-08-11 08:13:42 on dist-test-slave-gkw7"
server_key: "ed60a67b77ef881e73702e7ab97c425d"
server_key_iv: "f00bf879692d9ebc4faf2edaa1bf95ef"
server_key_version: "encryptionkey@0"
I20260811 08:13:42.604142 25819 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "c81da0c746ad403a851b0d8f857f9edc"
format_stamp: "Formatted at 2026-08-11 08:13:42 on dist-test-slave-gkw7"
server_key: "ed60a67b77ef881e73702e7ab97c425d"
server_key_iv: "f00bf879692d9ebc4faf2edaa1bf95ef"
server_key_version: "encryptionkey@0"
I20260811 08:13:42.605635 25819 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:13:42.606444 25846 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:42.606639 25819 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:42.606745 25819 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "c81da0c746ad403a851b0d8f857f9edc"
format_stamp: "Formatted at 2026-08-11 08:13:42 on dist-test-slave-gkw7"
server_key: "ed60a67b77ef881e73702e7ab97c425d"
server_key_iv: "f00bf879692d9ebc4faf2edaa1bf95ef"
server_key_version: "encryptionkey@0"
I20260811 08:13:42.606832 25819 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:42.631111 25819 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:42.633184 25819 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:42.633376 25819 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:42.637715 25819 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:37961
I20260811 08:13:42.637774 25916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:37961 every 8 connection(s)
I20260811 08:13:42.638166 25819 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:13:42.639353 25920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:42.641752 25920 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c81da0c746ad403a851b0d8f857f9edc: Bootstrap starting.
I20260811 08:13:42.642364 25920 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c81da0c746ad403a851b0d8f857f9edc: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:42.642660 25920 log.cc:824] T 00000000000000000000000000000000 P c81da0c746ad403a851b0d8f857f9edc: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:42.643476 25920 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c81da0c746ad403a851b0d8f857f9edc: No bootstrap required, opened a new log
I20260811 08:13:42.645169 25920 raft_consensus.cc:348] T 00000000000000000000000000000000 P c81da0c746ad403a851b0d8f857f9edc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81da0c746ad403a851b0d8f857f9edc" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37961 } }
I20260811 08:13:42.645316 25920 raft_consensus.cc:374] T 00000000000000000000000000000000 P c81da0c746ad403a851b0d8f857f9edc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:42.645341 25920 raft_consensus.cc:729] T 00000000000000000000000000000000 P c81da0c746ad403a851b0d8f857f9edc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c81da0c746ad403a851b0d8f857f9edc, State: Initialized, Role: FOLLOWER
I20260811 08:13:42.645578 25920 consensus_queue.cc:260] T 00000000000000000000000000000000 P c81da0c746ad403a851b0d8f857f9edc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81da0c746ad403a851b0d8f857f9edc" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37961 } }
I20260811 08:13:42.645654 25920 raft_consensus.cc:388] T 00000000000000000000000000000000 P c81da0c746ad403a851b0d8f857f9edc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:13:42.645680 25920 raft_consensus.cc:482] T 00000000000000000000000000000000 P c81da0c746ad403a851b0d8f857f9edc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:13:42.645759 25920 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c81da0c746ad403a851b0d8f857f9edc [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:42.646654 25920 raft_consensus.cc:504] T 00000000000000000000000000000000 P c81da0c746ad403a851b0d8f857f9edc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81da0c746ad403a851b0d8f857f9edc" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37961 } }
I20260811 08:13:42.646761 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 25819
I20260811 08:13:42.646778 25920 leader_election.cc:302] T 00000000000000000000000000000000 P c81da0c746ad403a851b0d8f857f9edc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c81da0c746ad403a851b0d8f857f9edc; no voters:
I20260811 08:13:42.646907 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:13:42.646976 25920 leader_election.cc:288] T 00000000000000000000000000000000 P c81da0c746ad403a851b0d8f857f9edc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:13:42.647013 25925 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c81da0c746ad403a851b0d8f857f9edc [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:42.647107 21114 external_mini_cluster.cc:1428] Setting key c74a8c515dc5a234595a045093566877
I20260811 08:13:42.647156 25925 raft_consensus.cc:686] T 00000000000000000000000000000000 P c81da0c746ad403a851b0d8f857f9edc [term 1 LEADER]: Becoming Leader. State: Replica: c81da0c746ad403a851b0d8f857f9edc, State: Running, Role: LEADER
I20260811 08:13:42.647274 25920 sys_catalog.cc:564] T 00000000000000000000000000000000 P c81da0c746ad403a851b0d8f857f9edc [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:42.647270 25925 consensus_queue.cc:237] T 00000000000000000000000000000000 P c81da0c746ad403a851b0d8f857f9edc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81da0c746ad403a851b0d8f857f9edc" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37961 } }
I20260811 08:13:42.648910 25927 sys_catalog.cc:455] T 00000000000000000000000000000000 P c81da0c746ad403a851b0d8f857f9edc [sys.catalog]: SysCatalogTable state changed. Reason: New leader c81da0c746ad403a851b0d8f857f9edc. Latest consensus state: current_term: 1 leader_uuid: "c81da0c746ad403a851b0d8f857f9edc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81da0c746ad403a851b0d8f857f9edc" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37961 } } }
I20260811 08:13:42.649026 25927 sys_catalog.cc:458] T 00000000000000000000000000000000 P c81da0c746ad403a851b0d8f857f9edc [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:42.649421 25926 sys_catalog.cc:455] T 00000000000000000000000000000000 P c81da0c746ad403a851b0d8f857f9edc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c81da0c746ad403a851b0d8f857f9edc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c81da0c746ad403a851b0d8f857f9edc" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37961 } } }
W20260811 08:13:42.649572 25950 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c81da0c746ad403a851b0d8f857f9edc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:13:42.649837 25950 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:13:42.649821 25926 sys_catalog.cc:458] T 00000000000000000000000000000000 P c81da0c746ad403a851b0d8f857f9edc [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:42.650146 25952 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:13:42.650357 25952 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:13:42.652019 25952 catalog_manager.cc:1347] Generated new cluster ID: f4a68b533b704c3bb5970e09386fa1ef
I20260811 08:13:42.652089 25952 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:13:42 dist-test-slave-gkw7 krb5kdc[25800](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436022, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:42.658969 25952 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:13:42.659178 25929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:42.647729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45644 (local address 127.20.158.190:37961)
0811 08:13:42.647951 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:42.647962 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:42.648006 (+ 44us) server_negotiation.cc:407] Connection header received
0811 08:13:42.648151 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:42.648160 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:42.648226 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:42.648454 (+ 228us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:42.649424 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:42.650893 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:42.652011 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:42.652537 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:42.652667 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:42.655203 (+ 2536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:42.655207 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:42.655207 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:42.655220 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:42.657463 (+ 2243us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:42.657888 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:42.657891 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:42.657892 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:42.658010 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:42.658230 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:42.658231 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:42.658231 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:42.658467 (+ 236us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:42.658658 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:42.658744 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 08:13:42.658894 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":101,"threads_started":1}
I20260811 08:13:42.659672 25952 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:13:42.681145 25952 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c81da0c746ad403a851b0d8f857f9edc: Generated new TSK 0
I20260811 08:13:42.681413 25952 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.158.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
I20260811 08:13:42.716663 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:0
--local_ip_for_outbound_sockets=127.20.158.129
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:37961
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:33965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:42.800697 25961 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:42.800912 25961 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:42.800935 25961 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:42.802188 25961 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:42.802230 25961 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:42.802256 25961 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:13:42.803771 25961 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:33965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:37961
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25961
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:42.803969 25961 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:42.804152 25961 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:42.809327 25975 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:42.809250 25971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:42.809428 25961 server_base.cc:1034] running on GCE node
W20260811 08:13:42.809309 25972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:42.809814 25961 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:42.810089 25961 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:42.811265 25961 hybrid_clock.cc:648] HybridClock initialized: now 1786436022811226 us; error 60 us; skew 500 ppm
Aug 11 08:13:42 dist-test-slave-gkw7 krb5kdc[25800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436022, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:42.814344 25961 init.cc:377] Logged in from keytab as kudu/127.20.158.129@KRBTEST.COM (short username kudu)
I20260811 08:13:42.814898 25961 webserver.cc:460] Webserver started at http://127.20.158.129:34061/ using document root <none> and password file <none>
I20260811 08:13:42.815166 25961 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:42.815243 25961 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:42.815418 25961 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:42.816586 25961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/data/instance:
uuid: "d6bda650986a4386aa54d2302d9b0763"
format_stamp: "Formatted at 2026-08-11 08:13:42 on dist-test-slave-gkw7"
server_key: "5b99d8b582c3d34213b9fe06b4d639b5"
server_key_iv: "7a78ca2bfced3f00f33893454b91cbc3"
server_key_version: "encryptionkey@0"
I20260811 08:13:42.816992 25961 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance:
uuid: "d6bda650986a4386aa54d2302d9b0763"
format_stamp: "Formatted at 2026-08-11 08:13:42 on dist-test-slave-gkw7"
server_key: "5b99d8b582c3d34213b9fe06b4d639b5"
server_key_iv: "7a78ca2bfced3f00f33893454b91cbc3"
server_key_version: "encryptionkey@0"
I20260811 08:13:42.818538 25961 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:13:42.819321 25985 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:42.819505 25961 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:13:42.819625 25961 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "d6bda650986a4386aa54d2302d9b0763"
format_stamp: "Formatted at 2026-08-11 08:13:42 on dist-test-slave-gkw7"
server_key: "5b99d8b582c3d34213b9fe06b4d639b5"
server_key_iv: "7a78ca2bfced3f00f33893454b91cbc3"
server_key_version: "encryptionkey@0"
I20260811 08:13:42.819708 25961 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:42.832782 25961 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:42.835378 25961 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:42.835556 25961 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:42.835807 25961 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:42.836160 25961 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:42.836222 25961 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:42.836267 25961 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:42.836299 25961 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:42.843217 25961 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:35017
I20260811 08:13:42.843258 26149 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:35017 every 8 connection(s)
I20260811 08:13:42.843616 25961 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
Aug 11 08:13:42 dist-test-slave-gkw7 krb5kdc[25800](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436022, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:42.852384 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 25961
I20260811 08:13:42.852496 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance
I20260811 08:13:42.852710 21114 external_mini_cluster.cc:1428] Setting key 71b3f29fa8e9f9683993d42c9efc139f
I20260811 08:13:42.853937 25929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:42.844395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:44055 (local address 127.20.158.190:37961)
0811 08:13:42.844446 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:42.844448 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:42.844649 (+ 201us) server_negotiation.cc:407] Connection header received
0811 08:13:42.845119 (+ 470us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:42.845121 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:42.845133 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:42.845208 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:42.846176 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:42.846729 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:42.847875 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:42.848096 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:42.848200 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:42.850767 (+ 2567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:42.850768 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:42.850769 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:42.850777 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:42.852287 (+ 1510us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:42.852757 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:42.852759 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:42.852759 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:42.852824 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:42.853110 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:42.853111 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:42.853112 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:42.853235 (+ 123us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:42.853325 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:42.853719 (+ 394us) server_negotiation.cc:299] Negotiation successful
0811 08:13:42.853807 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:13:42.853957 26154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:42.844323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:37961 (local address 127.20.158.129:44055)
0811 08:13:42.844498 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:42.844541 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:42.845024 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:42.845286 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:42.845290 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:42.845871 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:42.846061 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:42.846065 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:42.846814 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:42.846815 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:42.847799 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:42.847802 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:42.848216 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:42.848217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:42.848380 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:42.848981 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:42.848990 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:42.850661 (+ 1671us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:42.852392 (+ 1731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:42.852399 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:42.852401 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:42.852675 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:42.852910 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:42.852910 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:42.852911 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:42.853055 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:42.853350 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:42.853358 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:42.853517 (+ 159us) client_negotiation.cc:769] Sending connection context
0811 08:13:42.853674 (+ 157us) client_negotiation.cc:240] Negotiation successful
0811 08:13:42.853803 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":98,"threads_started":1}
I20260811 08:13:42.854468 26151 heartbeater.cc:347] Connected to a master server at 127.20.158.190:37961
I20260811 08:13:42.854573 26151 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:42.854769 26151 heartbeater.cc:511] Master 127.20.158.190:37961 requested a full tablet report, sending...
I20260811 08:13:42.855327 25872 ts_manager.cc:194] Registered new tserver with Master: d6bda650986a4386aa54d2302d9b0763 (127.20.158.129:35017)
I20260811 08:13:42.856248 25872 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.129@KRBTEST.COM'} at 127.20.158.129:44055
WARNING: no policy specified for kudu/127.20.158.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
I20260811 08:13:42.881165 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:0
--local_ip_for_outbound_sockets=127.20.158.130
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:37961
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:33965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:42.964195 26159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:42.964419 26159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:42.964444 26159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:42.965678 26159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:42.965723 26159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:42.965751 26159 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:13:42.967255 26159 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:33965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:37961
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:42.967523 26159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:42.967775 26159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:42.972994 26167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:42.973001 26171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:42.973047 26169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:42.973361 26159 server_base.cc:1034] running on GCE node
I20260811 08:13:42.973657 26159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:42.973950 26159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:42.975135 26159 hybrid_clock.cc:648] HybridClock initialized: now 1786436022975113 us; error 36 us; skew 500 ppm
Aug 11 08:13:42 dist-test-slave-gkw7 krb5kdc[25800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436022, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:42.977979 26159 init.cc:377] Logged in from keytab as kudu/127.20.158.130@KRBTEST.COM (short username kudu)
I20260811 08:13:42.978489 26159 webserver.cc:460] Webserver started at http://127.20.158.130:33059/ using document root <none> and password file <none>
I20260811 08:13:42.978758 26159 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:42.978833 26159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:42.978995 26159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:42.980077 26159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/data/instance:
uuid: "402742e70dcc4f0a9f51c9fc60e611ae"
format_stamp: "Formatted at 2026-08-11 08:13:42 on dist-test-slave-gkw7"
server_key: "6a40976de036b29e86852373d399bd8a"
server_key_iv: "ff2224e754a319e23acbe9a11a789dd6"
server_key_version: "encryptionkey@0"
I20260811 08:13:42.980476 26159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance:
uuid: "402742e70dcc4f0a9f51c9fc60e611ae"
format_stamp: "Formatted at 2026-08-11 08:13:42 on dist-test-slave-gkw7"
server_key: "6a40976de036b29e86852373d399bd8a"
server_key_iv: "ff2224e754a319e23acbe9a11a789dd6"
server_key_version: "encryptionkey@0"
I20260811 08:13:42.982064 26159 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:13:42.982843 26179 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:42.983023 26159 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:13:42.983170 26159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "402742e70dcc4f0a9f51c9fc60e611ae"
format_stamp: "Formatted at 2026-08-11 08:13:42 on dist-test-slave-gkw7"
server_key: "6a40976de036b29e86852373d399bd8a"
server_key_iv: "ff2224e754a319e23acbe9a11a789dd6"
server_key_version: "encryptionkey@0"
I20260811 08:13:42.983251 26159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:42.993144 26159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:42.995380 26159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:42.995581 26159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:42.995879 26159 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:42.996268 26159 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:42.996330 26159 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:42.996376 26159 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:42.996404 26159 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:43.003317 26159 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:36041
I20260811 08:13:43.003371 26341 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:36041 every 8 connection(s)
I20260811 08:13:43.003697 26159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
I20260811 08:13:43.006338 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 26159
I20260811 08:13:43.006464 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance
I20260811 08:13:43.006671 21114 external_mini_cluster.cc:1428] Setting key 406abd47ca1c98b4acaf0959f9b397a0
Aug 11 08:13:43 dist-test-slave-gkw7 krb5kdc[25800](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436022, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:43.015218 25929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:43.004448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:34021 (local address 127.20.158.190:37961)
0811 08:13:43.004537 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:43.004539 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:43.004743 (+ 204us) server_negotiation.cc:407] Connection header received
0811 08:13:43.005283 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:43.005285 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:43.005298 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:43.005357 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:43.006449 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:43.007224 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:43.008805 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:43.009125 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:43.009232 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:43.011662 (+ 2430us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:43.011664 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:43.011664 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:43.011674 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:43.013663 (+ 1989us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:43.014106 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:43.014107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:43.014108 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:43.014184 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:43.014457 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:43.014458 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:43.014459 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:43.014626 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:43.014714 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:43.014976 (+ 262us) server_negotiation.cc:299] Negotiation successful
0811 08:13:43.015099 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 08:13:43.015302 26344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:43.004407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:37961 (local address 127.20.158.130:34021)
0811 08:13:43.004606 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:43.004650 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:43.005173 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:43.005429 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:43.005433 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:43.006130 (+ 697us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:43.006344 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:43.006349 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:43.007337 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:43.007338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:43.008681 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:43.008684 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:43.009267 (+ 583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:43.009268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:43.009446 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:43.010085 (+ 639us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:43.010094 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:43.011558 (+ 1464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:43.013757 (+ 2199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:43.013763 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:43.013765 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:43.014005 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:43.014269 (+ 264us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:43.014269 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:43.014269 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:43.014385 (+ 116us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:43.014705 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:43.014710 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:43.014838 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 08:13:43.014926 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 08:13:43.015055 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":92,"threads_started":1}
I20260811 08:13:43.015873 26342 heartbeater.cc:347] Connected to a master server at 127.20.158.190:37961
I20260811 08:13:43.015992 26342 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:43.016225 26342 heartbeater.cc:511] Master 127.20.158.190:37961 requested a full tablet report, sending...
I20260811 08:13:43.016703 25872 ts_manager.cc:194] Registered new tserver with Master: 402742e70dcc4f0a9f51c9fc60e611ae (127.20.158.130:36041)
I20260811 08:13:43.017107 25872 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.130@KRBTEST.COM'} at 127.20.158.130:34021
WARNING: no policy specified for kudu/127.20.158.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
I20260811 08:13:43.037119 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:0
--local_ip_for_outbound_sockets=127.20.158.131
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:37961
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:33965
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:43.120478 26348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:43.120680 26348 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:43.120703 26348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:43.121912 26348 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:43.121955 26348 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:43.121981 26348 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:13:43.123600 26348 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:33965
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:37961
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26348
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:43.123863 26348 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:43.124095 26348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:13:43.129274 26348 server_base.cc:1034] running on GCE node
W20260811 08:13:43.129207 26357 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:43.129210 26356 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:43.129233 26361 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:43.129675 26348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:43.129947 26348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:43.131124 26348 hybrid_clock.cc:648] HybridClock initialized: now 1786436023131133 us; error 52 us; skew 500 ppm
Aug 11 08:13:43 dist-test-slave-gkw7 krb5kdc[25800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436023, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:43.133810 26348 init.cc:377] Logged in from keytab as kudu/127.20.158.131@KRBTEST.COM (short username kudu)
I20260811 08:13:43.134246 26348 webserver.cc:460] Webserver started at http://127.20.158.131:38163/ using document root <none> and password file <none>
I20260811 08:13:43.134505 26348 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:43.134579 26348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:43.134684 26348 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:43.135679 26348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/data/instance:
uuid: "697656fc1fc94bd48eeebb668e9702f2"
format_stamp: "Formatted at 2026-08-11 08:13:43 on dist-test-slave-gkw7"
server_key: "cbd86c84cdda392e4d90d9207d063ea6"
server_key_iv: "f217f2226cbf00978eb14228ac0f07c1"
server_key_version: "encryptionkey@0"
I20260811 08:13:43.135985 26348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance:
uuid: "697656fc1fc94bd48eeebb668e9702f2"
format_stamp: "Formatted at 2026-08-11 08:13:43 on dist-test-slave-gkw7"
server_key: "cbd86c84cdda392e4d90d9207d063ea6"
server_key_iv: "f217f2226cbf00978eb14228ac0f07c1"
server_key_version: "encryptionkey@0"
I20260811 08:13:43.137302 26348 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:13:43.138134 26372 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:43.138324 26348 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:13:43.138409 26348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "697656fc1fc94bd48eeebb668e9702f2"
format_stamp: "Formatted at 2026-08-11 08:13:43 on dist-test-slave-gkw7"
server_key: "cbd86c84cdda392e4d90d9207d063ea6"
server_key_iv: "f217f2226cbf00978eb14228ac0f07c1"
server_key_version: "encryptionkey@0"
I20260811 08:13:43.138463 26348 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:43.154438 26348 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:43.156294 26348 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:43.156409 26348 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:43.156598 26348 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:43.156860 26348 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:43.156893 26348 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:43.156915 26348 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:43.156929 26348 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:43.162989 26348 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:40999
I20260811 08:13:43.163069 26543 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:40999 every 8 connection(s)
I20260811 08:13:43.163406 26348 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
Aug 11 08:13:43 dist-test-slave-gkw7 krb5kdc[25800](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436023, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:43.172441 25929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:43.164222 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:43047 (local address 127.20.158.190:37961)
0811 08:13:43.164280 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:43.164282 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:43.164474 (+ 192us) server_negotiation.cc:407] Connection header received
0811 08:13:43.164933 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:43.164934 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:43.164946 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:43.165008 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:43.165996 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:43.166509 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:43.167513 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:43.167734 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:43.167805 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:43.169997 (+ 2192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:43.169999 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:43.170000 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:43.170007 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:43.171265 (+ 1258us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:43.171645 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:43.171646 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:43.171646 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:43.171707 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:43.171929 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:43.171930 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:43.171930 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:43.172034 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:43.172094 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:43.172315 (+ 221us) server_negotiation.cc:299] Negotiation successful
0811 08:13:43.172378 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:13:43.172633 26546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:43.164136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:37961 (local address 127.20.158.131:43047)
0811 08:13:43.164323 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:43.164368 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:43.164846 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:43.165084 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:43.165088 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:43.165705 (+ 617us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:43.165909 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:43.165914 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:43.166587 (+ 673us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:43.166588 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:43.167403 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:43.167405 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:43.167818 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:43.167818 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:43.167926 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:43.168455 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:43.168465 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:43.169908 (+ 1443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:43.171347 (+ 1439us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:43.171353 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:43.171355 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:43.171570 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:43.171768 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:43.171769 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:43.171769 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:43.171875 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:43.172095 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:43.172099 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:43.172207 (+ 108us) client_negotiation.cc:769] Sending connection context
0811 08:13:43.172290 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 08:13:43.172405 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":99,"threads_started":1}
I20260811 08:13:43.173168 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 26348
I20260811 08:13:43.173228 26544 heartbeater.cc:347] Connected to a master server at 127.20.158.190:37961
I20260811 08:13:43.173261 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance
I20260811 08:13:43.173333 26544 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:43.173465 21114 external_mini_cluster.cc:1428] Setting key e1f246aee7f0130467baf30a572c148c
I20260811 08:13:43.173511 26544 heartbeater.cc:511] Master 127.20.158.190:37961 requested a full tablet report, sending...
I20260811 08:13:43.173954 25872 ts_manager.cc:194] Registered new tserver with Master: 697656fc1fc94bd48eeebb668e9702f2 (127.20.158.131:40999)
I20260811 08:13:43.174319 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:13:43.174443 25872 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.131@KRBTEST.COM'} at 127.20.158.131:43047
Aug 11 08:13:43 dist-test-slave-gkw7 krb5kdc[25800](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436023, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 11 08:13:43 dist-test-slave-gkw7 krb5kdc[25800](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436023, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:43.198611 25929 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:43.191450 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45646 (local address 127.20.158.190:37961)
0811 08:13:43.191533 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:43.191535 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:43.191585 (+ 50us) server_negotiation.cc:407] Connection header received
0811 08:13:43.191674 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:43.191675 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:43.191685 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:43.191726 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:43.192373 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:43.192863 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:43.193673 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:43.193884 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:43.193935 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:43.196296 (+ 2361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:43.196297 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:43.196297 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:43.196304 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:43.197588 (+ 1284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:43.197921 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:43.197922 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:43.197922 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:43.197998 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:43.198161 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:43.198161 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:43.198162 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:43.198328 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:43.198406 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:43.198490 (+ 84us) server_negotiation.cc:299] Negotiation successful
0811 08:13:43.198547 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
W20260811 08:13:43.198876 25872 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:45646
I20260811 08:13:43.199339 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 25961
I20260811 08:13:43.214553 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 26159
I20260811 08:13:43.228739 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 26348
I20260811 08:13:43.241432 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 25819
2026-08-11T08:13:43Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (2120 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:13:43 dist-test-slave-gkw7 krb5kdc[26563](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:13:43 dist-test-slave-gkw7 krb5kdc[26563](info): set up 2 sockets
Aug 11 08:13:43 dist-test-slave-gkw7 krb5kdc[26563](info): commencing operation
krb5kdc: starting...
W20260811 08:13:44.504748 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.236s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:13:44 dist-test-slave-gkw7 krb5kdc[26563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:13:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:13:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:13:44.633302 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:38105
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:42503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:38105
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:44.722927 26587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:44.723191 26587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:44.723228 26587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:44.724424 26587 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:44.724495 26587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:44.724519 26587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:44.724539 26587 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:44.724568 26587 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:13:44.726140 26587 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:42503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:38105
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:38105
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26587
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:44.726420 26587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:44.726650 26587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:44.731889 26600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:44.731916 26595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:44.731916 26596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:44.731949 26587 server_base.cc:1034] running on GCE node
I20260811 08:13:44.732463 26587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:44.732770 26587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:44.733949 26587 hybrid_clock.cc:648] HybridClock initialized: now 1786436024733933 us; error 43 us; skew 500 ppm
Aug 11 08:13:44 dist-test-slave-gkw7 krb5kdc[26563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436024, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:44.736672 26587 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:13:44.737138 26587 webserver.cc:460] Webserver started at http://127.20.158.190:44719/ using document root <none> and password file <none>
I20260811 08:13:44.737332 26587 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:44.737372 26587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:44.737464 26587 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:44.738586 26587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "fb45879509614edf8c7d9d77e15653ab"
format_stamp: "Formatted at 2026-08-11 08:13:44 on dist-test-slave-gkw7"
server_key: "9150e9c4d681bbd8a185418258684617"
server_key_iv: "ac9de7ee7d11d6dc81ec15037cb5a490"
server_key_version: "encryptionkey@0"
I20260811 08:13:44.738894 26587 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "fb45879509614edf8c7d9d77e15653ab"
format_stamp: "Formatted at 2026-08-11 08:13:44 on dist-test-slave-gkw7"
server_key: "9150e9c4d681bbd8a185418258684617"
server_key_iv: "ac9de7ee7d11d6dc81ec15037cb5a490"
server_key_version: "encryptionkey@0"
I20260811 08:13:44.740201 26587 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:13:44.740965 26608 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:44.741201 26587 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:44.741295 26587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "fb45879509614edf8c7d9d77e15653ab"
format_stamp: "Formatted at 2026-08-11 08:13:44 on dist-test-slave-gkw7"
server_key: "9150e9c4d681bbd8a185418258684617"
server_key_iv: "ac9de7ee7d11d6dc81ec15037cb5a490"
server_key_version: "encryptionkey@0"
I20260811 08:13:44.741360 26587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:44.753252 26587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:44.755122 26587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:44.755232 26587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:44.759218 26587 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:38105
I20260811 08:13:44.759279 26685 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:38105 every 8 connection(s)
I20260811 08:13:44.759781 26587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:13:44.760492 26686 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:44.762838 26686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb45879509614edf8c7d9d77e15653ab: Bootstrap starting.
I20260811 08:13:44.763446 26686 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fb45879509614edf8c7d9d77e15653ab: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:44.763742 26686 log.cc:824] T 00000000000000000000000000000000 P fb45879509614edf8c7d9d77e15653ab: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:44.764454 26686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fb45879509614edf8c7d9d77e15653ab: No bootstrap required, opened a new log
I20260811 08:13:44.766096 26686 raft_consensus.cc:348] T 00000000000000000000000000000000 P fb45879509614edf8c7d9d77e15653ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb45879509614edf8c7d9d77e15653ab" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38105 } }
I20260811 08:13:44.766258 26686 raft_consensus.cc:374] T 00000000000000000000000000000000 P fb45879509614edf8c7d9d77e15653ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:44.766307 26686 raft_consensus.cc:729] T 00000000000000000000000000000000 P fb45879509614edf8c7d9d77e15653ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb45879509614edf8c7d9d77e15653ab, State: Initialized, Role: FOLLOWER
I20260811 08:13:44.766470 26686 consensus_queue.cc:260] T 00000000000000000000000000000000 P fb45879509614edf8c7d9d77e15653ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb45879509614edf8c7d9d77e15653ab" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38105 } }
I20260811 08:13:44.766551 26686 raft_consensus.cc:388] T 00000000000000000000000000000000 P fb45879509614edf8c7d9d77e15653ab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:13:44.766597 26686 raft_consensus.cc:482] T 00000000000000000000000000000000 P fb45879509614edf8c7d9d77e15653ab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:13:44.766644 26686 raft_consensus.cc:3037] T 00000000000000000000000000000000 P fb45879509614edf8c7d9d77e15653ab [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:44.767542 26686 raft_consensus.cc:504] T 00000000000000000000000000000000 P fb45879509614edf8c7d9d77e15653ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb45879509614edf8c7d9d77e15653ab" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38105 } }
I20260811 08:13:44.767669 26686 leader_election.cc:302] T 00000000000000000000000000000000 P fb45879509614edf8c7d9d77e15653ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fb45879509614edf8c7d9d77e15653ab; no voters:
I20260811 08:13:44.767855 26686 leader_election.cc:288] T 00000000000000000000000000000000 P fb45879509614edf8c7d9d77e15653ab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:13:44.767915 26690 raft_consensus.cc:2781] T 00000000000000000000000000000000 P fb45879509614edf8c7d9d77e15653ab [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:44.768128 26690 raft_consensus.cc:686] T 00000000000000000000000000000000 P fb45879509614edf8c7d9d77e15653ab [term 1 LEADER]: Becoming Leader. State: Replica: fb45879509614edf8c7d9d77e15653ab, State: Running, Role: LEADER
I20260811 08:13:44.768193 26686 sys_catalog.cc:564] T 00000000000000000000000000000000 P fb45879509614edf8c7d9d77e15653ab [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:44.768232 26690 consensus_queue.cc:237] T 00000000000000000000000000000000 P fb45879509614edf8c7d9d77e15653ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb45879509614edf8c7d9d77e15653ab" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38105 } }
I20260811 08:13:44.768680 26692 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb45879509614edf8c7d9d77e15653ab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fb45879509614edf8c7d9d77e15653ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb45879509614edf8c7d9d77e15653ab" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38105 } } }
I20260811 08:13:44.768819 26692 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb45879509614edf8c7d9d77e15653ab [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:44.769057 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 26587
I20260811 08:13:44.769165 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:13:44.769158 26702 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:13:44.769377 21114 external_mini_cluster.cc:1428] Setting key bb7ac3eefcab91f28baf6ba872426c3d
I20260811 08:13:44.768694 26691 sys_catalog.cc:455] T 00000000000000000000000000000000 P fb45879509614edf8c7d9d77e15653ab [sys.catalog]: SysCatalogTable state changed. Reason: New leader fb45879509614edf8c7d9d77e15653ab. Latest consensus state: current_term: 1 leader_uuid: "fb45879509614edf8c7d9d77e15653ab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fb45879509614edf8c7d9d77e15653ab" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38105 } } }
I20260811 08:13:44.769450 26691 sys_catalog.cc:458] T 00000000000000000000000000000000 P fb45879509614edf8c7d9d77e15653ab [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:44.770421 26702 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:13:44.772261 26702 catalog_manager.cc:1347] Generated new cluster ID: 692484c97a9c4f93b64b6791ed05fb56
I20260811 08:13:44.772316 26702 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:13:44 dist-test-slave-gkw7 krb5kdc[26563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436024, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:44.781078 26710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:44.769879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42000 (local address 127.20.158.190:38105)
0811 08:13:44.770145 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:44.770157 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:44.770193 (+ 36us) server_negotiation.cc:407] Connection header received
0811 08:13:44.770311 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:44.770317 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:44.770372 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:44.770516 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:44.771458 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:44.772872 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:44.773962 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:44.774568 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:44.774677 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:44.777434 (+ 2757us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:44.777438 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:44.777439 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:44.777453 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:44.779414 (+ 1961us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:44.779812 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:44.779815 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:44.779816 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:44.779930 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:44.780134 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:44.780135 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:44.780136 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:44.780459 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:44.780615 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:44.780717 (+ 102us) server_negotiation.cc:299] Negotiation successful
0811 08:13:44.780859 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":213,"thread_start_us":187,"threads_started":1}
I20260811 08:13:44.785048 26702 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:13:44.785651 26702 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:13:44.791399 26702 catalog_manager.cc:5868] T 00000000000000000000000000000000 P fb45879509614edf8c7d9d77e15653ab: Generated new TSK 0
I20260811 08:13:44.791594 26702 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.158.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
I20260811 08:13:44.820958 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:0
--local_ip_for_outbound_sockets=127.20.158.129
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:38105
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:42503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:44.905325 26720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:44.905558 26720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:44.905607 26720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:44.906822 26720 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:44.906865 26720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:44.906912 26720 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:13:44.908407 26720 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:42503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:38105
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26720
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:44.908656 26720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:44.908890 26720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:44.914042 26726 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:44.914083 26729 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:44.914052 26727 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:44.914204 26720 server_base.cc:1034] running on GCE node
I20260811 08:13:44.914467 26720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:44.914681 26720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:44.915856 26720 hybrid_clock.cc:648] HybridClock initialized: now 1786436024915839 us; error 27 us; skew 500 ppm
Aug 11 08:13:44 dist-test-slave-gkw7 krb5kdc[26563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436024, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:44.918495 26720 init.cc:377] Logged in from keytab as kudu/127.20.158.129@KRBTEST.COM (short username kudu)
I20260811 08:13:44.918884 26720 webserver.cc:460] Webserver started at http://127.20.158.129:37397/ using document root <none> and password file <none>
I20260811 08:13:44.919077 26720 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:44.919119 26720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:44.919205 26720 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:44.920177 26720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-0/data/instance:
uuid: "a080e2b4ef1b4124b534c1a1b9eefae4"
format_stamp: "Formatted at 2026-08-11 08:13:44 on dist-test-slave-gkw7"
server_key: "030b5c2586237da71b7c511be7de88f6"
server_key_iv: "dae9ce50d1e4ceab82128ccc60f59f72"
server_key_version: "encryptionkey@0"
I20260811 08:13:44.920475 26720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance:
uuid: "a080e2b4ef1b4124b534c1a1b9eefae4"
format_stamp: "Formatted at 2026-08-11 08:13:44 on dist-test-slave-gkw7"
server_key: "030b5c2586237da71b7c511be7de88f6"
server_key_iv: "dae9ce50d1e4ceab82128ccc60f59f72"
server_key_version: "encryptionkey@0"
I20260811 08:13:44.921866 26720 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:13:44.922783 26737 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:44.922972 26720 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:13:44.923066 26720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "a080e2b4ef1b4124b534c1a1b9eefae4"
format_stamp: "Formatted at 2026-08-11 08:13:44 on dist-test-slave-gkw7"
server_key: "030b5c2586237da71b7c511be7de88f6"
server_key_iv: "dae9ce50d1e4ceab82128ccc60f59f72"
server_key_version: "encryptionkey@0"
I20260811 08:13:44.923138 26720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:44.933403 26720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:44.935714 26720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:44.935889 26720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:44.936146 26720 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:44.936461 26720 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:44.936513 26720 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:44.936555 26720 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:44.936589 26720 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:44.942495 26720 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:37147
I20260811 08:13:44.942543 26912 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:37147 every 8 connection(s)
I20260811 08:13:44.942857 26720 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:13:44.946413 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 26720
I20260811 08:13:44.946523 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance
I20260811 08:13:44.946738 21114 external_mini_cluster.cc:1428] Setting key 2921760fac09578d31567b31cdf4a2dc
Aug 11 08:13:44 dist-test-slave-gkw7 krb5kdc[26563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436024, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:44.953929 26710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:44.943549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:52839 (local address 127.20.158.190:38105)
0811 08:13:44.943614 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:44.943616 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:44.943824 (+ 208us) server_negotiation.cc:407] Connection header received
0811 08:13:44.944914 (+ 1090us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:44.944915 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:44.944928 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:44.944972 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:44.945659 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:44.946157 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:44.947605 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:44.947818 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:44.947873 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:44.950674 (+ 2801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:44.950676 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:44.950676 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:44.950684 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:44.952161 (+ 1477us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:44.952680 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:44.952680 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:44.952681 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:44.952730 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:44.953018 (+ 288us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:44.953018 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:44.953019 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:44.953118 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:44.953168 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:44.953794 (+ 626us) server_negotiation.cc:299] Negotiation successful
0811 08:13:44.953867 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 08:13:44.954020 26915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:44.943542 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38105 (local address 127.20.158.129:52839)
0811 08:13:44.943704 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:44.943739 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:44.944805 (+ 1066us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:44.945047 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:44.945050 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:44.945337 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:44.945524 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:44.945578 (+ 54us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:44.946276 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:44.946278 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:44.947527 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:44.947530 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:44.947898 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:44.947899 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:44.948066 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:44.948597 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:44.948608 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:44.950581 (+ 1973us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:44.952253 (+ 1672us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:44.952262 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:44.952264 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:44.952602 (+ 338us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:44.952795 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:44.952796 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:44.952797 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:44.952952 (+ 155us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:44.953186 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:44.953194 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:44.953378 (+ 184us) client_negotiation.cc:769] Sending connection context
0811 08:13:44.953509 (+ 131us) client_negotiation.cc:240] Negotiation successful
0811 08:13:44.953740 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":94,"threads_started":1}
I20260811 08:13:44.954555 26913 heartbeater.cc:347] Connected to a master server at 127.20.158.190:38105
I20260811 08:13:44.954660 26913 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:44.954852 26913 heartbeater.cc:511] Master 127.20.158.190:38105 requested a full tablet report, sending...
I20260811 08:13:44.955365 26631 ts_manager.cc:194] Registered new tserver with Master: a080e2b4ef1b4124b534c1a1b9eefae4 (127.20.158.129:37147)
I20260811 08:13:44.955958 26631 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.129@KRBTEST.COM'} at 127.20.158.129:52839
WARNING: no policy specified for kudu/127.20.158.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
I20260811 08:13:44.974542 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:0
--local_ip_for_outbound_sockets=127.20.158.130
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:38105
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:42503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:45.060428 26918 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:45.060679 26918 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:45.060720 26918 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:45.061942 26918 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:45.061998 26918 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:45.062042 26918 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:13:45.063566 26918 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:42503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:38105
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26918
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:45.063838 26918 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:45.064088 26918 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:45.069227 26931 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:45.069344 26928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:45.069270 26927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:45.069459 26918 server_base.cc:1034] running on GCE node
I20260811 08:13:45.069717 26918 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:45.069962 26918 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:45.071101 26918 hybrid_clock.cc:648] HybridClock initialized: now 1786436025071073 us; error 45 us; skew 500 ppm
Aug 11 08:13:45 dist-test-slave-gkw7 krb5kdc[26563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436025, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:45.073674 26918 init.cc:377] Logged in from keytab as kudu/127.20.158.130@KRBTEST.COM (short username kudu)
I20260811 08:13:45.074115 26918 webserver.cc:460] Webserver started at http://127.20.158.130:35699/ using document root <none> and password file <none>
I20260811 08:13:45.074378 26918 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:45.074445 26918 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:45.074582 26918 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:45.075639 26918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-1/data/instance:
uuid: "26450630851642e0b922aac7c0fc24a4"
format_stamp: "Formatted at 2026-08-11 08:13:45 on dist-test-slave-gkw7"
server_key: "f1d774266c3e03ae3a62542c76b0d9e5"
server_key_iv: "1e0b83de821f568754b92c83b986780b"
server_key_version: "encryptionkey@0"
I20260811 08:13:45.076004 26918 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance:
uuid: "26450630851642e0b922aac7c0fc24a4"
format_stamp: "Formatted at 2026-08-11 08:13:45 on dist-test-slave-gkw7"
server_key: "f1d774266c3e03ae3a62542c76b0d9e5"
server_key_iv: "1e0b83de821f568754b92c83b986780b"
server_key_version: "encryptionkey@0"
I20260811 08:13:45.077342 26918 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:13:45.078169 26942 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:45.078347 26918 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:13:45.078446 26918 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "26450630851642e0b922aac7c0fc24a4"
format_stamp: "Formatted at 2026-08-11 08:13:45 on dist-test-slave-gkw7"
server_key: "f1d774266c3e03ae3a62542c76b0d9e5"
server_key_iv: "1e0b83de821f568754b92c83b986780b"
server_key_version: "encryptionkey@0"
I20260811 08:13:45.078528 26918 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:45.091568 26918 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:45.093948 26918 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:45.094126 26918 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:45.094367 26918 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:45.094674 26918 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:45.094724 26918 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:45.094766 26918 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:45.094794 26918 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:45.100618 26918 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:40491
I20260811 08:13:45.100708 27106 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:40491 every 8 connection(s)
I20260811 08:13:45.101011 26918 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
Aug 11 08:13:45 dist-test-slave-gkw7 krb5kdc[26563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436025, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:45.110270 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 26918
I20260811 08:13:45.110394 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance
I20260811 08:13:45.110605 21114 external_mini_cluster.cc:1428] Setting key dbfd5e0c4614298410487e065c9af3cf
I20260811 08:13:45.110800 26710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:45.101912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:33871 (local address 127.20.158.190:38105)
0811 08:13:45.101982 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:45.101984 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:45.102162 (+ 178us) server_negotiation.cc:407] Connection header received
0811 08:13:45.103179 (+ 1017us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:45.103180 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:45.103202 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:45.103261 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:45.103943 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:45.104477 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:45.105513 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:45.105748 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:45.105835 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:45.107952 (+ 2117us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:45.107954 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:45.107955 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:45.107962 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:45.109283 (+ 1321us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:45.109742 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:45.109743 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:45.109744 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:45.109802 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:45.110008 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:45.110008 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:45.110008 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:45.110123 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:45.110171 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:45.110585 (+ 414us) server_negotiation.cc:299] Negotiation successful
0811 08:13:45.110695 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 08:13:45.111114 27110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:45.101801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38105 (local address 127.20.158.130:33871)
0811 08:13:45.102029 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:45.102078 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:45.103058 (+ 980us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:45.103333 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:45.103337 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:45.103597 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:45.103832 (+ 235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:45.103837 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:45.104583 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:45.104584 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:45.105416 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:45.105419 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:45.105845 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:45.105846 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:45.105976 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:45.106443 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:45.106452 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:45.107857 (+ 1405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:45.109358 (+ 1501us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:45.109364 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:45.109366 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:45.109646 (+ 280us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:45.109865 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:45.109866 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:45.109866 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:45.109965 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:45.110188 (+ 223us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:45.110194 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:45.110375 (+ 181us) client_negotiation.cc:769] Sending connection context
0811 08:13:45.110538 (+ 163us) client_negotiation.cc:240] Negotiation successful
0811 08:13:45.110730 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":68,"threads_started":1}
I20260811 08:13:45.111552 27107 heartbeater.cc:347] Connected to a master server at 127.20.158.190:38105
I20260811 08:13:45.111658 27107 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:45.111861 27107 heartbeater.cc:511] Master 127.20.158.190:38105 requested a full tablet report, sending...
I20260811 08:13:45.112229 26631 ts_manager.cc:194] Registered new tserver with Master: 26450630851642e0b922aac7c0fc24a4 (127.20.158.130:40491)
I20260811 08:13:45.112607 26631 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.130@KRBTEST.COM'} at 127.20.158.130:33871
WARNING: no policy specified for kudu/127.20.158.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
I20260811 08:13:45.137037 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:0
--local_ip_for_outbound_sockets=127.20.158.131
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:38105
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:42503
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:45.219421 27115 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:45.219663 27115 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:45.219700 27115 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:45.220815 27115 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:45.220877 27115 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:45.220920 27115 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:13:45.222522 27115 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:42503
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:38105
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27115
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:45.222785 27115 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:45.223018 27115 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:45.228223 27121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:45.228307 27120 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:45.228392 27126 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:45.228293 27115 server_base.cc:1034] running on GCE node
I20260811 08:13:45.228631 27115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:45.228902 27115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:45.230060 27115 hybrid_clock.cc:648] HybridClock initialized: now 1786436025230053 us; error 44 us; skew 500 ppm
Aug 11 08:13:45 dist-test-slave-gkw7 krb5kdc[26563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436025, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:45.232609 27115 init.cc:377] Logged in from keytab as kudu/127.20.158.131@KRBTEST.COM (short username kudu)
I20260811 08:13:45.233078 27115 webserver.cc:460] Webserver started at http://127.20.158.131:42679/ using document root <none> and password file <none>
I20260811 08:13:45.233317 27115 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:45.233382 27115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:45.233572 27115 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:45.234601 27115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-2/data/instance:
uuid: "86907dc6233e47c78ab4bbf2bcc66570"
format_stamp: "Formatted at 2026-08-11 08:13:45 on dist-test-slave-gkw7"
server_key: "6b62f036c700f42363a7b0758b90a98b"
server_key_iv: "8af4ae9f94bcb86d1bf8a0a713e901bd"
server_key_version: "encryptionkey@0"
I20260811 08:13:45.234972 27115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance:
uuid: "86907dc6233e47c78ab4bbf2bcc66570"
format_stamp: "Formatted at 2026-08-11 08:13:45 on dist-test-slave-gkw7"
server_key: "6b62f036c700f42363a7b0758b90a98b"
server_key_iv: "8af4ae9f94bcb86d1bf8a0a713e901bd"
server_key_version: "encryptionkey@0"
I20260811 08:13:45.236338 27115 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 08:13:45.237074 27138 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:45.237252 27115 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:13:45.237350 27115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "86907dc6233e47c78ab4bbf2bcc66570"
format_stamp: "Formatted at 2026-08-11 08:13:45 on dist-test-slave-gkw7"
server_key: "6b62f036c700f42363a7b0758b90a98b"
server_key_iv: "8af4ae9f94bcb86d1bf8a0a713e901bd"
server_key_version: "encryptionkey@0"
I20260811 08:13:45.237425 27115 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:45.250166 27115 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:45.251987 27115 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:45.252146 27115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:45.252386 27115 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:45.252707 27115 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:45.252759 27115 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:45.252799 27115 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:45.252823 27115 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:45.259081 27115 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:44683
I20260811 08:13:45.259130 27315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:44683 every 8 connection(s)
I20260811 08:13:45.259449 27115 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
I20260811 08:13:45.262109 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 27115
I20260811 08:13:45.262245 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance
I20260811 08:13:45.262446 21114 external_mini_cluster.cc:1428] Setting key 4148da1ced2ade09498d9a5fa1ba83a1
Aug 11 08:13:45 dist-test-slave-gkw7 krb5kdc[26563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436025, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:45.271221 26710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:45.260189 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:36583 (local address 127.20.158.190:38105)
0811 08:13:45.260268 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:45.260270 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:45.260471 (+ 201us) server_negotiation.cc:407] Connection header received
0811 08:13:45.261491 (+ 1020us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:45.261491 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:45.261501 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:45.261629 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:45.262396 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:45.263015 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:45.264660 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:45.265039 (+ 379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:45.265130 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:45.268238 (+ 3108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:45.268240 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:45.268240 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:45.268260 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:45.269899 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:45.270347 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:45.270349 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:45.270349 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:45.270412 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:45.270605 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:45.270606 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:45.270606 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:45.270713 (+ 107us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:45.270766 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:45.271081 (+ 315us) server_negotiation.cc:299] Negotiation successful
0811 08:13:45.271150 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 08:13:45.271471 27321 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:45.260148 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38105 (local address 127.20.158.131:36583)
0811 08:13:45.260330 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:45.260377 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:45.261396 (+ 1019us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:45.261726 (+ 330us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:45.261730 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:45.262038 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:45.262295 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:45.262302 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:45.263261 (+ 959us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:45.263263 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:45.264503 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:45.264506 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:45.265162 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:45.265163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:45.265344 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:45.266423 (+ 1079us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:45.266432 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:45.268134 (+ 1702us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:45.270009 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:45.270016 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:45.270018 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:45.270268 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:45.270460 (+ 192us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:45.270460 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:45.270460 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:45.270554 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:45.270776 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:45.270782 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:45.270959 (+ 177us) client_negotiation.cc:769] Sending connection context
0811 08:13:45.271057 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 08:13:45.271193 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":99,"threads_started":1}
I20260811 08:13:45.271987 27318 heartbeater.cc:347] Connected to a master server at 127.20.158.190:38105
I20260811 08:13:45.272133 27318 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:45.272349 27318 heartbeater.cc:511] Master 127.20.158.190:38105 requested a full tablet report, sending...
I20260811 08:13:45.272883 26631 ts_manager.cc:194] Registered new tserver with Master: 86907dc6233e47c78ab4bbf2bcc66570 (127.20.158.131:44683)
I20260811 08:13:45.273329 26631 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.131@KRBTEST.COM'} at 127.20.158.131:36583
I20260811 08:13:45.274374 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 11 08:13:45 dist-test-slave-gkw7 krb5kdc[26563](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436025, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 08:13:45 dist-test-slave-gkw7 krb5kdc[26563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436025, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.129@KRBTEST.COM
I20260811 08:13:45.300685 27327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:45.292772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57746 (local address 127.20.158.129:37147)
0811 08:13:45.292930 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:45.292935 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:45.292944 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:13:45.292969 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:45.292971 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:45.292985 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:45.293070 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:45.293716 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:45.294461 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:45.295215 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:45.295552 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:45.295649 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:45.297991 (+ 2342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:45.298000 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:45.298000 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:45.298007 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:45.299477 (+ 1470us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:45.299833 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:45.299838 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:45.299838 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:45.299914 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:45.300112 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:45.300113 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:45.300113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:45.300262 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:45.300434 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:45.300478 (+ 44us) server_negotiation.cc:299] Negotiation successful
0811 08:13:45.300561 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":69,"threads_started":1}
Aug 11 08:13:45 dist-test-slave-gkw7 krb5kdc[26563](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436025, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:45.308897 26710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:45.302044 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42006 (local address 127.20.158.190:38105)
0811 08:13:45.302088 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:45.302090 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:45.302115 (+ 25us) server_negotiation.cc:407] Connection header received
0811 08:13:45.302168 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:45.302168 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:45.302178 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:45.302225 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:45.302678 (+ 453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:45.303149 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:45.303852 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:45.304035 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:45.304089 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:45.306422 (+ 2333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:45.306424 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:45.306424 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:45.306431 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:45.307819 (+ 1388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:45.308152 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:45.308153 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:45.308153 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:45.308210 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:45.308389 (+ 179us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:45.308390 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:45.308390 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:45.308579 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:45.308675 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:45.308772 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 08:13:45.308833 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 08:13:45.309171 26631 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42006
I20260811 08:13:45.309506 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 26720
I20260811 08:13:45.321856 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 26918
I20260811 08:13:45.335490 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 27115
I20260811 08:13:45.366643 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 26587
2026-08-11T08:13:45Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (2123 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:13:45 dist-test-slave-gkw7 krb5kdc[27337](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:13:45 dist-test-slave-gkw7 krb5kdc[27337](info): set up 2 sockets
Aug 11 08:13:45 dist-test-slave-gkw7 krb5kdc[27337](info): commencing operation
krb5kdc: starting...
W20260811 08:13:46.611099 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.219s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:13:46 dist-test-slave-gkw7 krb5kdc[27337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:13:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:13:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:13:46.734555 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:46249
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:37489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:46249
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:46.817922 27354 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:46.818156 27354 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:46.818195 27354 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:46.819317 27354 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:46.819353 27354 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:46.819367 27354 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:46.819380 27354 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:46.819393 27354 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:13:46.820833 27354 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:37489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:46249
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:46249
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27354
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:46.821027 27354 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:46.821192 27354 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:46.826201 27360 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:46.826131 27365 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:46.826211 27354 server_base.cc:1034] running on GCE node
W20260811 08:13:46.826175 27361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:46.826612 27354 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:46.826978 27354 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:46.828153 27354 hybrid_clock.cc:648] HybridClock initialized: now 1786436026828132 us; error 44 us; skew 500 ppm
Aug 11 08:13:46 dist-test-slave-gkw7 krb5kdc[27337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436026, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:46.837246 27354 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:13:46.837664 27354 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:46.837723 27354 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:46.837822 27354 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:46.838877 27354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "a1e89a620090497f9071c6ba36030202"
format_stamp: "Formatted at 2026-08-11 08:13:46 on dist-test-slave-gkw7"
server_key: "773cae61f3f9a85616b77fb0ad52671b"
server_key_iv: "026c22c591f9a70b0f70d3bd543fa7f0"
server_key_version: "encryptionkey@0"
I20260811 08:13:46.839185 27354 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "a1e89a620090497f9071c6ba36030202"
format_stamp: "Formatted at 2026-08-11 08:13:46 on dist-test-slave-gkw7"
server_key: "773cae61f3f9a85616b77fb0ad52671b"
server_key_iv: "026c22c591f9a70b0f70d3bd543fa7f0"
server_key_version: "encryptionkey@0"
I20260811 08:13:46.840512 27354 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:13:46.841243 27373 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:46.841473 27354 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:13:46.841595 27354 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "a1e89a620090497f9071c6ba36030202"
format_stamp: "Formatted at 2026-08-11 08:13:46 on dist-test-slave-gkw7"
server_key: "773cae61f3f9a85616b77fb0ad52671b"
server_key_iv: "026c22c591f9a70b0f70d3bd543fa7f0"
server_key_version: "encryptionkey@0"
I20260811 08:13:46.841663 27354 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:46.850238 27354 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:46.852218 27354 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:46.852352 27354 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:46.856510 27354 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:46249
I20260811 08:13:46.856643 27449 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:46249 every 8 connection(s)
I20260811 08:13:46.856863 27354 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:13:46.858011 27450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:46.859792 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 27354
I20260811 08:13:46.859923 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:13:46.860116 21114 external_mini_cluster.cc:1428] Setting key 5d16844bd9d3827c3c9d559a87784d31
I20260811 08:13:46.860783 27450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1e89a620090497f9071c6ba36030202: Bootstrap starting.
I20260811 08:13:46.861413 27450 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a1e89a620090497f9071c6ba36030202: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:46.861830 27450 log.cc:824] T 00000000000000000000000000000000 P a1e89a620090497f9071c6ba36030202: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:46.862596 27450 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a1e89a620090497f9071c6ba36030202: No bootstrap required, opened a new log
I20260811 08:13:46.864696 27450 raft_consensus.cc:348] T 00000000000000000000000000000000 P a1e89a620090497f9071c6ba36030202 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1e89a620090497f9071c6ba36030202" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 46249 } }
I20260811 08:13:46.864867 27450 raft_consensus.cc:374] T 00000000000000000000000000000000 P a1e89a620090497f9071c6ba36030202 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:46.864905 27450 raft_consensus.cc:729] T 00000000000000000000000000000000 P a1e89a620090497f9071c6ba36030202 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1e89a620090497f9071c6ba36030202, State: Initialized, Role: FOLLOWER
I20260811 08:13:46.865041 27450 consensus_queue.cc:260] T 00000000000000000000000000000000 P a1e89a620090497f9071c6ba36030202 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1e89a620090497f9071c6ba36030202" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 46249 } }
I20260811 08:13:46.865142 27450 raft_consensus.cc:388] T 00000000000000000000000000000000 P a1e89a620090497f9071c6ba36030202 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:13:46.865190 27450 raft_consensus.cc:482] T 00000000000000000000000000000000 P a1e89a620090497f9071c6ba36030202 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:13:46.865239 27450 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a1e89a620090497f9071c6ba36030202 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:46.866026 27450 raft_consensus.cc:504] T 00000000000000000000000000000000 P a1e89a620090497f9071c6ba36030202 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1e89a620090497f9071c6ba36030202" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 46249 } }
I20260811 08:13:46.866158 27450 leader_election.cc:302] T 00000000000000000000000000000000 P a1e89a620090497f9071c6ba36030202 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a1e89a620090497f9071c6ba36030202; no voters:
I20260811 08:13:46.866340 27450 leader_election.cc:288] T 00000000000000000000000000000000 P a1e89a620090497f9071c6ba36030202 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:13:46.866398 27456 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a1e89a620090497f9071c6ba36030202 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:46.866554 27456 raft_consensus.cc:686] T 00000000000000000000000000000000 P a1e89a620090497f9071c6ba36030202 [term 1 LEADER]: Becoming Leader. State: Replica: a1e89a620090497f9071c6ba36030202, State: Running, Role: LEADER
I20260811 08:13:46.866621 27450 sys_catalog.cc:564] T 00000000000000000000000000000000 P a1e89a620090497f9071c6ba36030202 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:46.866647 27456 consensus_queue.cc:237] T 00000000000000000000000000000000 P a1e89a620090497f9071c6ba36030202 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1e89a620090497f9071c6ba36030202" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 46249 } }
I20260811 08:13:46.866971 27456 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1e89a620090497f9071c6ba36030202 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a1e89a620090497f9071c6ba36030202. Latest consensus state: current_term: 1 leader_uuid: "a1e89a620090497f9071c6ba36030202" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1e89a620090497f9071c6ba36030202" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 46249 } } }
I20260811 08:13:46.866981 27459 sys_catalog.cc:455] T 00000000000000000000000000000000 P a1e89a620090497f9071c6ba36030202 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a1e89a620090497f9071c6ba36030202" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a1e89a620090497f9071c6ba36030202" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 46249 } } }
I20260811 08:13:46.867054 27456 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1e89a620090497f9071c6ba36030202 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:46.867105 27459 sys_catalog.cc:458] T 00000000000000000000000000000000 P a1e89a620090497f9071c6ba36030202 [sys.catalog]: This master's current role is: LEADER
Aug 11 08:13:46 dist-test-slave-gkw7 krb5kdc[27337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436026, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:46.867362 27471 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:13:46.867858 27471 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:13:46.870795 27471 catalog_manager.cc:1347] Generated new cluster ID: bba2f8d8acec496294b9ae4cd4f52e35
I20260811 08:13:46.870847 27471 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:13:46.871541 27453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:46.860636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38706 (local address 127.20.158.190:46249)
0811 08:13:46.860811 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:46.860819 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:46.860862 (+ 43us) server_negotiation.cc:407] Connection header received
0811 08:13:46.861298 (+ 436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:46.861305 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:46.861350 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:46.861467 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:46.862337 (+ 870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:46.863262 (+ 925us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:46.864382 (+ 1120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:46.864775 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:46.864850 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:46.867939 (+ 3089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:46.867944 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:46.867944 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:46.867957 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:46.869874 (+ 1917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:46.870255 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:46.870258 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:46.870259 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:46.870344 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:46.870576 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:46.870577 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:46.870577 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:46.870909 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:46.871055 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:46.871178 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 08:13:46.871327 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":87,"threads_started":1}
I20260811 08:13:46.882229 27471 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:13:46.883008 27471 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:13:46.900982 27471 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a1e89a620090497f9071c6ba36030202: Generated new TSK 0
I20260811 08:13:46.901225 27471 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.158.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
I20260811 08:13:46.930239 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:0
--local_ip_for_outbound_sockets=127.20.158.129
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:46249
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:37489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:47.015132 27488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:47.015413 27488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:47.015455 27488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:47.016631 27488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:47.016701 27488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:47.016744 27488 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:13:47.018326 27488 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:37489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:46249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27488
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:47.018615 27488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:47.018849 27488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:47.024190 27499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:47.024185 27502 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:47.024185 27506 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:47.024698 27488 server_base.cc:1034] running on GCE node
I20260811 08:13:47.024937 27488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:47.025154 27488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:47.026319 27488 hybrid_clock.cc:648] HybridClock initialized: now 1786436027026305 us; error 32 us; skew 500 ppm
Aug 11 08:13:47 dist-test-slave-gkw7 krb5kdc[27337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436027, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:47.029096 27488 init.cc:377] Logged in from keytab as kudu/127.20.158.129@KRBTEST.COM (short username kudu)
I20260811 08:13:47.029477 27488 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:47.029572 27488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:47.029740 27488 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:47.030840 27488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-0/data/instance:
uuid: "54d00e95f74d408dbe68f316a707cbf2"
format_stamp: "Formatted at 2026-08-11 08:13:47 on dist-test-slave-gkw7"
server_key: "db8e27c36f933e37d9973007150e687c"
server_key_iv: "175fc0ef3e8c068833ba0a90bc0746fe"
server_key_version: "encryptionkey@0"
I20260811 08:13:47.031230 27488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance:
uuid: "54d00e95f74d408dbe68f316a707cbf2"
format_stamp: "Formatted at 2026-08-11 08:13:47 on dist-test-slave-gkw7"
server_key: "db8e27c36f933e37d9973007150e687c"
server_key_iv: "175fc0ef3e8c068833ba0a90bc0746fe"
server_key_version: "encryptionkey@0"
I20260811 08:13:47.032630 27488 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:13:47.033614 27514 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:47.033928 27488 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:13:47.034040 27488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "54d00e95f74d408dbe68f316a707cbf2"
format_stamp: "Formatted at 2026-08-11 08:13:47 on dist-test-slave-gkw7"
server_key: "db8e27c36f933e37d9973007150e687c"
server_key_iv: "175fc0ef3e8c068833ba0a90bc0746fe"
server_key_version: "encryptionkey@0"
I20260811 08:13:47.034126 27488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:47.055734 27488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:47.058305 27488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:47.058477 27488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:47.058743 27488 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:47.059093 27488 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:47.059147 27488 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:47.059186 27488 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:47.059230 27488 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:47.065376 27488 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:38231
I20260811 08:13:47.065420 27673 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:38231 every 8 connection(s)
I20260811 08:13:47.065750 27488 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:13:47.066442 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 27488
I20260811 08:13:47.066605 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance
I20260811 08:13:47.066818 21114 external_mini_cluster.cc:1428] Setting key f1a40de945b9141df3bd1a2d3f244256
Aug 11 08:13:47 dist-test-slave-gkw7 krb5kdc[27337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436027, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.158.130@KRBTEST.COM; defaulting to no policy
I20260811 08:13:47.077984 27453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:47.066662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:42733 (local address 127.20.158.190:46249)
0811 08:13:47.066728 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:47.066730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:47.067014 (+ 284us) server_negotiation.cc:407] Connection header received
0811 08:13:47.067620 (+ 606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:47.067622 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:47.067634 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:47.067719 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:47.068809 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.069641 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.071255 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.071467 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.071536 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:47.074693 (+ 3157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:47.074695 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:47.074695 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:47.074710 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:47.076340 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:47.076853 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:47.076854 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:47.076854 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:47.076910 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:47.077239 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:47.077239 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:47.077240 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:47.077352 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:47.077404 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:47.077776 (+ 372us) server_negotiation.cc:299] Negotiation successful
0811 08:13:47.077882 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 08:13:47.078258 27678 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:47.066669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:46249 (local address 127.20.158.129:42733)
0811 08:13:47.066848 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:47.066891 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:47.067491 (+ 600us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:47.067842 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:47.067846 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:47.068130 (+ 284us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:47.068710 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:47.068716 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.069755 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.069757 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:47.071146 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:47.071150 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.071570 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.071571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:47.071745 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:47.072333 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:47.072346 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:47.074559 (+ 2213us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:47.076433 (+ 1874us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:47.076442 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:47.076445 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:47.076760 (+ 315us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:47.076975 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:47.076976 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:47.076977 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:47.077139 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:47.077417 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:47.077424 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:47.077638 (+ 214us) client_negotiation.cc:769] Sending connection context
0811 08:13:47.077762 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 08:13:47.077959 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":102,"threads_started":1}
I20260811 08:13:47.078825 27675 heartbeater.cc:347] Connected to a master server at 127.20.158.190:46249
I20260811 08:13:47.078958 27675 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:47.079130 27675 heartbeater.cc:511] Master 127.20.158.190:46249 requested a full tablet report, sending...
I20260811 08:13:47.079658 27399 ts_manager.cc:194] Registered new tserver with Master: 54d00e95f74d408dbe68f316a707cbf2 (127.20.158.129:38231)
I20260811 08:13:47.080377 27399 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.129@KRBTEST.COM'} at 127.20.158.129:42733
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
I20260811 08:13:47.096671 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:0
--local_ip_for_outbound_sockets=127.20.158.130
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:46249
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:37489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:47.184109 27682 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:47.184317 27682 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:47.184340 27682 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:47.185487 27682 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:47.185592 27682 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:47.185645 27682 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:13:47.187203 27682 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:37489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:46249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27682
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:47.187422 27682 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:47.187649 27682 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:47.192852 27688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:47.192916 27682 server_base.cc:1034] running on GCE node
W20260811 08:13:47.192782 27689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:47.193042 27692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:47.193281 27682 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:47.193579 27682 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:47.194730 27682 hybrid_clock.cc:648] HybridClock initialized: now 1786436027194719 us; error 30 us; skew 500 ppm
Aug 11 08:13:47 dist-test-slave-gkw7 krb5kdc[27337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436027, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:47.197358 27682 init.cc:377] Logged in from keytab as kudu/127.20.158.130@KRBTEST.COM (short username kudu)
I20260811 08:13:47.197791 27682 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:47.197844 27682 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:47.197937 27682 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:47.198940 27682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-1/data/instance:
uuid: "8479da920a214376bf44c538f55649d0"
format_stamp: "Formatted at 2026-08-11 08:13:47 on dist-test-slave-gkw7"
server_key: "33ad26b702e09bb33c40b18b52e170d6"
server_key_iv: "b176750bc2fcf098c051e70a37332884"
server_key_version: "encryptionkey@0"
I20260811 08:13:47.199275 27682 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance:
uuid: "8479da920a214376bf44c538f55649d0"
format_stamp: "Formatted at 2026-08-11 08:13:47 on dist-test-slave-gkw7"
server_key: "33ad26b702e09bb33c40b18b52e170d6"
server_key_iv: "b176750bc2fcf098c051e70a37332884"
server_key_version: "encryptionkey@0"
I20260811 08:13:47.200668 27682 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:13:47.201427 27701 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:47.201665 27682 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:13:47.201767 27682 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "8479da920a214376bf44c538f55649d0"
format_stamp: "Formatted at 2026-08-11 08:13:47 on dist-test-slave-gkw7"
server_key: "33ad26b702e09bb33c40b18b52e170d6"
server_key_iv: "b176750bc2fcf098c051e70a37332884"
server_key_version: "encryptionkey@0"
I20260811 08:13:47.201853 27682 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:47.225962 27682 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:47.228411 27682 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:47.228567 27682 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:47.228849 27682 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:47.229192 27682 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:47.229244 27682 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:47.229295 27682 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:47.229321 27682 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:47.235644 27682 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:37351
I20260811 08:13:47.235687 27876 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:37351 every 8 connection(s)
I20260811 08:13:47.235975 27682 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
Aug 11 08:13:47 dist-test-slave-gkw7 krb5kdc[27337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436027, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:47.242981 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 27682
I20260811 08:13:47.243103 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance
I20260811 08:13:47.243351 21114 external_mini_cluster.cc:1428] Setting key 19870c9d28cab199166a9ba178cb5afc
I20260811 08:13:47.246311 27453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:47.236716 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:41783 (local address 127.20.158.190:46249)
0811 08:13:47.236769 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:47.236782 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:47.236988 (+ 206us) server_negotiation.cc:407] Connection header received
0811 08:13:47.237596 (+ 608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:47.237597 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:47.237608 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:47.237669 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:47.238687 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.239191 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.240203 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.240386 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.240437 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:47.242673 (+ 2236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:47.242675 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:47.242675 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:47.242682 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:47.244613 (+ 1931us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:47.245140 (+ 527us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:47.245142 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:47.245143 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:47.245211 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:47.245502 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:47.245503 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:47.245503 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:47.245677 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:47.245760 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:47.246107 (+ 347us) server_negotiation.cc:299] Negotiation successful
0811 08:13:47.246207 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:13:47.246537 27881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:47.236693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:46249 (local address 127.20.158.130:41783)
0811 08:13:47.236867 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:47.236911 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:47.237468 (+ 557us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:47.237735 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:47.237739 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:47.238012 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:47.238607 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:47.238613 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.239290 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.239291 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:47.240122 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:47.240124 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.240456 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.240457 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:47.240558 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:47.241024 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:47.241033 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:47.242550 (+ 1517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:47.244707 (+ 2157us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:47.244715 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:47.244718 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:47.245035 (+ 317us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:47.245285 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:47.245286 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:47.245286 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:47.245419 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:47.245775 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:47.245783 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:47.245937 (+ 154us) client_negotiation.cc:769] Sending connection context
0811 08:13:47.246061 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 08:13:47.246259 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":93,"threads_started":1}
I20260811 08:13:47.247062 27877 heartbeater.cc:347] Connected to a master server at 127.20.158.190:46249
I20260811 08:13:47.247185 27877 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:47.247354 27877 heartbeater.cc:511] Master 127.20.158.190:46249 requested a full tablet report, sending...
I20260811 08:13:47.247797 27399 ts_manager.cc:194] Registered new tserver with Master: 8479da920a214376bf44c538f55649d0 (127.20.158.130:37351)
I20260811 08:13:47.248183 27399 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.130@KRBTEST.COM'} at 127.20.158.130:41783
WARNING: no policy specified for kudu/127.20.158.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
I20260811 08:13:47.272859 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:0
--local_ip_for_outbound_sockets=127.20.158.131
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:46249
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:37489
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:47.358583 27885 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:47.358798 27885 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:47.358824 27885 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:47.359949 27885 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:47.359990 27885 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:47.360015 27885 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:13:47.361511 27885 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:37489
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:46249
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27885
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:47.361801 27885 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:47.362037 27885 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:47.367005 27891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:47.367070 27892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:47.367034 27895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:47.367193 27885 server_base.cc:1034] running on GCE node
I20260811 08:13:47.367478 27885 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:47.367740 27885 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:47.368880 27885 hybrid_clock.cc:648] HybridClock initialized: now 1786436027368866 us; error 32 us; skew 500 ppm
Aug 11 08:13:47 dist-test-slave-gkw7 krb5kdc[27337](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436027, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:47.371618 27885 init.cc:377] Logged in from keytab as kudu/127.20.158.131@KRBTEST.COM (short username kudu)
I20260811 08:13:47.371961 27885 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:47.372008 27885 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:47.372172 27885 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:47.373231 27885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-2/data/instance:
uuid: "564fa970f3594119b14e8b9258d70b43"
format_stamp: "Formatted at 2026-08-11 08:13:47 on dist-test-slave-gkw7"
server_key: "3ac0f07332effb7b41fd3fc850950b49"
server_key_iv: "06b3254c8bcab8a7ed8bfb852dd58ca6"
server_key_version: "encryptionkey@0"
I20260811 08:13:47.373643 27885 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance:
uuid: "564fa970f3594119b14e8b9258d70b43"
format_stamp: "Formatted at 2026-08-11 08:13:47 on dist-test-slave-gkw7"
server_key: "3ac0f07332effb7b41fd3fc850950b49"
server_key_iv: "06b3254c8bcab8a7ed8bfb852dd58ca6"
server_key_version: "encryptionkey@0"
I20260811 08:13:47.374977 27885 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:47.375708 27904 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:47.375893 27885 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:47.375983 27885 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "564fa970f3594119b14e8b9258d70b43"
format_stamp: "Formatted at 2026-08-11 08:13:47 on dist-test-slave-gkw7"
server_key: "3ac0f07332effb7b41fd3fc850950b49"
server_key_iv: "06b3254c8bcab8a7ed8bfb852dd58ca6"
server_key_version: "encryptionkey@0"
I20260811 08:13:47.376056 27885 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:47.394484 27885 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:47.397009 27885 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:47.397167 27885 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:47.397421 27885 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:47.397773 27885 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:47.397812 27885 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:47.397835 27885 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:47.397847 27885 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:47.404289 27885 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:44043
I20260811 08:13:47.404356 28082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:44043 every 8 connection(s)
I20260811 08:13:47.404664 27885 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
I20260811 08:13:47.409031 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 27885
I20260811 08:13:47.409135 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance
I20260811 08:13:47.409314 21114 external_mini_cluster.cc:1428] Setting key 10eada5918c5d1516bd715e27abf2163
Aug 11 08:13:47 dist-test-slave-gkw7 krb5kdc[27337](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436027, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:47.414067 27453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:47.405431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:41835 (local address 127.20.158.190:46249)
0811 08:13:47.405510 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:47.405513 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:47.405701 (+ 188us) server_negotiation.cc:407] Connection header received
0811 08:13:47.406206 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:47.406207 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:47.406219 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:47.406302 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:47.407219 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.407724 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.408729 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.408947 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.409017 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:47.411466 (+ 2449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:47.411467 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:47.411467 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:47.411475 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:47.412887 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:47.413225 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:47.413226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:47.413226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:47.413292 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:47.413496 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:47.413497 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:47.413497 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:47.413649 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:47.413702 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:47.413937 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 08:13:47.414002 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 08:13:47.414252 28087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:47.405380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:46249 (local address 127.20.158.131:41835)
0811 08:13:47.405559 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:47.405601 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:47.406090 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:47.406359 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:47.406363 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:47.406623 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:47.407140 (+ 517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:47.407146 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.407804 (+ 658us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.407805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:47.408633 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:47.408635 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.409042 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.409043 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:47.409208 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:47.409864 (+ 656us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:47.409874 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:47.411383 (+ 1509us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:47.412955 (+ 1572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:47.412960 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:47.412962 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:47.413165 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:47.413348 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:47.413348 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:47.413349 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:47.413445 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:47.413703 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:47.413708 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:47.413825 (+ 117us) client_negotiation.cc:769] Sending connection context
0811 08:13:47.413913 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 08:13:47.414034 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":83,"threads_started":1}
I20260811 08:13:47.414676 28083 heartbeater.cc:347] Connected to a master server at 127.20.158.190:46249
I20260811 08:13:47.414800 28083 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:47.414956 28083 heartbeater.cc:511] Master 127.20.158.190:46249 requested a full tablet report, sending...
I20260811 08:13:47.415356 27399 ts_manager.cc:194] Registered new tserver with Master: 564fa970f3594119b14e8b9258d70b43 (127.20.158.131:44043)
I20260811 08:13:47.415695 27399 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.131@KRBTEST.COM'} at 127.20.158.131:41835
I20260811 08:13:47.421110 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:13:47.428154 27453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:47.422494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38720 (local address 127.20.158.190:46249)
0811 08:13:47.422552 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:47.422554 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:47.422649 (+ 95us) server_negotiation.cc:407] Connection header received
0811 08:13:47.422692 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:47.422693 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:47.422701 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:47.422754 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:47.423348 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.423830 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.424518 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.424692 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.424749 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:47.426014 (+ 1265us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:47.426015 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:47.426016 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:47.426022 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:47.427196 (+ 1174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:47.427508 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:47.427509 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:47.427509 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:47.427558 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:47.427735 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:47.427735 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:47.427736 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:47.427872 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:47.427947 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:47.428032 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 08:13:47.428092 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 08:13:47.429705 27399 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38720:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:13:47.431313 27399 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:13:47.438316 28104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:47.434117 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:37351 (local address 127.0.0.1:37790)
0811 08:13:47.434556 (+ 439us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:47.434567 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:47.434624 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:47.434910 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:47.434910 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:47.434912 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:47.434973 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:47.434975 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.436129 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.436130 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:47.436994 (+ 864us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:47.436997 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.437994 (+ 997us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.437995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:47.438082 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:47.438100 (+ 18us) client_negotiation.cc:769] Sending connection context
0811 08:13:47.438174 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 08:13:47.438241 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":76,"threads_started":1}
I20260811 08:13:47.438336 28105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:47.434255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37790 (local address 127.20.158.130:37351)
0811 08:13:47.434435 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:47.434439 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:47.434683 (+ 244us) server_negotiation.cc:407] Connection header received
0811 08:13:47.434735 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:47.434737 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:47.434752 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:47.434826 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:47.435041 (+ 215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.436030 (+ 989us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.437080 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.437888 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.437965 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:47.438022 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:47.438198 (+ 176us) server_negotiation.cc:299] Negotiation successful
0811 08:13:47.438245 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":118,"threads_started":1}
I20260811 08:13:47.438406 28100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:47.433827 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49342 (local address 127.20.158.131:44043)
0811 08:13:47.434120 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:47.434126 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:47.434139 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:13:47.434181 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:47.434184 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:47.434201 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:47.434283 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:47.434500 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.435696 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.437357 (+ 1661us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.438033 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.438105 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:47.438159 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:47.438271 (+ 112us) server_negotiation.cc:299] Negotiation successful
0811 08:13:47.438311 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":244,"thread_start_us":99,"threads_started":1}
I20260811 08:13:47.438433 28098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:47.433713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:44043 (local address 127.0.0.1:49342)
0811 08:13:47.433854 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:47.433887 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:47.433965 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:47.434310 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:47.434313 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:47.434316 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:47.434386 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:47.434388 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.435789 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.435790 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:47.437283 (+ 1493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:47.437285 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.438111 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.438112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:47.438184 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:47.438188 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:13:47.438254 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 08:13:47.438308 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"mutex_wait_us":29,"thread_start_us":77,"threads_started":1}
I20260811 08:13:47.438977 28102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:47.434076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34498 (local address 127.20.158.129:38231)
0811 08:13:47.434502 (+ 426us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:47.434506 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:47.434606 (+ 100us) server_negotiation.cc:407] Connection header received
0811 08:13:47.434678 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:47.434680 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:47.434695 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:47.434784 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:47.434906 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.435602 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.437187 (+ 1585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.437894 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.437968 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:47.438022 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:47.438833 (+ 811us) server_negotiation.cc:299] Negotiation successful
0811 08:13:47.438877 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":393,"thread_start_us":96,"threads_started":1}
I20260811 08:13:47.438903 28101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:47.433940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:38231 (local address 127.0.0.1:34498)
0811 08:13:47.434546 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:47.434558 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:47.434609 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:47.434792 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:47.434793 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:47.434795 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:47.434849 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:47.434851 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.435704 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.435705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:47.437106 (+ 1401us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:47.437108 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.438662 (+ 1554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.438663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:47.438730 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:47.438734 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:13:47.438802 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 08:13:47.438843 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":300,"mutex_wait_us":46,"thread_start_us":71,"threads_started":1}
I20260811 08:13:47.439802 27574 tablet_service.cc:1467] Processing CreateTablet for tablet d8b7962b5c43493cbcaa48dcc650c162 (DEFAULT_TABLE table=test-table [id=cf997c98608f4ae09f88dee5b6aa8b98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:47.439836 27973 tablet_service.cc:1467] Processing CreateTablet for tablet d8b7962b5c43493cbcaa48dcc650c162 (DEFAULT_TABLE table=test-table [id=cf997c98608f4ae09f88dee5b6aa8b98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:47.439836 27772 tablet_service.cc:1467] Processing CreateTablet for tablet d8b7962b5c43493cbcaa48dcc650c162 (DEFAULT_TABLE table=test-table [id=cf997c98608f4ae09f88dee5b6aa8b98]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:47.440174 27574 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8b7962b5c43493cbcaa48dcc650c162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:47.440183 27973 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8b7962b5c43493cbcaa48dcc650c162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:47.440183 27772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8b7962b5c43493cbcaa48dcc650c162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:47.442874 28109 tablet_bootstrap.cc:492] T d8b7962b5c43493cbcaa48dcc650c162 P 54d00e95f74d408dbe68f316a707cbf2: Bootstrap starting.
I20260811 08:13:47.443527 28110 tablet_bootstrap.cc:492] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43: Bootstrap starting.
I20260811 08:13:47.443641 28109 tablet_bootstrap.cc:654] T d8b7962b5c43493cbcaa48dcc650c162 P 54d00e95f74d408dbe68f316a707cbf2: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:47.443940 28112 tablet_bootstrap.cc:492] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0: Bootstrap starting.
I20260811 08:13:47.444285 28110 tablet_bootstrap.cc:654] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:47.444314 28109 log.cc:824] T d8b7962b5c43493cbcaa48dcc650c162 P 54d00e95f74d408dbe68f316a707cbf2: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:47.444612 28112 tablet_bootstrap.cc:654] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:47.444942 28110 log.cc:824] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:47.445223 28109 tablet_bootstrap.cc:492] T d8b7962b5c43493cbcaa48dcc650c162 P 54d00e95f74d408dbe68f316a707cbf2: No bootstrap required, opened a new log
I20260811 08:13:47.445267 28112 log.cc:824] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:47.445322 28109 ts_tablet_manager.cc:1397] T d8b7962b5c43493cbcaa48dcc650c162 P 54d00e95f74d408dbe68f316a707cbf2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 08:13:47.445762 28110 tablet_bootstrap.cc:492] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43: No bootstrap required, opened a new log
I20260811 08:13:47.445899 28110 ts_tablet_manager.cc:1397] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:13:47.446026 28112 tablet_bootstrap.cc:492] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0: No bootstrap required, opened a new log
I20260811 08:13:47.446095 28112 ts_tablet_manager.cc:1397] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:13:47.447391 28109 raft_consensus.cc:348] T d8b7962b5c43493cbcaa48dcc650c162 P 54d00e95f74d408dbe68f316a707cbf2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "564fa970f3594119b14e8b9258d70b43" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44043 } } peers { permanent_uuid: "54d00e95f74d408dbe68f316a707cbf2" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 38231 } } peers { permanent_uuid: "8479da920a214376bf44c538f55649d0" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37351 } }
I20260811 08:13:47.447580 28109 raft_consensus.cc:374] T d8b7962b5c43493cbcaa48dcc650c162 P 54d00e95f74d408dbe68f316a707cbf2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:47.447625 28109 raft_consensus.cc:729] T d8b7962b5c43493cbcaa48dcc650c162 P 54d00e95f74d408dbe68f316a707cbf2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54d00e95f74d408dbe68f316a707cbf2, State: Initialized, Role: FOLLOWER
I20260811 08:13:47.447535 28112 raft_consensus.cc:348] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "564fa970f3594119b14e8b9258d70b43" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44043 } } peers { permanent_uuid: "54d00e95f74d408dbe68f316a707cbf2" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 38231 } } peers { permanent_uuid: "8479da920a214376bf44c538f55649d0" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37351 } }
I20260811 08:13:47.447698 28112 raft_consensus.cc:374] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:47.447742 28112 raft_consensus.cc:729] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8479da920a214376bf44c538f55649d0, State: Initialized, Role: FOLLOWER
I20260811 08:13:47.447767 28109 consensus_queue.cc:260] T d8b7962b5c43493cbcaa48dcc650c162 P 54d00e95f74d408dbe68f316a707cbf2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "564fa970f3594119b14e8b9258d70b43" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44043 } } peers { permanent_uuid: "54d00e95f74d408dbe68f316a707cbf2" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 38231 } } peers { permanent_uuid: "8479da920a214376bf44c538f55649d0" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37351 } }
I20260811 08:13:47.447861 28112 consensus_queue.cc:260] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "564fa970f3594119b14e8b9258d70b43" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44043 } } peers { permanent_uuid: "54d00e95f74d408dbe68f316a707cbf2" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 38231 } } peers { permanent_uuid: "8479da920a214376bf44c538f55649d0" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37351 } }
I20260811 08:13:47.447901 28110 raft_consensus.cc:348] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "564fa970f3594119b14e8b9258d70b43" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44043 } } peers { permanent_uuid: "54d00e95f74d408dbe68f316a707cbf2" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 38231 } } peers { permanent_uuid: "8479da920a214376bf44c538f55649d0" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37351 } }
I20260811 08:13:47.448064 28109 ts_tablet_manager.cc:1428] T d8b7962b5c43493cbcaa48dcc650c162 P 54d00e95f74d408dbe68f316a707cbf2: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:13:47.448063 28110 raft_consensus.cc:374] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:47.448108 28110 raft_consensus.cc:729] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 564fa970f3594119b14e8b9258d70b43, State: Initialized, Role: FOLLOWER
I20260811 08:13:47.448143 28112 ts_tablet_manager.cc:1428] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:13:47.448190 27675 heartbeater.cc:503] Master 127.20.158.190:46249 was elected leader, sending a full tablet report...
I20260811 08:13:47.448221 28110 consensus_queue.cc:260] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "564fa970f3594119b14e8b9258d70b43" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44043 } } peers { permanent_uuid: "54d00e95f74d408dbe68f316a707cbf2" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 38231 } } peers { permanent_uuid: "8479da920a214376bf44c538f55649d0" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37351 } }
I20260811 08:13:47.448279 27877 heartbeater.cc:503] Master 127.20.158.190:46249 was elected leader, sending a full tablet report...
I20260811 08:13:47.448490 28110 ts_tablet_manager.cc:1428] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 08:13:47.448608 28083 heartbeater.cc:503] Master 127.20.158.190:46249 was elected leader, sending a full tablet report...
W20260811 08:13:47.486516 27879 tablet.cc:2369] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:13:47.566522 27677 tablet.cc:2369] T d8b7962b5c43493cbcaa48dcc650c162 P 54d00e95f74d408dbe68f316a707cbf2: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:13:47.655287 28086 tablet.cc:2369] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:13:47.683538 28123 raft_consensus.cc:482] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:13:47.683682 28123 raft_consensus.cc:504] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "564fa970f3594119b14e8b9258d70b43" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44043 } } peers { permanent_uuid: "54d00e95f74d408dbe68f316a707cbf2" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 38231 } } peers { permanent_uuid: "8479da920a214376bf44c538f55649d0" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37351 } }
I20260811 08:13:47.684005 28123 leader_election.cc:288] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 54d00e95f74d408dbe68f316a707cbf2 (127.20.158.129:38231), 8479da920a214376bf44c538f55649d0 (127.20.158.130:37351)
I20260811 08:13:47.684763 28120 raft_consensus.cc:482] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:13:47.684909 28120 raft_consensus.cc:504] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "564fa970f3594119b14e8b9258d70b43" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44043 } } peers { permanent_uuid: "54d00e95f74d408dbe68f316a707cbf2" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 38231 } } peers { permanent_uuid: "8479da920a214376bf44c538f55649d0" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37351 } }
I20260811 08:13:47.685273 28120 leader_election.cc:288] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 564fa970f3594119b14e8b9258d70b43 (127.20.158.131:44043), 54d00e95f74d408dbe68f316a707cbf2 (127.20.158.129:38231)
I20260811 08:13:47.688088 28105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:47.684483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:52099 (local address 127.20.158.130:37351)
0811 08:13:47.684531 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:47.684533 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:47.684662 (+ 129us) server_negotiation.cc:407] Connection header received
0811 08:13:47.684759 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:47.684760 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:47.684769 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:47.684800 (+ 31us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:47.685013 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.685696 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.687192 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.687707 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.687785 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:47.687793 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:47.687989 (+ 196us) server_negotiation.cc:299] Negotiation successful
0811 08:13:47.688025 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:13:47.688126 28087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:47.684243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:38231 (local address 127.20.158.131:38531)
0811 08:13:47.684307 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:47.684319 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:47.684371 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:47.684562 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:47.684563 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:47.684565 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:47.684674 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:47.684677 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.685663 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.685664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:47.687019 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:47.687022 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.687862 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.687863 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:47.687953 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:47.687956 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:13:47.688005 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 08:13:47.688043 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":53}
I20260811 08:13:47.688313 28126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:47.684365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:37351 (local address 127.20.158.131:52099)
0811 08:13:47.684583 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:47.684594 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:47.684668 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:47.684869 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:47.684870 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:47.684872 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:47.684946 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:47.684948 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.685922 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.685923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:47.687105 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:47.687107 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.687829 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.687830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:47.687910 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:47.687914 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:13:47.688179 (+ 265us) client_negotiation.cc:240] Negotiation successful
0811 08:13:47.688231 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":134,"threads_started":1}
I20260811 08:13:47.688632 27803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8b7962b5c43493cbcaa48dcc650c162" candidate_uuid: "564fa970f3594119b14e8b9258d70b43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8479da920a214376bf44c538f55649d0" is_pre_election: true
I20260811 08:13:47.688762 27803 raft_consensus.cc:2454] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 564fa970f3594119b14e8b9258d70b43 in term 0.
I20260811 08:13:47.688795 28102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:47.684327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:38531 (local address 127.20.158.129:38231)
0811 08:13:47.684397 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:47.684400 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:47.684414 (+ 14us) server_negotiation.cc:407] Connection header received
0811 08:13:47.684448 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:47.684449 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:47.684461 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:47.684555 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:47.684776 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.685570 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.687204 (+ 1634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.687762 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.687825 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:47.687833 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:47.688686 (+ 853us) server_negotiation.cc:299] Negotiation successful
0811 08:13:47.688733 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 08:13:47.688971 27908 leader_election.cc:302] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 564fa970f3594119b14e8b9258d70b43, 8479da920a214376bf44c538f55649d0; no voters:
I20260811 08:13:47.689064 27603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8b7962b5c43493cbcaa48dcc650c162" candidate_uuid: "564fa970f3594119b14e8b9258d70b43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54d00e95f74d408dbe68f316a707cbf2" is_pre_election: true
I20260811 08:13:47.689177 28128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:47.685506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:38231 (local address 127.20.158.130:42895)
0811 08:13:47.685818 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:47.685828 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:47.685867 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:47.686109 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:47.686110 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:47.686112 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:47.686177 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:47.686178 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.686829 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.686830 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:47.688125 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:47.688127 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.688945 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.688946 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:47.689021 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:47.689024 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:13:47.689058 (+ 34us) client_negotiation.cc:240] Negotiation successful
0811 08:13:47.689097 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":296,"mutex_wait_us":41,"thread_start_us":128,"threads_started":1}
I20260811 08:13:47.689199 27603 raft_consensus.cc:2454] T d8b7962b5c43493cbcaa48dcc650c162 P 54d00e95f74d408dbe68f316a707cbf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 564fa970f3594119b14e8b9258d70b43 in term 0.
I20260811 08:13:47.689316 28123 raft_consensus.cc:2781] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:13:47.689375 28123 raft_consensus.cc:482] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:13:47.689397 28123 raft_consensus.cc:3037] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:47.689436 28129 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:47.685743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:42895 (local address 127.20.158.129:38231)
0811 08:13:47.685971 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:47.685973 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:47.685980 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:13:47.686001 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:47.686001 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:47.686011 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:47.686099 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:47.686280 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.686746 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.688268 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.688853 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.689309 (+ 456us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:47.689321 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:47.689340 (+ 19us) server_negotiation.cc:299] Negotiation successful
0811 08:13:47.689374 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":209,"thread_start_us":62,"threads_started":1}
I20260811 08:13:47.689652 27603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8b7962b5c43493cbcaa48dcc650c162" candidate_uuid: "8479da920a214376bf44c538f55649d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54d00e95f74d408dbe68f316a707cbf2" is_pre_election: true
I20260811 08:13:47.689718 27603 raft_consensus.cc:2454] T d8b7962b5c43493cbcaa48dcc650c162 P 54d00e95f74d408dbe68f316a707cbf2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8479da920a214376bf44c538f55649d0 in term 0.
I20260811 08:13:47.689867 28100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:47.685461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:46131 (local address 127.20.158.131:44043)
0811 08:13:47.685521 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:47.685543 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:47.685685 (+ 142us) server_negotiation.cc:407] Connection header received
0811 08:13:47.685707 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:47.685709 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:47.685717 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:47.685762 (+ 45us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:47.685982 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.687696 (+ 1714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.689004 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.689502 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.689595 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:47.689602 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:47.689786 (+ 184us) server_negotiation.cc:299] Negotiation successful
0811 08:13:47.689825 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1080,"server-negotiator.queue_time_us":40}
I20260811 08:13:47.689873 27881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:47.685411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:44043 (local address 127.20.158.130:46131)
0811 08:13:47.685574 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:47.685585 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:47.685632 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:47.685844 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:47.685845 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:47.685847 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:47.685902 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:47.685904 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.687804 (+ 1900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.687806 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:47.688903 (+ 1097us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:47.688906 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.689636 (+ 730us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.689637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:47.689707 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:47.689710 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:13:47.689767 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 08:13:47.689817 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146}
I20260811 08:13:47.690057 27705 leader_election.cc:302] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54d00e95f74d408dbe68f316a707cbf2, 8479da920a214376bf44c538f55649d0; no voters:
I20260811 08:13:47.690131 28003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8b7962b5c43493cbcaa48dcc650c162" candidate_uuid: "8479da920a214376bf44c538f55649d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "564fa970f3594119b14e8b9258d70b43" is_pre_election: true
I20260811 08:13:47.690199 28120 raft_consensus.cc:2781] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:13:47.690261 28120 raft_consensus.cc:482] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:13:47.690281 28120 raft_consensus.cc:3037] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:47.690407 28123 raft_consensus.cc:504] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "564fa970f3594119b14e8b9258d70b43" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44043 } } peers { permanent_uuid: "54d00e95f74d408dbe68f316a707cbf2" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 38231 } } peers { permanent_uuid: "8479da920a214376bf44c538f55649d0" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37351 } }
I20260811 08:13:47.690527 28003 raft_consensus.cc:2379] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8479da920a214376bf44c538f55649d0 in current term 1: Already voted for candidate 564fa970f3594119b14e8b9258d70b43 in this term.
I20260811 08:13:47.690548 28123 leader_election.cc:288] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43 [CANDIDATE]: Term 1 election: Requested vote from peers 54d00e95f74d408dbe68f316a707cbf2 (127.20.158.129:38231), 8479da920a214376bf44c538f55649d0 (127.20.158.130:37351)
I20260811 08:13:47.690806 27803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8b7962b5c43493cbcaa48dcc650c162" candidate_uuid: "564fa970f3594119b14e8b9258d70b43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8479da920a214376bf44c538f55649d0"
I20260811 08:13:47.691087 28120 raft_consensus.cc:504] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "564fa970f3594119b14e8b9258d70b43" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44043 } } peers { permanent_uuid: "54d00e95f74d408dbe68f316a707cbf2" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 38231 } } peers { permanent_uuid: "8479da920a214376bf44c538f55649d0" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37351 } }
I20260811 08:13:47.691174 27803 raft_consensus.cc:2379] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 564fa970f3594119b14e8b9258d70b43 in current term 1: Already voted for candidate 8479da920a214376bf44c538f55649d0 in this term.
I20260811 08:13:47.691228 28120 leader_election.cc:288] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0 [CANDIDATE]: Term 1 election: Requested vote from peers 564fa970f3594119b14e8b9258d70b43 (127.20.158.131:44043), 54d00e95f74d408dbe68f316a707cbf2 (127.20.158.129:38231)
I20260811 08:13:47.691390 27603 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8b7962b5c43493cbcaa48dcc650c162" candidate_uuid: "564fa970f3594119b14e8b9258d70b43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54d00e95f74d408dbe68f316a707cbf2"
I20260811 08:13:47.691407 28003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8b7962b5c43493cbcaa48dcc650c162" candidate_uuid: "8479da920a214376bf44c538f55649d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "564fa970f3594119b14e8b9258d70b43"
I20260811 08:13:47.691403 27602 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8b7962b5c43493cbcaa48dcc650c162" candidate_uuid: "8479da920a214376bf44c538f55649d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54d00e95f74d408dbe68f316a707cbf2"
I20260811 08:13:47.691479 28003 raft_consensus.cc:2379] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 8479da920a214376bf44c538f55649d0 in current term 1: Already voted for candidate 564fa970f3594119b14e8b9258d70b43 in this term.
I20260811 08:13:47.691476 27603 raft_consensus.cc:3037] T d8b7962b5c43493cbcaa48dcc650c162 P 54d00e95f74d408dbe68f316a707cbf2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:47.691732 27705 leader_election.cc:302] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8479da920a214376bf44c538f55649d0; no voters: 54d00e95f74d408dbe68f316a707cbf2, 564fa970f3594119b14e8b9258d70b43
I20260811 08:13:47.691804 28120 raft_consensus.cc:2726] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260811 08:13:47.692189 27603 raft_consensus.cc:2454] T d8b7962b5c43493cbcaa48dcc650c162 P 54d00e95f74d408dbe68f316a707cbf2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 564fa970f3594119b14e8b9258d70b43 in term 1.
I20260811 08:13:47.692340 27908 leader_election.cc:302] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54d00e95f74d408dbe68f316a707cbf2, 564fa970f3594119b14e8b9258d70b43; no voters: 8479da920a214376bf44c538f55649d0
I20260811 08:13:47.692443 28123 raft_consensus.cc:2781] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:47.692577 28123 raft_consensus.cc:686] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43 [term 1 LEADER]: Becoming Leader. State: Replica: 564fa970f3594119b14e8b9258d70b43, State: Running, Role: LEADER
I20260811 08:13:47.692672 28123 consensus_queue.cc:237] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "564fa970f3594119b14e8b9258d70b43" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44043 } } peers { permanent_uuid: "54d00e95f74d408dbe68f316a707cbf2" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 38231 } } peers { permanent_uuid: "8479da920a214376bf44c538f55649d0" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37351 } }
I20260811 08:13:47.693503 27397 catalog_manager.cc:5495] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 564fa970f3594119b14e8b9258d70b43 (127.20.158.131). New cstate: current_term: 1 leader_uuid: "564fa970f3594119b14e8b9258d70b43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "564fa970f3594119b14e8b9258d70b43" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44043 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54d00e95f74d408dbe68f316a707cbf2" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 38231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8479da920a214376bf44c538f55649d0" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37351 } health_report { overall_health: UNKNOWN } } }
I20260811 08:13:47.721309 28100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:47.719009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49352 (local address 127.20.158.131:44043)
0811 08:13:47.719072 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:47.719074 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:47.719083 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:13:47.719141 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:47.719141 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:47.719159 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:47.719221 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:47.719362 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.719832 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.720536 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:47.720714 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:47.720764 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:47.720898 (+ 134us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:47.721059 (+ 161us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:47.721125 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:47.721166 (+ 41us) server_negotiation.cc:299] Negotiation successful
0811 08:13:47.721185 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 08:13:47.723227 27603 raft_consensus.cc:1261] T d8b7962b5c43493cbcaa48dcc650c162 P 54d00e95f74d408dbe68f316a707cbf2 [term 1 FOLLOWER]: Refusing update from remote peer 564fa970f3594119b14e8b9258d70b43: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:47.723239 27803 raft_consensus.cc:1261] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0 [term 1 FOLLOWER]: Refusing update from remote peer 564fa970f3594119b14e8b9258d70b43: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:47.723676 28130 consensus_queue.cc:1035] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8479da920a214376bf44c538f55649d0" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37351 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:13:47.723863 28123 consensus_queue.cc:1035] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54d00e95f74d408dbe68f316a707cbf2" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 38231 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:13:47.726495 28135 mvcc.cc:205] Tried to move back new op lower bound from 7317241969551450112 to 7317241969429733376. Current Snapshot: MvccSnapshot[applied={T|T < 7317241969551450112}]
I20260811 08:13:47.726800 28133 mvcc.cc:205] Tried to move back new op lower bound from 7317241969551450112 to 7317241969429733376. Current Snapshot: MvccSnapshot[applied={T|T < 7317241969551450112 or (T in {7317241969551450112})}]
I20260811 08:13:47.727025 28136 mvcc.cc:205] Tried to move back new op lower bound from 7317241969551450112 to 7317241969429733376. Current Snapshot: MvccSnapshot[applied={T|T < 7317241969551450112}]
I20260811 08:13:47.728794 27395 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38720:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:13:47.728899 27395 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38720:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:13:47.729732 27395 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a1e89a620090497f9071c6ba36030202: Sending DeleteTablet for 3 replicas of tablet d8b7962b5c43493cbcaa48dcc650c162
I20260811 08:13:47.730074 27574 tablet_service.cc:1514] Processing DeleteTablet for tablet d8b7962b5c43493cbcaa48dcc650c162 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:47 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:34498
I20260811 08:13:47.730101 27973 tablet_service.cc:1514] Processing DeleteTablet for tablet d8b7962b5c43493cbcaa48dcc650c162 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:47 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:49342
I20260811 08:13:47.730137 27772 tablet_service.cc:1514] Processing DeleteTablet for tablet d8b7962b5c43493cbcaa48dcc650c162 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:47 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:37790
I20260811 08:13:47.730451 28145 tablet_replica.cc:330] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43: stopping tablet replica
I20260811 08:13:47.730587 28146 tablet_replica.cc:330] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0: stopping tablet replica
I20260811 08:13:47.730615 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 27488
I20260811 08:13:47.730769 28146 raft_consensus.cc:2229] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:13:47.730897 28145 raft_consensus.cc:2229] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:13:47.733518 28146 raft_consensus.cc:2258] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:47.731071 28145 raft_consensus.cc:2258] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:47.738042 28145 ts_tablet_manager.cc:1905] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:13:47.740662 28145 ts_tablet_manager.cc:1918] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:13:47.741122 28146 ts_tablet_manager.cc:1905] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:13:47.743212 28146 ts_tablet_manager.cc:1918] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:13:47.743359 28146 log.cc:1196] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-1/wal/wals/d8b7962b5c43493cbcaa48dcc650c162
I20260811 08:13:47.743650 28146 ts_tablet_manager.cc:1939] T d8b7962b5c43493cbcaa48dcc650c162 P 8479da920a214376bf44c538f55649d0: Deleting consensus metadata
I20260811 08:13:47.744202 27377 catalog_manager.cc:4841] TS 8479da920a214376bf44c538f55649d0 (127.20.158.130:37351): tablet d8b7962b5c43493cbcaa48dcc650c162 (table test-table [id=cf997c98608f4ae09f88dee5b6aa8b98]) successfully deleted
I20260811 08:13:47.744423 28145 log.cc:1196] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786436003833085-21114-0/minicluster-data/ts-2/wal/wals/d8b7962b5c43493cbcaa48dcc650c162
I20260811 08:13:47.744751 28145 ts_tablet_manager.cc:1939] T d8b7962b5c43493cbcaa48dcc650c162 P 564fa970f3594119b14e8b9258d70b43: Deleting consensus metadata
I20260811 08:13:47.745371 27377 catalog_manager.cc:4841] TS 564fa970f3594119b14e8b9258d70b43 (127.20.158.131:44043): tablet d8b7962b5c43493cbcaa48dcc650c162 (table test-table [id=cf997c98608f4ae09f88dee5b6aa8b98]) successfully deleted
W20260811 08:13:47.752257 27377 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.158.129:38231 (error 108)
I20260811 08:13:47.752846 28101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:47.752694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:38231 (local address 127.0.0.1:34512)
0811 08:13:47.752764 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:47.752805 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.129:38231: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 08:13:47.752916 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 27682
W20260811 08:13:47.758780 27377 catalog_manager.cc:4584] TS 54d00e95f74d408dbe68f316a707cbf2 (127.20.158.129:38231): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d8b7962b5c43493cbcaa48dcc650c162: Network error: Client connection negotiation failed: client connection to 127.20.158.129:38231: connect: Connection refused (error 111)
I20260811 08:13:47.764386 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 27885
I20260811 08:13:47.776832 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 27354
2026-08-11T08:13:47Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (2411 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-11T08:13:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:13:47Z Disabled control of system clock
I20260811 08:13:47.813031 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:46735
--webserver_interface=127.20.158.190
--webserver_port=0
--builtin_ntp_servers=127.20.158.148:36355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:46735
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 08:13:47.896396 28159 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:47.896618 28159 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:47.896641 28159 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:47.897965 28159 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:47.898012 28159 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:47.898025 28159 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:47.898037 28159 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:47.898051 28159 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:13:47.899452 28159 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:36355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:46735
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:46735
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28159
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:47.899709 28159 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:47.900039 28159 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:47.905095 28170 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:47.905042 28166 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:47.905095 28168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:47.905318 28159 server_base.cc:1034] running on GCE node
I20260811 08:13:47.905607 28159 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:47.905879 28159 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:47.907095 28159 hybrid_clock.cc:648] HybridClock initialized: now 1786436027907076 us; error 29 us; skew 500 ppm
I20260811 08:13:47.908578 28159 webserver.cc:460] Webserver started at http://127.20.158.190:43263/ using document root <none> and password file <none>
I20260811 08:13:47.908862 28159 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:47.908913 28159 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:47.909089 28159 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:47.910272 28159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "c95d2a7123be4e449fc5435f54e1e7ce"
format_stamp: "Formatted at 2026-08-11 08:13:47 on dist-test-slave-gkw7"
server_key: "624c9c5dfd20f99a55d788f07cb3b2c8"
server_key_iv: "ea453b2bc6224834aa038e15b9d6ca82"
server_key_version: "encryptionkey@0"
I20260811 08:13:47.910655 28159 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "c95d2a7123be4e449fc5435f54e1e7ce"
format_stamp: "Formatted at 2026-08-11 08:13:47 on dist-test-slave-gkw7"
server_key: "624c9c5dfd20f99a55d788f07cb3b2c8"
server_key_iv: "ea453b2bc6224834aa038e15b9d6ca82"
server_key_version: "encryptionkey@0"
I20260811 08:13:47.912009 28159 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:13:47.912844 28184 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:47.913056 28159 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:13:47.913159 28159 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "c95d2a7123be4e449fc5435f54e1e7ce"
format_stamp: "Formatted at 2026-08-11 08:13:47 on dist-test-slave-gkw7"
server_key: "624c9c5dfd20f99a55d788f07cb3b2c8"
server_key_iv: "ea453b2bc6224834aa038e15b9d6ca82"
server_key_version: "encryptionkey@0"
I20260811 08:13:47.913237 28159 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:47.916801 28159 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:47.917075 28159 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:47.917212 28159 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:47.921274 28159 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:46735
I20260811 08:13:47.921281 28256 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:46735 every 8 connection(s)
I20260811 08:13:47.921720 28159 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:13:47.922428 28257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:47.925376 28257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c95d2a7123be4e449fc5435f54e1e7ce: Bootstrap starting.
I20260811 08:13:47.926033 28257 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c95d2a7123be4e449fc5435f54e1e7ce: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:47.926347 28257 log.cc:824] T 00000000000000000000000000000000 P c95d2a7123be4e449fc5435f54e1e7ce: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:47.927073 28257 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c95d2a7123be4e449fc5435f54e1e7ce: No bootstrap required, opened a new log
I20260811 08:13:47.927573 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 28159
I20260811 08:13:47.927680 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:13:47.927879 21114 external_mini_cluster.cc:1428] Setting key 4866b677d70ad3b07ffda2da569998e2
I20260811 08:13:47.929224 28257 raft_consensus.cc:348] T 00000000000000000000000000000000 P c95d2a7123be4e449fc5435f54e1e7ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c95d2a7123be4e449fc5435f54e1e7ce" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 46735 } }
I20260811 08:13:47.929388 28257 raft_consensus.cc:374] T 00000000000000000000000000000000 P c95d2a7123be4e449fc5435f54e1e7ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:47.929433 28257 raft_consensus.cc:729] T 00000000000000000000000000000000 P c95d2a7123be4e449fc5435f54e1e7ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95d2a7123be4e449fc5435f54e1e7ce, State: Initialized, Role: FOLLOWER
I20260811 08:13:47.929625 28257 consensus_queue.cc:260] T 00000000000000000000000000000000 P c95d2a7123be4e449fc5435f54e1e7ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c95d2a7123be4e449fc5435f54e1e7ce" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 46735 } }
I20260811 08:13:47.929744 28257 raft_consensus.cc:388] T 00000000000000000000000000000000 P c95d2a7123be4e449fc5435f54e1e7ce [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:13:47.929786 28257 raft_consensus.cc:482] T 00000000000000000000000000000000 P c95d2a7123be4e449fc5435f54e1e7ce [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:13:47.929840 28257 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c95d2a7123be4e449fc5435f54e1e7ce [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:47.930460 28257 raft_consensus.cc:504] T 00000000000000000000000000000000 P c95d2a7123be4e449fc5435f54e1e7ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c95d2a7123be4e449fc5435f54e1e7ce" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 46735 } }
I20260811 08:13:47.930608 28261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:47.928468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51894 (local address 127.20.158.190:46735)
0811 08:13:47.928679 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:47.928687 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:47.928711 (+ 24us) server_negotiation.cc:407] Connection header received
0811 08:13:47.929194 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:47.929200 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:47.929240 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:47.929379 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:47.930116 (+ 737us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:47.930120 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:47.930120 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:13:47.930131 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:47.930181 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:13:47.930192 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:47.930270 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:47.930342 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 08:13:47.930404 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":81,"threads_started":1}
I20260811 08:13:47.930610 28257 leader_election.cc:302] T 00000000000000000000000000000000 P c95d2a7123be4e449fc5435f54e1e7ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c95d2a7123be4e449fc5435f54e1e7ce; no voters:
I20260811 08:13:47.930835 28257 leader_election.cc:288] T 00000000000000000000000000000000 P c95d2a7123be4e449fc5435f54e1e7ce [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:13:47.931124 28257 sys_catalog.cc:564] T 00000000000000000000000000000000 P c95d2a7123be4e449fc5435f54e1e7ce [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:47.931133 28263 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c95d2a7123be4e449fc5435f54e1e7ce [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:47.931275 28263 raft_consensus.cc:686] T 00000000000000000000000000000000 P c95d2a7123be4e449fc5435f54e1e7ce [term 1 LEADER]: Becoming Leader. State: Replica: c95d2a7123be4e449fc5435f54e1e7ce, State: Running, Role: LEADER
I20260811 08:13:47.931371 28263 consensus_queue.cc:237] T 00000000000000000000000000000000 P c95d2a7123be4e449fc5435f54e1e7ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c95d2a7123be4e449fc5435f54e1e7ce" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 46735 } }
I20260811 08:13:47.931772 28263 sys_catalog.cc:455] T 00000000000000000000000000000000 P c95d2a7123be4e449fc5435f54e1e7ce [sys.catalog]: SysCatalogTable state changed. Reason: New leader c95d2a7123be4e449fc5435f54e1e7ce. Latest consensus state: current_term: 1 leader_uuid: "c95d2a7123be4e449fc5435f54e1e7ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c95d2a7123be4e449fc5435f54e1e7ce" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 46735 } } }
I20260811 08:13:47.931866 28263 sys_catalog.cc:458] T 00000000000000000000000000000000 P c95d2a7123be4e449fc5435f54e1e7ce [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:47.931787 28266 sys_catalog.cc:455] T 00000000000000000000000000000000 P c95d2a7123be4e449fc5435f54e1e7ce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c95d2a7123be4e449fc5435f54e1e7ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c95d2a7123be4e449fc5435f54e1e7ce" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 46735 } } }
I20260811 08:13:47.932049 28266 sys_catalog.cc:458] T 00000000000000000000000000000000 P c95d2a7123be4e449fc5435f54e1e7ce [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:47.932077 28279 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:13:47.932848 28279 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:13:47.934386 28279 catalog_manager.cc:1347] Generated new cluster ID: 02ddb2f6d29e47858c18624dcbbdb67c
I20260811 08:13:47.934441 28279 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:13:47.940727 28279 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:13:47.940922 28279 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:13:47.950860 28279 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c95d2a7123be4e449fc5435f54e1e7ce: Generated new TSK 0
I20260811 08:13:47.951092 28279 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:13:47.961136 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:0
--local_ip_for_outbound_sockets=127.20.158.129
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:46735
--builtin_ntp_servers=127.20.158.148:36355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 08:13:48.070969 28292 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:48.071190 28292 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:48.071213 28292 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:48.072400 28292 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:48.072443 28292 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:48.072469 28292 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:13:48.073884 28292 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:36355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:46735
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28292
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:48.074141 28292 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:48.074447 28292 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:48.080466 28302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:48.080492 28306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:48.080709 28292 server_base.cc:1034] running on GCE node
W20260811 08:13:48.080490 28309 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:48.081060 28292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:48.081347 28292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:48.082536 28292 hybrid_clock.cc:648] HybridClock initialized: now 1786436028082508 us; error 47 us; skew 500 ppm
I20260811 08:13:48.084022 28292 webserver.cc:460] Webserver started at http://127.20.158.129:38317/ using document root <none> and password file <none>
I20260811 08:13:48.084327 28292 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:48.084405 28292 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:48.084576 28292 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:48.086184 28292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-0/data/instance:
uuid: "a997d697d57f42929f6d6b34f32ae349"
format_stamp: "Formatted at 2026-08-11 08:13:48 on dist-test-slave-gkw7"
server_key: "0229f4209feeb8da7d0fc605ea75ebd6"
server_key_iv: "e0814836e6e8ec72ced45ea8a669cede"
server_key_version: "encryptionkey@0"
I20260811 08:13:48.086659 28292 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance:
uuid: "a997d697d57f42929f6d6b34f32ae349"
format_stamp: "Formatted at 2026-08-11 08:13:48 on dist-test-slave-gkw7"
server_key: "0229f4209feeb8da7d0fc605ea75ebd6"
server_key_iv: "e0814836e6e8ec72ced45ea8a669cede"
server_key_version: "encryptionkey@0"
I20260811 08:13:48.088411 28292 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 08:13:48.089283 28319 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:48.089476 28292 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:48.089591 28292 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "a997d697d57f42929f6d6b34f32ae349"
format_stamp: "Formatted at 2026-08-11 08:13:48 on dist-test-slave-gkw7"
server_key: "0229f4209feeb8da7d0fc605ea75ebd6"
server_key_iv: "e0814836e6e8ec72ced45ea8a669cede"
server_key_version: "encryptionkey@0"
I20260811 08:13:48.089664 28292 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:48.094329 28292 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:48.094641 28292 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:48.094791 28292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:48.095026 28292 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:48.095358 28292 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:48.095403 28292 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:48.095428 28292 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:48.095444 28292 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:48.102385 28292 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:46199
I20260811 08:13:48.102424 28491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:46199 every 8 connection(s)
I20260811 08:13:48.102773 28292 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:13:48.106004 28261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:48.103522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:56427 (local address 127.20.158.190:46735)
0811 08:13:48.103581 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:48.103583 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:48.103827 (+ 244us) server_negotiation.cc:407] Connection header received
0811 08:13:48.104356 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:48.104358 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:48.104366 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:48.104418 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:48.105708 (+ 1290us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:48.105710 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:48.105710 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:13:48.105715 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:48.105740 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:13:48.105745 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:48.105814 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:48.105913 (+ 99us) server_negotiation.cc:299] Negotiation successful
0811 08:13:48.105933 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 08:13:48.106210 28496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:48.103521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:46735 (local address 127.20.158.129:56427)
0811 08:13:48.103706 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:48.103741 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:48.104240 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:48.104491 (+ 251us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:48.104495 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:48.104503 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:48.105497 (+ 994us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:13:48.105498 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:48.105569 (+ 71us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:13:48.105611 (+ 42us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:48.105826 (+ 215us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:48.105832 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:48.105835 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:13:48.105924 (+ 89us) client_negotiation.cc:240] Negotiation successful
0811 08:13:48.105989 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":86,"threads_started":1}
I20260811 08:13:48.106801 28494 heartbeater.cc:347] Connected to a master server at 127.20.158.190:46735
I20260811 08:13:48.106910 28494 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:48.107082 28494 heartbeater.cc:511] Master 127.20.158.190:46735 requested a full tablet report, sending...
I20260811 08:13:48.107681 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 28292
I20260811 08:13:48.107698 28210 ts_manager.cc:194] Registered new tserver with Master: a997d697d57f42929f6d6b34f32ae349 (127.20.158.129:46199)
I20260811 08:13:48.107761 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance
I20260811 08:13:48.107951 21114 external_mini_cluster.cc:1428] Setting key 2803de0ab5c492f05725ec2fc05fc1fc
I20260811 08:13:48.108911 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:0
--local_ip_for_outbound_sockets=127.20.158.130
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:46735
--builtin_ntp_servers=127.20.158.148:36355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 08:13:48.193100 28497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:48.193363 28497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:48.193455 28497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:48.194773 28497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:48.194813 28497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:48.194839 28497 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:13:48.196157 28497 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:36355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:46735
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28497
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:48.196370 28497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:48.196614 28497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:48.201730 28505 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:48.201726 28503 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:48.201835 28497 server_base.cc:1034] running on GCE node
W20260811 08:13:48.201753 28507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:48.202214 28497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:48.202441 28497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:48.203580 28497 hybrid_clock.cc:648] HybridClock initialized: now 1786436028203565 us; error 39 us; skew 500 ppm
I20260811 08:13:48.204963 28497 webserver.cc:460] Webserver started at http://127.20.158.130:45919/ using document root <none> and password file <none>
I20260811 08:13:48.205248 28497 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:48.205302 28497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:48.205476 28497 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:48.206679 28497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-1/data/instance:
uuid: "d91a9667e9b14126adf63820039eec78"
format_stamp: "Formatted at 2026-08-11 08:13:48 on dist-test-slave-gkw7"
server_key: "fd7373fe4cf1c2341c9e9ceb6bd2aa8d"
server_key_iv: "f656454afe8297dd7347e312dbfaf438"
server_key_version: "encryptionkey@0"
I20260811 08:13:48.207054 28497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance:
uuid: "d91a9667e9b14126adf63820039eec78"
format_stamp: "Formatted at 2026-08-11 08:13:48 on dist-test-slave-gkw7"
server_key: "fd7373fe4cf1c2341c9e9ceb6bd2aa8d"
server_key_iv: "f656454afe8297dd7347e312dbfaf438"
server_key_version: "encryptionkey@0"
I20260811 08:13:48.208420 28497 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:13:48.209142 28515 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:48.209332 28497 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:13:48.209417 28497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "d91a9667e9b14126adf63820039eec78"
format_stamp: "Formatted at 2026-08-11 08:13:48 on dist-test-slave-gkw7"
server_key: "fd7373fe4cf1c2341c9e9ceb6bd2aa8d"
server_key_iv: "f656454afe8297dd7347e312dbfaf438"
server_key_version: "encryptionkey@0"
I20260811 08:13:48.209492 28497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:48.213016 28497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:48.213291 28497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:48.213428 28497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:48.213661 28497 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:48.213985 28497 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:48.214020 28497 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:48.214040 28497 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:48.214082 28497 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:48.220257 28497 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:35323
I20260811 08:13:48.220304 28674 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:35323 every 8 connection(s)
I20260811 08:13:48.220674 28497 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
I20260811 08:13:48.223701 28261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:48.221464 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:49807 (local address 127.20.158.190:46735)
0811 08:13:48.221571 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:48.221573 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:48.221786 (+ 213us) server_negotiation.cc:407] Connection header received
0811 08:13:48.222260 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:48.222261 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:48.222266 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:48.222326 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:48.223520 (+ 1194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:48.223521 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:48.223521 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:13:48.223524 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:48.223535 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:13:48.223539 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:48.223581 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:48.223633 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 08:13:48.223645 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 08:13:48.223919 28677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:48.221432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:46735 (local address 127.20.158.130:49807)
0811 08:13:48.221653 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:48.221690 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:48.222161 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:48.222380 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:48.222384 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:48.222393 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:48.223387 (+ 994us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:13:48.223388 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:48.223418 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:13:48.223448 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:48.223580 (+ 132us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:48.223582 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:48.223585 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:13:48.223637 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 08:13:48.223684 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":120,"threads_started":1}
I20260811 08:13:48.224429 28675 heartbeater.cc:347] Connected to a master server at 127.20.158.190:46735
I20260811 08:13:48.224531 28675 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:48.224685 28675 heartbeater.cc:511] Master 127.20.158.190:46735 requested a full tablet report, sending...
I20260811 08:13:48.224670 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 28497
I20260811 08:13:48.224792 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance
I20260811 08:13:48.224977 21114 external_mini_cluster.cc:1428] Setting key d75959d466dbe81e36b4b6c141f880a7
I20260811 08:13:48.225066 28210 ts_manager.cc:194] Registered new tserver with Master: d91a9667e9b14126adf63820039eec78 (127.20.158.130:35323)
I20260811 08:13:48.225917 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:0
--local_ip_for_outbound_sockets=127.20.158.131
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:46735
--builtin_ntp_servers=127.20.158.148:36355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260811 08:13:48.311401 28678 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:48.311631 28678 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:48.311656 28678 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:48.312938 28678 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:48.312978 28678 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:48.313027 28678 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:13:48.314451 28678 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:36355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:46735
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28678
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:48.314687 28678 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:48.314970 28678 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:48.320271 28688 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:48.320302 28690 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:48.320281 28687 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:48.320565 28678 server_base.cc:1034] running on GCE node
I20260811 08:13:48.320806 28678 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:48.321048 28678 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:48.322184 28678 hybrid_clock.cc:648] HybridClock initialized: now 1786436028322162 us; error 45 us; skew 500 ppm
I20260811 08:13:48.323436 28678 webserver.cc:460] Webserver started at http://127.20.158.131:39025/ using document root <none> and password file <none>
I20260811 08:13:48.323671 28678 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:48.323716 28678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:48.323887 28678 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:48.324977 28678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-2/data/instance:
uuid: "849741831c3f4668ac5b4a7a5e82c0af"
format_stamp: "Formatted at 2026-08-11 08:13:48 on dist-test-slave-gkw7"
server_key: "413306921812d201e6214366040b0546"
server_key_iv: "74803f7d9be2335f0808530854d40ea5"
server_key_version: "encryptionkey@0"
I20260811 08:13:48.325345 28678 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance:
uuid: "849741831c3f4668ac5b4a7a5e82c0af"
format_stamp: "Formatted at 2026-08-11 08:13:48 on dist-test-slave-gkw7"
server_key: "413306921812d201e6214366040b0546"
server_key_iv: "74803f7d9be2335f0808530854d40ea5"
server_key_version: "encryptionkey@0"
I20260811 08:13:48.326747 28678 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:48.327474 28697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:48.327636 28678 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:13:48.327740 28678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "849741831c3f4668ac5b4a7a5e82c0af"
format_stamp: "Formatted at 2026-08-11 08:13:48 on dist-test-slave-gkw7"
server_key: "413306921812d201e6214366040b0546"
server_key_iv: "74803f7d9be2335f0808530854d40ea5"
server_key_version: "encryptionkey@0"
I20260811 08:13:48.327814 28678 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:48.331437 28678 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:48.331698 28678 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:48.331842 28678 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:48.332058 28678 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:48.332397 28678 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:48.332440 28678 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:48.332479 28678 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:48.332507 28678 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:48.338940 28678 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:36029
I20260811 08:13:48.338984 28877 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:36029 every 8 connection(s)
I20260811 08:13:48.339354 28678 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
I20260811 08:13:48.341305 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 28678
I20260811 08:13:48.341447 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance
I20260811 08:13:48.341677 21114 external_mini_cluster.cc:1428] Setting key 6b192cb83238f82bcc0b694c2e212f6c
I20260811 08:13:48.342684 28261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:48.340061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:60673 (local address 127.20.158.190:46735)
0811 08:13:48.340139 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:48.340153 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:48.340356 (+ 203us) server_negotiation.cc:407] Connection header received
0811 08:13:48.340876 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:48.340877 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:48.340884 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:48.340935 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:48.342414 (+ 1479us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:48.342415 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:48.342415 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:13:48.342419 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:48.342440 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:13:48.342445 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:48.342489 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:48.342594 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 08:13:48.342610 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 08:13:48.342896 28881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:48.340049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:46735 (local address 127.20.158.131:60673)
0811 08:13:48.340240 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:48.340272 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:48.340756 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:48.341002 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:48.341005 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:48.341015 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:48.342232 (+ 1217us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:13:48.342233 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:48.342274 (+ 41us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:13:48.342309 (+ 35us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:48.342507 (+ 198us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:48.342512 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:48.342515 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:13:48.342594 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 08:13:48.342660 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":78,"threads_started":1}
I20260811 08:13:48.343412 28878 heartbeater.cc:347] Connected to a master server at 127.20.158.190:46735
I20260811 08:13:48.343508 28878 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:48.343653 28878 heartbeater.cc:511] Master 127.20.158.190:46735 requested a full tablet report, sending...
I20260811 08:13:48.344008 28210 ts_manager.cc:194] Registered new tserver with Master: 849741831c3f4668ac5b4a7a5e82c0af (127.20.158.131:36029)
I20260811 08:13:48.353473 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:13:48.356041 28261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:48.354870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51900 (local address 127.20.158.190:46735)
0811 08:13:48.354946 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:48.354948 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:48.355041 (+ 93us) server_negotiation.cc:407] Connection header received
0811 08:13:48.355121 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:48.355122 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:48.355127 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:48.355178 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:48.355821 (+ 643us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:48.355822 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:48.355823 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:13:48.355827 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:48.355840 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:13:48.355845 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:48.355895 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:48.355949 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 08:13:48.355964 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 08:13:48.357704 28210 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51900:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:13:48.359262 28210 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:13:48.363422 28901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:48.361474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:36029 (local address 127.0.0.1:50806)
0811 08:13:48.362352 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:48.362363 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:48.362410 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:48.362586 (+ 176us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:48.362587 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:48.362590 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:48.362999 (+ 409us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:13:48.362999 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:48.363006 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:13:48.363018 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:48.363244 (+ 226us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:48.363250 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:48.363254 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:13:48.363322 (+ 68us) client_negotiation.cc:240] Negotiation successful
0811 08:13:48.363338 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":863,"mutex_wait_us":12,"thread_start_us":628,"threads_started":1}
I20260811 08:13:48.363441 28895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:48.361444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:46199 (local address 127.0.0.1:46514)
0811 08:13:48.361646 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:48.361685 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:48.361741 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:48.361994 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:48.362000 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:48.362007 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:48.362533 (+ 526us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:13:48.362534 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:48.362550 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:13:48.362574 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:48.363320 (+ 746us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:48.363320 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:48.363321 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 08:13:48.363373 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 08:13:48.363383 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":54,"threads_started":1}
I20260811 08:13:48.363649 28897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:48.361556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46514 (local address 127.20.158.129:46199)
0811 08:13:48.361859 (+ 303us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:48.361864 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:48.361872 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:13:48.361894 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:48.361895 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:48.361902 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:48.361960 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:48.362670 (+ 710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:48.362680 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:48.362681 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:13:48.362686 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:48.363174 (+ 488us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:13:48.363215 (+ 41us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:48.363293 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:48.363409 (+ 116us) server_negotiation.cc:299] Negotiation successful
0811 08:13:48.363428 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":271,"thread_start_us":79,"threads_started":1}
I20260811 08:13:48.363653 28899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:48.361872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44522 (local address 127.20.158.130:35323)
0811 08:13:48.362091 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:48.362095 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:48.362241 (+ 146us) server_negotiation.cc:407] Connection header received
0811 08:13:48.362341 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:48.362346 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:48.362356 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:48.362410 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:48.363293 (+ 883us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:48.363299 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:48.363299 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:13:48.363304 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:48.363334 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:13:48.363373 (+ 39us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:48.363436 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:48.363542 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 08:13:48.363561 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177,"thread_start_us":110,"threads_started":1}
I20260811 08:13:48.363722 28898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:48.361652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50806 (local address 127.20.158.131:36029)
0811 08:13:48.361837 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:48.361842 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:48.362467 (+ 625us) server_negotiation.cc:407] Connection header received
0811 08:13:48.362497 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:48.362499 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:48.362508 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:48.362584 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:48.363100 (+ 516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:48.363106 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:48.363106 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:13:48.363110 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:48.363142 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:13:48.363163 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:48.363243 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:48.363628 (+ 385us) server_negotiation.cc:299] Negotiation successful
0811 08:13:48.363645 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":105,"threads_started":1}
I20260811 08:13:48.363873 28900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:48.361474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:35323 (local address 127.0.0.1:44522)
0811 08:13:48.362173 (+ 699us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:48.362183 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:48.362263 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:48.362715 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:48.362716 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:48.362730 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:48.363172 (+ 442us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:13:48.363173 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:48.363180 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:13:48.363192 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:48.363462 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:48.363463 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:48.363464 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 08:13:48.363774 (+ 310us) client_negotiation.cc:240] Negotiation successful
0811 08:13:48.363790 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":676,"thread_start_us":713,"threads_started":1}
I20260811 08:13:48.364385 28773 tablet_service.cc:1467] Processing CreateTablet for tablet d8687f721dcc46ab9d0e8e6aace3a9e5 (DEFAULT_TABLE table=test-table [id=de365a63e798442db4952e8d8413f3e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:48.364518 28582 tablet_service.cc:1467] Processing CreateTablet for tablet d8687f721dcc46ab9d0e8e6aace3a9e5 (DEFAULT_TABLE table=test-table [id=de365a63e798442db4952e8d8413f3e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:48.364506 28393 tablet_service.cc:1467] Processing CreateTablet for tablet d8687f721dcc46ab9d0e8e6aace3a9e5 (DEFAULT_TABLE table=test-table [id=de365a63e798442db4952e8d8413f3e9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:48.364768 28773 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8687f721dcc46ab9d0e8e6aace3a9e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:48.364869 28582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8687f721dcc46ab9d0e8e6aace3a9e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:48.364871 28393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8687f721dcc46ab9d0e8e6aace3a9e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:48.367374 28902 tablet_bootstrap.cc:492] T d8687f721dcc46ab9d0e8e6aace3a9e5 P 849741831c3f4668ac5b4a7a5e82c0af: Bootstrap starting.
I20260811 08:13:48.368046 28902 tablet_bootstrap.cc:654] T d8687f721dcc46ab9d0e8e6aace3a9e5 P 849741831c3f4668ac5b4a7a5e82c0af: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:48.368184 28905 tablet_bootstrap.cc:492] T d8687f721dcc46ab9d0e8e6aace3a9e5 P a997d697d57f42929f6d6b34f32ae349: Bootstrap starting.
I20260811 08:13:48.368436 28902 log.cc:824] T d8687f721dcc46ab9d0e8e6aace3a9e5 P 849741831c3f4668ac5b4a7a5e82c0af: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:48.368819 28903 tablet_bootstrap.cc:492] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78: Bootstrap starting.
I20260811 08:13:48.368875 28905 tablet_bootstrap.cc:654] T d8687f721dcc46ab9d0e8e6aace3a9e5 P a997d697d57f42929f6d6b34f32ae349: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:48.369208 28905 log.cc:824] T d8687f721dcc46ab9d0e8e6aace3a9e5 P a997d697d57f42929f6d6b34f32ae349: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:48.369236 28902 tablet_bootstrap.cc:492] T d8687f721dcc46ab9d0e8e6aace3a9e5 P 849741831c3f4668ac5b4a7a5e82c0af: No bootstrap required, opened a new log
I20260811 08:13:48.369325 28902 ts_tablet_manager.cc:1397] T d8687f721dcc46ab9d0e8e6aace3a9e5 P 849741831c3f4668ac5b4a7a5e82c0af: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:13:48.369499 28903 tablet_bootstrap.cc:654] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:48.369877 28903 log.cc:824] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:48.370030 28905 tablet_bootstrap.cc:492] T d8687f721dcc46ab9d0e8e6aace3a9e5 P a997d697d57f42929f6d6b34f32ae349: No bootstrap required, opened a new log
I20260811 08:13:48.370105 28905 ts_tablet_manager.cc:1397] T d8687f721dcc46ab9d0e8e6aace3a9e5 P a997d697d57f42929f6d6b34f32ae349: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:13:48.370668 28903 tablet_bootstrap.cc:492] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78: No bootstrap required, opened a new log
I20260811 08:13:48.370746 28903 ts_tablet_manager.cc:1397] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260811 08:13:48.372016 28905 raft_consensus.cc:348] T d8687f721dcc46ab9d0e8e6aace3a9e5 P a997d697d57f42929f6d6b34f32ae349 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a997d697d57f42929f6d6b34f32ae349" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 46199 } } peers { permanent_uuid: "849741831c3f4668ac5b4a7a5e82c0af" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36029 } } peers { permanent_uuid: "d91a9667e9b14126adf63820039eec78" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35323 } }
I20260811 08:13:48.372174 28905 raft_consensus.cc:374] T d8687f721dcc46ab9d0e8e6aace3a9e5 P a997d697d57f42929f6d6b34f32ae349 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:48.372220 28905 raft_consensus.cc:729] T d8687f721dcc46ab9d0e8e6aace3a9e5 P a997d697d57f42929f6d6b34f32ae349 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a997d697d57f42929f6d6b34f32ae349, State: Initialized, Role: FOLLOWER
I20260811 08:13:48.372247 28902 raft_consensus.cc:348] T d8687f721dcc46ab9d0e8e6aace3a9e5 P 849741831c3f4668ac5b4a7a5e82c0af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a997d697d57f42929f6d6b34f32ae349" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 46199 } } peers { permanent_uuid: "849741831c3f4668ac5b4a7a5e82c0af" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36029 } } peers { permanent_uuid: "d91a9667e9b14126adf63820039eec78" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35323 } }
I20260811 08:13:48.372359 28905 consensus_queue.cc:260] T d8687f721dcc46ab9d0e8e6aace3a9e5 P a997d697d57f42929f6d6b34f32ae349 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a997d697d57f42929f6d6b34f32ae349" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 46199 } } peers { permanent_uuid: "849741831c3f4668ac5b4a7a5e82c0af" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36029 } } peers { permanent_uuid: "d91a9667e9b14126adf63820039eec78" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35323 } }
I20260811 08:13:48.372423 28902 raft_consensus.cc:374] T d8687f721dcc46ab9d0e8e6aace3a9e5 P 849741831c3f4668ac5b4a7a5e82c0af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:48.372475 28902 raft_consensus.cc:729] T d8687f721dcc46ab9d0e8e6aace3a9e5 P 849741831c3f4668ac5b4a7a5e82c0af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 849741831c3f4668ac5b4a7a5e82c0af, State: Initialized, Role: FOLLOWER
I20260811 08:13:48.372581 28902 consensus_queue.cc:260] T d8687f721dcc46ab9d0e8e6aace3a9e5 P 849741831c3f4668ac5b4a7a5e82c0af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a997d697d57f42929f6d6b34f32ae349" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 46199 } } peers { permanent_uuid: "849741831c3f4668ac5b4a7a5e82c0af" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36029 } } peers { permanent_uuid: "d91a9667e9b14126adf63820039eec78" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35323 } }
I20260811 08:13:48.372653 28905 ts_tablet_manager.cc:1428] T d8687f721dcc46ab9d0e8e6aace3a9e5 P a997d697d57f42929f6d6b34f32ae349: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 08:13:48.372807 28494 heartbeater.cc:503] Master 127.20.158.190:46735 was elected leader, sending a full tablet report...
I20260811 08:13:48.372869 28902 ts_tablet_manager.cc:1428] T d8687f721dcc46ab9d0e8e6aace3a9e5 P 849741831c3f4668ac5b4a7a5e82c0af: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:13:48.372999 28878 heartbeater.cc:503] Master 127.20.158.190:46735 was elected leader, sending a full tablet report...
I20260811 08:13:48.373391 28903 raft_consensus.cc:348] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a997d697d57f42929f6d6b34f32ae349" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 46199 } } peers { permanent_uuid: "849741831c3f4668ac5b4a7a5e82c0af" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36029 } } peers { permanent_uuid: "d91a9667e9b14126adf63820039eec78" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35323 } }
I20260811 08:13:48.373564 28903 raft_consensus.cc:374] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:48.373606 28903 raft_consensus.cc:729] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d91a9667e9b14126adf63820039eec78, State: Initialized, Role: FOLLOWER
I20260811 08:13:48.373703 28903 consensus_queue.cc:260] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a997d697d57f42929f6d6b34f32ae349" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 46199 } } peers { permanent_uuid: "849741831c3f4668ac5b4a7a5e82c0af" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36029 } } peers { permanent_uuid: "d91a9667e9b14126adf63820039eec78" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35323 } }
I20260811 08:13:48.373970 28903 ts_tablet_manager.cc:1428] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78: Time spent starting tablet: real 0.003s user 0.000s sys 0.004s
I20260811 08:13:48.374008 28675 heartbeater.cc:503] Master 127.20.158.190:46735 was elected leader, sending a full tablet report...
W20260811 08:13:48.471305 28676 tablet.cc:2369] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:13:48.572467 28912 raft_consensus.cc:482] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:13:48.572618 28912 raft_consensus.cc:504] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a997d697d57f42929f6d6b34f32ae349" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 46199 } } peers { permanent_uuid: "849741831c3f4668ac5b4a7a5e82c0af" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36029 } } peers { permanent_uuid: "d91a9667e9b14126adf63820039eec78" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35323 } }
I20260811 08:13:48.573098 28912 leader_election.cc:288] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a997d697d57f42929f6d6b34f32ae349 (127.20.158.129:46199), 849741831c3f4668ac5b4a7a5e82c0af (127.20.158.131:36029)
I20260811 08:13:48.574523 28677 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:48.573325 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:46199 (local address 127.20.158.130:53697)
0811 08:13:48.573389 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:48.573401 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:48.573443 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:48.573678 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:48.573680 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:48.573683 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:48.574195 (+ 512us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:13:48.574196 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:48.574203 (+ 7us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:13:48.574215 (+ 12us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:48.574391 (+ 176us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:48.574392 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:48.574393 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 08:13:48.574438 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 08:13:48.574454 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 08:13:48.574523 28897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:48.573390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:53697 (local address 127.20.158.129:46199)
0811 08:13:48.573465 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:48.573467 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:48.573479 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:13:48.573511 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:48.573513 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:48.573520 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:48.573610 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:48.574300 (+ 690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:48.574302 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:48.574303 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:13:48.574308 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:48.574325 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:13:48.574330 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:48.574379 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:48.574443 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 08:13:48.574456 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:13:48.574899 28422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8687f721dcc46ab9d0e8e6aace3a9e5" candidate_uuid: "d91a9667e9b14126adf63820039eec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a997d697d57f42929f6d6b34f32ae349" is_pre_election: true
I20260811 08:13:48.575073 28422 raft_consensus.cc:2454] T d8687f721dcc46ab9d0e8e6aace3a9e5 P a997d697d57f42929f6d6b34f32ae349 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d91a9667e9b14126adf63820039eec78 in term 0.
I20260811 08:13:48.575201 28898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:48.573676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:56361 (local address 127.20.158.131:36029)
0811 08:13:48.573737 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:48.573739 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:48.573747 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:13:48.573772 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:48.573773 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:48.573777 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:48.573843 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:48.574922 (+ 1079us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:48.574924 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:48.574924 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:13:48.574929 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:48.574948 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:13:48.574953 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:48.575020 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:48.575117 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 08:13:48.575133 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 08:13:48.575347 28520 leader_election.cc:302] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a997d697d57f42929f6d6b34f32ae349, d91a9667e9b14126adf63820039eec78; no voters:
I20260811 08:13:48.575346 28913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:48.573339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:36029 (local address 127.20.158.130:56361)
0811 08:13:48.573674 (+ 335us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:48.573684 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:48.573721 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:48.574198 (+ 477us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:48.574199 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:48.574217 (+ 18us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:48.574810 (+ 593us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:13:48.574810 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:48.574818 (+ 8us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:13:48.574831 (+ 13us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:48.575061 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:48.575062 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:48.575063 (+ 1us) client_negotiation.cc:769] Sending connection context
0811 08:13:48.575116 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 08:13:48.575157 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":310,"thread_start_us":177,"threads_started":1}
I20260811 08:13:48.575498 28912 raft_consensus.cc:2781] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:13:48.575552 28912 raft_consensus.cc:482] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:13:48.575573 28912 raft_consensus.cc:3037] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:48.575753 28808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8687f721dcc46ab9d0e8e6aace3a9e5" candidate_uuid: "d91a9667e9b14126adf63820039eec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849741831c3f4668ac5b4a7a5e82c0af" is_pre_election: true
I20260811 08:13:48.575909 28808 raft_consensus.cc:2454] T d8687f721dcc46ab9d0e8e6aace3a9e5 P 849741831c3f4668ac5b4a7a5e82c0af [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d91a9667e9b14126adf63820039eec78 in term 0.
I20260811 08:13:48.576481 28912 raft_consensus.cc:504] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a997d697d57f42929f6d6b34f32ae349" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 46199 } } peers { permanent_uuid: "849741831c3f4668ac5b4a7a5e82c0af" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36029 } } peers { permanent_uuid: "d91a9667e9b14126adf63820039eec78" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35323 } }
I20260811 08:13:48.576628 28912 leader_election.cc:288] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78 [CANDIDATE]: Term 1 election: Requested vote from peers a997d697d57f42929f6d6b34f32ae349 (127.20.158.129:46199), 849741831c3f4668ac5b4a7a5e82c0af (127.20.158.131:36029)
I20260811 08:13:48.576774 28422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8687f721dcc46ab9d0e8e6aace3a9e5" candidate_uuid: "d91a9667e9b14126adf63820039eec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a997d697d57f42929f6d6b34f32ae349"
I20260811 08:13:48.576819 28808 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8687f721dcc46ab9d0e8e6aace3a9e5" candidate_uuid: "d91a9667e9b14126adf63820039eec78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "849741831c3f4668ac5b4a7a5e82c0af"
I20260811 08:13:48.576864 28422 raft_consensus.cc:3037] T d8687f721dcc46ab9d0e8e6aace3a9e5 P a997d697d57f42929f6d6b34f32ae349 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:48.576889 28808 raft_consensus.cc:3037] T d8687f721dcc46ab9d0e8e6aace3a9e5 P 849741831c3f4668ac5b4a7a5e82c0af [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:48.577857 28422 raft_consensus.cc:2454] T d8687f721dcc46ab9d0e8e6aace3a9e5 P a997d697d57f42929f6d6b34f32ae349 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d91a9667e9b14126adf63820039eec78 in term 1.
I20260811 08:13:48.577876 28808 raft_consensus.cc:2454] T d8687f721dcc46ab9d0e8e6aace3a9e5 P 849741831c3f4668ac5b4a7a5e82c0af [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d91a9667e9b14126adf63820039eec78 in term 1.
I20260811 08:13:48.578047 28520 leader_election.cc:302] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a997d697d57f42929f6d6b34f32ae349, d91a9667e9b14126adf63820039eec78; no voters:
I20260811 08:13:48.578197 28912 raft_consensus.cc:2781] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:48.578377 28912 raft_consensus.cc:686] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78 [term 1 LEADER]: Becoming Leader. State: Replica: d91a9667e9b14126adf63820039eec78, State: Running, Role: LEADER
I20260811 08:13:48.578476 28912 consensus_queue.cc:237] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a997d697d57f42929f6d6b34f32ae349" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 46199 } } peers { permanent_uuid: "849741831c3f4668ac5b4a7a5e82c0af" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36029 } } peers { permanent_uuid: "d91a9667e9b14126adf63820039eec78" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35323 } }
I20260811 08:13:48.579397 28209 catalog_manager.cc:5495] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78 reported cstate change: term changed from 0 to 1, leader changed from <none> to d91a9667e9b14126adf63820039eec78 (127.20.158.130). New cstate: current_term: 1 leader_uuid: "d91a9667e9b14126adf63820039eec78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a997d697d57f42929f6d6b34f32ae349" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 46199 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "849741831c3f4668ac5b4a7a5e82c0af" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36029 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d91a9667e9b14126adf63820039eec78" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35323 } health_report { overall_health: HEALTHY } } }
W20260811 08:13:48.589912 28879 tablet.cc:2369] T d8687f721dcc46ab9d0e8e6aace3a9e5 P 849741831c3f4668ac5b4a7a5e82c0af: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:13:48.597958 28899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:48.596918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44534 (local address 127.20.158.130:35323)
0811 08:13:48.596978 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:48.596980 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:48.596991 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:13:48.597039 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:48.597040 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:48.597053 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:48.597095 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:48.597701 (+ 606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:48.597703 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:48.597703 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:13:48.597708 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:48.597725 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:13:48.597729 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:48.597794 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:48.597850 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 08:13:48.597862 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 08:13:48.599861 28808 raft_consensus.cc:1261] T d8687f721dcc46ab9d0e8e6aace3a9e5 P 849741831c3f4668ac5b4a7a5e82c0af [term 1 FOLLOWER]: Refusing update from remote peer d91a9667e9b14126adf63820039eec78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:48.599879 28422 raft_consensus.cc:1261] T d8687f721dcc46ab9d0e8e6aace3a9e5 P a997d697d57f42929f6d6b34f32ae349 [term 1 FOLLOWER]: Refusing update from remote peer d91a9667e9b14126adf63820039eec78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:48.600210 28912 consensus_queue.cc:1035] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a997d697d57f42929f6d6b34f32ae349" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 46199 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:13:48.600342 28915 consensus_queue.cc:1035] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "849741831c3f4668ac5b4a7a5e82c0af" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:13:48.604463 28919 mvcc.cc:205] Tried to move back new op lower bound from 7317241973142183936 to 7317241973058027520. Current Snapshot: MvccSnapshot[applied={T|T < 7317241973142183936 or (T in {7317241973142183936})}]
I20260811 08:13:48.604674 28920 mvcc.cc:205] Tried to move back new op lower bound from 7317241973142183936 to 7317241973058027520. Current Snapshot: MvccSnapshot[applied={T|T < 7317241973142183936 or (T in {7317241973142183936})}]
I20260811 08:13:48.604974 28209 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:51900:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:13:48.605070 28209 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51900:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:13:48.605878 28209 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c95d2a7123be4e449fc5435f54e1e7ce: Sending DeleteTablet for 3 replicas of tablet d8687f721dcc46ab9d0e8e6aace3a9e5
I20260811 08:13:48.606213 28773 tablet_service.cc:1514] Processing DeleteTablet for tablet d8687f721dcc46ab9d0e8e6aace3a9e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:48 UTC) from {username='slave'} at 127.0.0.1:50806
I20260811 08:13:48.606323 28393 tablet_service.cc:1514] Processing DeleteTablet for tablet d8687f721dcc46ab9d0e8e6aace3a9e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:48 UTC) from {username='slave'} at 127.0.0.1:46514
I20260811 08:13:48.606539 28937 tablet_replica.cc:330] T d8687f721dcc46ab9d0e8e6aace3a9e5 P a997d697d57f42929f6d6b34f32ae349: stopping tablet replica
I20260811 08:13:48.606685 28937 raft_consensus.cc:2229] T d8687f721dcc46ab9d0e8e6aace3a9e5 P a997d697d57f42929f6d6b34f32ae349 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:13:48.606701 28582 tablet_service.cc:1514] Processing DeleteTablet for tablet d8687f721dcc46ab9d0e8e6aace3a9e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:48 UTC) from {username='slave'} at 127.0.0.1:44522
I20260811 08:13:48.606880 28937 raft_consensus.cc:2258] T d8687f721dcc46ab9d0e8e6aace3a9e5 P a997d697d57f42929f6d6b34f32ae349 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:48.606900 28938 tablet_replica.cc:330] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78: stopping tablet replica
I20260811 08:13:48.606920 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 28292
I20260811 08:13:48.606987 28938 raft_consensus.cc:2229] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:13:48.607506 28938 raft_consensus.cc:2258] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:48.611755 28938 ts_tablet_manager.cc:1905] T d8687f721dcc46ab9d0e8e6aace3a9e5 P d91a9667e9b14126adf63820039eec78: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:13:48.617861 28935 tablet_replica.cc:330] T d8687f721dcc46ab9d0e8e6aace3a9e5 P 849741831c3f4668ac5b4a7a5e82c0af: stopping tablet replica
I20260811 08:13:48.618016 28935 raft_consensus.cc:2229] T d8687f721dcc46ab9d0e8e6aace3a9e5 P 849741831c3f4668ac5b4a7a5e82c0af [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:13:48.618145 28935 raft_consensus.cc:2258] T d8687f721dcc46ab9d0e8e6aace3a9e5 P 849741831c3f4668ac5b4a7a5e82c0af [term 1 FOLLOWER]: Raft consensus is shut down!
W20260811 08:13:48.621932 28188 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.158.129:46199 (error 108)
I20260811 08:13:48.622042 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 28497
I20260811 08:13:48.622265 28935 ts_tablet_manager.cc:1905] T d8687f721dcc46ab9d0e8e6aace3a9e5 P 849741831c3f4668ac5b4a7a5e82c0af: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:13:48.627765 28900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:48.627508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:46199 (local address 127.0.0.1:46522)
0811 08:13:48.627665 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:48.627707 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.129:46199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135}
W20260811 08:13:48.628868 28188 catalog_manager.cc:4584] TS a997d697d57f42929f6d6b34f32ae349 (127.20.158.129:46199): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d8687f721dcc46ab9d0e8e6aace3a9e5: Network error: Client connection negotiation failed: client connection to 127.20.158.129:46199: connect: Connection refused (error 111)
I20260811 08:13:48.675002 28935 ts_tablet_manager.cc:1918] T d8687f721dcc46ab9d0e8e6aace3a9e5 P 849741831c3f4668ac5b4a7a5e82c0af: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:13:48.675143 28935 log.cc:1196] T d8687f721dcc46ab9d0e8e6aace3a9e5 P 849741831c3f4668ac5b4a7a5e82c0af: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786436003833085-21114-0/minicluster-data/ts-2/wal/wals/d8687f721dcc46ab9d0e8e6aace3a9e5
I20260811 08:13:48.675525 28935 ts_tablet_manager.cc:1939] T d8687f721dcc46ab9d0e8e6aace3a9e5 P 849741831c3f4668ac5b4a7a5e82c0af: Deleting consensus metadata
I20260811 08:13:48.677117 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 28678
I20260811 08:13:48.677250 28189 catalog_manager.cc:4841] TS 849741831c3f4668ac5b4a7a5e82c0af (127.20.158.131:36029): tablet d8687f721dcc46ab9d0e8e6aace3a9e5 (table test-table [id=de365a63e798442db4952e8d8413f3e9]) successfully deleted
I20260811 08:13:48.679872 28900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:48.677141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:35323 (local address 127.0.0.1:44540)
0811 08:13:48.677237 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:48.677267 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.130:35323: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260811 08:13:48.682575 28900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:48.682457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:46199 (local address 127.0.0.1:46528)
0811 08:13:48.682507 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:48.682535 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.129:46199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 08:13:48.684141 28900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:48.684054 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:46199 (local address 127.0.0.1:46540)
0811 08:13:48.684092 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:48.684112 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.129:46199: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260811 08:13:48.690204 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 28159
2026-08-11T08:13:48Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (916 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260811 08:13:48.721197 21114 mini_oidc.cc:152] Starting JWKS server
I20260811 08:13:48.722471 21114 webserver.cc:460] Webserver started at https://127.0.0.1:46555/ using document root <none> and password file <none>
I20260811 08:13:48.722585 21114 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 08:13:48.722766 21114 webserver.cc:460] Webserver started at http://127.0.0.1:45453/ using document root <none> and password file <none>
2026-08-11T08:13:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:13:48Z Disabled control of system clock
I20260811 08:13:48.732191 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:39297
--webserver_interface=127.20.158.190
--webserver_port=0
--builtin_ntp_servers=127.20.158.148:45375
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:39297
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46555/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786436003833085-21114-0/testchainca.cert with env {}
W20260811 08:13:48.911496 28949 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:48.911707 28949 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:48.911729 28949 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:48.912834 28949 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:48.912873 28949 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:48.912892 28949 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:48.912904 28949 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:48.912916 28949 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 08:13:48.912928 28949 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 08:13:48.912945 28949 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46555/jwks.json
I20260811 08:13:48.914470 28949 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:45375
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:39297
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:39297
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46555/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786436003833085-21114-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28949
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:48.914672 28949 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:48.914839 28949 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:48.919740 28958 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:48.919740 28961 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:48.919847 28959 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:48.920073 28949 server_base.cc:1034] running on GCE node
I20260811 08:13:48.920401 28949 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:48.920696 28949 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:48.921855 28949 hybrid_clock.cc:648] HybridClock initialized: now 1786436028921840 us; error 46 us; skew 500 ppm
I20260811 08:13:48.923089 28949 webserver.cc:460] Webserver started at http://127.20.158.190:45957/ using document root <none> and password file <none>
I20260811 08:13:48.923354 28949 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:48.923424 28949 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:48.923568 28949 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:48.924708 28949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "401aaeff412045cf836fde4509b83634"
format_stamp: "Formatted at 2026-08-11 08:13:48 on dist-test-slave-gkw7"
server_key: "1a5883e17029e428f90426666285add0"
server_key_iv: "f78c559b07d2eec9fe810ec48083c766"
server_key_version: "encryptionkey@0"
I20260811 08:13:48.925072 28949 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "401aaeff412045cf836fde4509b83634"
format_stamp: "Formatted at 2026-08-11 08:13:48 on dist-test-slave-gkw7"
server_key: "1a5883e17029e428f90426666285add0"
server_key_iv: "f78c559b07d2eec9fe810ec48083c766"
server_key_version: "encryptionkey@0"
I20260811 08:13:48.926491 28949 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:13:48.927290 28970 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:48.927457 28949 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:13:48.927564 28949 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "401aaeff412045cf836fde4509b83634"
format_stamp: "Formatted at 2026-08-11 08:13:48 on dist-test-slave-gkw7"
server_key: "1a5883e17029e428f90426666285add0"
server_key_iv: "f78c559b07d2eec9fe810ec48083c766"
server_key_version: "encryptionkey@0"
I20260811 08:13:48.927637 28949 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:48.951049 28949 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:48.951409 28949 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:48.951575 28949 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:48.955853 28949 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:39297
I20260811 08:13:48.955892 29048 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:39297 every 8 connection(s)
I20260811 08:13:48.956249 28949 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:13:48.957340 29049 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:48.958039 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 28949
I20260811 08:13:48.958137 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:13:48.958328 21114 external_mini_cluster.cc:1428] Setting key 3072a9cb5a03ce02d32e0c4c48af87fa
I20260811 08:13:48.960642 29049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 401aaeff412045cf836fde4509b83634: Bootstrap starting.
I20260811 08:13:48.961381 29049 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 401aaeff412045cf836fde4509b83634: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:48.961740 29049 log.cc:824] T 00000000000000000000000000000000 P 401aaeff412045cf836fde4509b83634: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:48.962628 29049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 401aaeff412045cf836fde4509b83634: No bootstrap required, opened a new log
I20260811 08:13:48.964653 29052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:48.958870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37332 (local address 127.20.158.190:39297)
0811 08:13:48.959107 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:48.959117 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:48.959151 (+ 34us) server_negotiation.cc:407] Connection header received
0811 08:13:48.959730 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:48.959739 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:48.959826 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:48.959973 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:48.960154 (+ 181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:48.961513 (+ 1359us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:48.962539 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:48.963152 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:48.963280 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:48.963947 (+ 667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:48.963951 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:48.963952 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:13:48.964163 (+ 211us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:48.964205 (+ 42us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:13:48.964220 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:48.964292 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:48.964348 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 08:13:48.964429 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":91,"threads_started":1}
I20260811 08:13:48.965286 29049 raft_consensus.cc:348] T 00000000000000000000000000000000 P 401aaeff412045cf836fde4509b83634 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "401aaeff412045cf836fde4509b83634" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 39297 } }
I20260811 08:13:48.965449 29049 raft_consensus.cc:374] T 00000000000000000000000000000000 P 401aaeff412045cf836fde4509b83634 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:48.965497 29049 raft_consensus.cc:729] T 00000000000000000000000000000000 P 401aaeff412045cf836fde4509b83634 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 401aaeff412045cf836fde4509b83634, State: Initialized, Role: FOLLOWER
I20260811 08:13:48.965639 29049 consensus_queue.cc:260] T 00000000000000000000000000000000 P 401aaeff412045cf836fde4509b83634 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "401aaeff412045cf836fde4509b83634" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 39297 } }
I20260811 08:13:48.965715 29049 raft_consensus.cc:388] T 00000000000000000000000000000000 P 401aaeff412045cf836fde4509b83634 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:13:48.965746 29049 raft_consensus.cc:482] T 00000000000000000000000000000000 P 401aaeff412045cf836fde4509b83634 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:13:48.965727 21114 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:13:48.965790 29049 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 401aaeff412045cf836fde4509b83634 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:48.975036 29049 raft_consensus.cc:504] T 00000000000000000000000000000000 P 401aaeff412045cf836fde4509b83634 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "401aaeff412045cf836fde4509b83634" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 39297 } }
I20260811 08:13:48.975181 29049 leader_election.cc:302] T 00000000000000000000000000000000 P 401aaeff412045cf836fde4509b83634 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 401aaeff412045cf836fde4509b83634; no voters:
I20260811 08:13:48.975404 29049 leader_election.cc:288] T 00000000000000000000000000000000 P 401aaeff412045cf836fde4509b83634 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:13:48.975553 29055 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 401aaeff412045cf836fde4509b83634 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:48.975690 29049 sys_catalog.cc:564] T 00000000000000000000000000000000 P 401aaeff412045cf836fde4509b83634 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:48.975769 29055 raft_consensus.cc:686] T 00000000000000000000000000000000 P 401aaeff412045cf836fde4509b83634 [term 1 LEADER]: Becoming Leader. State: Replica: 401aaeff412045cf836fde4509b83634, State: Running, Role: LEADER
I20260811 08:13:48.975917 29055 consensus_queue.cc:237] T 00000000000000000000000000000000 P 401aaeff412045cf836fde4509b83634 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "401aaeff412045cf836fde4509b83634" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 39297 } }
I20260811 08:13:48.976286 29055 sys_catalog.cc:455] T 00000000000000000000000000000000 P 401aaeff412045cf836fde4509b83634 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 401aaeff412045cf836fde4509b83634. Latest consensus state: current_term: 1 leader_uuid: "401aaeff412045cf836fde4509b83634" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "401aaeff412045cf836fde4509b83634" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 39297 } } }
I20260811 08:13:48.976290 29057 sys_catalog.cc:455] T 00000000000000000000000000000000 P 401aaeff412045cf836fde4509b83634 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "401aaeff412045cf836fde4509b83634" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "401aaeff412045cf836fde4509b83634" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 39297 } } }
I20260811 08:13:48.976431 29057 sys_catalog.cc:458] T 00000000000000000000000000000000 P 401aaeff412045cf836fde4509b83634 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:48.976375 29055 sys_catalog.cc:458] T 00000000000000000000000000000000 P 401aaeff412045cf836fde4509b83634 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:48.976681 29067 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:13:48.977205 29067 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:13:48.980720 29067 catalog_manager.cc:1347] Generated new cluster ID: fd8430d65f0446fdbd9e8e527d1b6590
I20260811 08:13:48.980779 29067 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:13:48.992715 29067 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:13:48.993462 29067 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:13:48.996768 29067 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 401aaeff412045cf836fde4509b83634: Generated new TSK 0
I20260811 08:13:48.996995 29067 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 08:13:49.020773 29097 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260811 08:13:49.020893 29097 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 08:13:49.021207 29052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:49.005167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37344 (local address 127.20.158.190:39297)
0811 08:13:49.005231 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:49.005234 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:49.005355 (+ 121us) server_negotiation.cc:407] Connection header received
0811 08:13:49.005438 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:49.005440 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:49.005452 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:49.005561 (+ 109us) server_negotiation.cc:226] Negotiated authn=JWT
0811 08:13:49.005726 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:49.006511 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:49.007291 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:49.007607 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:49.007672 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:49.007872 (+ 200us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 08:13:49.020959 (+ 13087us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46555/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 08:13:49.021131 (+ 172us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37344: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46555/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":37}
W20260811 08:13:49.021294 29052 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37344: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46555/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260811 08:13:49.021679 29089 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:49.005078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:39297 (local address 127.0.0.1:37344)
0811 08:13:49.005285 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:49.005295 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:49.005357 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:49.005596 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:49.005597 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:49.005599 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 08:13:49.005652 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:49.005655 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:49.006588 (+ 933us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:49.006589 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:49.007210 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:49.007212 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:49.007698 (+ 486us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:49.007699 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:49.007741 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:49.007761 (+ 20us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 08:13:49.021099 (+ 13338us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46555/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0811 08:13:49.021202 (+ 103us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.158.190:39297: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46555/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":103,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.20.158.190:39297: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46555/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260811 08:13:49.022264 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 28949
2026-08-11T08:13:49Z chronyd exiting
I20260811 08:13:49.064471 21114 test_util.cc:175] -----------------------------------------------
I20260811 08:13:49.064554 21114 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786436003833085-21114-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (344 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260811 08:13:49.065338 21114 mini_oidc.cc:152] Starting JWKS server
I20260811 08:13:49.066104 21114 webserver.cc:460] Webserver started at https://127.0.0.1:36449/ using document root <none> and password file <none>
I20260811 08:13:49.066147 21114 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 08:13:49.066311 21114 webserver.cc:460] Webserver started at http://127.0.0.1:43407/ using document root <none> and password file <none>
2026-08-11T08:13:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:13:49Z Disabled control of system clock
I20260811 08:13:49.075770 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:45211
--webserver_interface=127.20.158.190
--webserver_port=0
--builtin_ntp_servers=127.20.158.148:34223
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:45211
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36449/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786436003833085-21114-0/testchainca.cert with env {}
W20260811 08:13:49.167958 29107 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:49.168192 29107 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:49.168216 29107 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:49.169437 29107 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:49.169480 29107 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:49.169494 29107 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:49.169508 29107 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:49.169521 29107 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 08:13:49.169615 29107 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 08:13:49.169651 29107 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:36449/jwks.json
I20260811 08:13:49.171406 29107 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:34223
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:45211
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:45211
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:36449/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786436003833085-21114-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29107
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:49.171718 29107 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:49.171955 29107 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:49.177438 29120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:49.177460 29118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:49.177515 29107 server_base.cc:1034] running on GCE node
W20260811 08:13:49.177486 29116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:49.178071 29107 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:49.178387 29107 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:49.179576 29107 hybrid_clock.cc:648] HybridClock initialized: now 1786436029179568 us; error 36 us; skew 500 ppm
I20260811 08:13:49.180969 29107 webserver.cc:460] Webserver started at http://127.20.158.190:35315/ using document root <none> and password file <none>
I20260811 08:13:49.181258 29107 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:49.181332 29107 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:49.181478 29107 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:49.182618 29107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "edc18ef082c8437193a8af44817eebf8"
format_stamp: "Formatted at 2026-08-11 08:13:49 on dist-test-slave-gkw7"
server_key: "4103f5ec71a42ed5b23f75eb3f68b009"
server_key_iv: "2a6c78d772f99fd5282e7e03c5bddd5f"
server_key_version: "encryptionkey@0"
I20260811 08:13:49.182991 29107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "edc18ef082c8437193a8af44817eebf8"
format_stamp: "Formatted at 2026-08-11 08:13:49 on dist-test-slave-gkw7"
server_key: "4103f5ec71a42ed5b23f75eb3f68b009"
server_key_iv: "2a6c78d772f99fd5282e7e03c5bddd5f"
server_key_version: "encryptionkey@0"
I20260811 08:13:49.184427 29107 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:13:49.185165 29131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:49.185341 29107 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:13:49.185449 29107 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "edc18ef082c8437193a8af44817eebf8"
format_stamp: "Formatted at 2026-08-11 08:13:49 on dist-test-slave-gkw7"
server_key: "4103f5ec71a42ed5b23f75eb3f68b009"
server_key_iv: "2a6c78d772f99fd5282e7e03c5bddd5f"
server_key_version: "encryptionkey@0"
I20260811 08:13:49.185523 29107 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:49.206537 29107 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:49.206908 29107 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:49.207082 29107 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:49.211498 29107 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:45211
I20260811 08:13:49.211537 29221 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:45211 every 8 connection(s)
I20260811 08:13:49.211930 29107 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:13:49.212687 29222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:49.215713 29222 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P edc18ef082c8437193a8af44817eebf8: Bootstrap starting.
I20260811 08:13:49.216360 29222 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P edc18ef082c8437193a8af44817eebf8: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:49.216662 29222 log.cc:824] T 00000000000000000000000000000000 P edc18ef082c8437193a8af44817eebf8: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:49.217450 29222 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P edc18ef082c8437193a8af44817eebf8: No bootstrap required, opened a new log
I20260811 08:13:49.219210 29222 raft_consensus.cc:348] T 00000000000000000000000000000000 P edc18ef082c8437193a8af44817eebf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edc18ef082c8437193a8af44817eebf8" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 45211 } }
I20260811 08:13:49.219353 29222 raft_consensus.cc:374] T 00000000000000000000000000000000 P edc18ef082c8437193a8af44817eebf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:49.219398 29222 raft_consensus.cc:729] T 00000000000000000000000000000000 P edc18ef082c8437193a8af44817eebf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: edc18ef082c8437193a8af44817eebf8, State: Initialized, Role: FOLLOWER
I20260811 08:13:49.219583 29222 consensus_queue.cc:260] T 00000000000000000000000000000000 P edc18ef082c8437193a8af44817eebf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edc18ef082c8437193a8af44817eebf8" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 45211 } }
I20260811 08:13:49.219672 29222 raft_consensus.cc:388] T 00000000000000000000000000000000 P edc18ef082c8437193a8af44817eebf8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:13:49.219724 29222 raft_consensus.cc:482] T 00000000000000000000000000000000 P edc18ef082c8437193a8af44817eebf8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:13:49.219777 29222 raft_consensus.cc:3037] T 00000000000000000000000000000000 P edc18ef082c8437193a8af44817eebf8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:49.220853 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 29107
I20260811 08:13:49.220956 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:13:49.221105 21114 external_mini_cluster.cc:1428] Setting key 6b29dfc65b8e04ff98155fc115429a23
I20260811 08:13:49.226612 29229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:49.221627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36784 (local address 127.20.158.190:45211)
0811 08:13:49.221862 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:49.221869 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:49.221896 (+ 27us) server_negotiation.cc:407] Connection header received
0811 08:13:49.221989 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:49.221995 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:49.222458 (+ 463us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:49.222618 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:49.222854 (+ 236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:49.223731 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:49.224506 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:49.224930 (+ 424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:49.225067 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:49.225801 (+ 734us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:49.225806 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:49.225806 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:13:49.225983 (+ 177us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:49.226016 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:13:49.226028 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:49.226106 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:49.226180 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 08:13:49.226283 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":85,"threads_started":1}
I20260811 08:13:49.227546 21114 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:13:49.284674 29222 raft_consensus.cc:504] T 00000000000000000000000000000000 P edc18ef082c8437193a8af44817eebf8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edc18ef082c8437193a8af44817eebf8" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 45211 } }
I20260811 08:13:49.284919 29222 leader_election.cc:302] T 00000000000000000000000000000000 P edc18ef082c8437193a8af44817eebf8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: edc18ef082c8437193a8af44817eebf8; no voters:
I20260811 08:13:49.285177 29222 leader_election.cc:288] T 00000000000000000000000000000000 P edc18ef082c8437193a8af44817eebf8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:13:49.285265 29231 raft_consensus.cc:2781] T 00000000000000000000000000000000 P edc18ef082c8437193a8af44817eebf8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:49.285451 29231 raft_consensus.cc:686] T 00000000000000000000000000000000 P edc18ef082c8437193a8af44817eebf8 [term 1 LEADER]: Becoming Leader. State: Replica: edc18ef082c8437193a8af44817eebf8, State: Running, Role: LEADER
I20260811 08:13:49.285501 29222 sys_catalog.cc:564] T 00000000000000000000000000000000 P edc18ef082c8437193a8af44817eebf8 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:49.285597 29231 consensus_queue.cc:237] T 00000000000000000000000000000000 P edc18ef082c8437193a8af44817eebf8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edc18ef082c8437193a8af44817eebf8" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 45211 } }
I20260811 08:13:49.285985 29231 sys_catalog.cc:455] T 00000000000000000000000000000000 P edc18ef082c8437193a8af44817eebf8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "edc18ef082c8437193a8af44817eebf8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edc18ef082c8437193a8af44817eebf8" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 45211 } } }
I20260811 08:13:49.286067 29231 sys_catalog.cc:458] T 00000000000000000000000000000000 P edc18ef082c8437193a8af44817eebf8 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:49.286202 29231 sys_catalog.cc:455] T 00000000000000000000000000000000 P edc18ef082c8437193a8af44817eebf8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader edc18ef082c8437193a8af44817eebf8. Latest consensus state: current_term: 1 leader_uuid: "edc18ef082c8437193a8af44817eebf8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "edc18ef082c8437193a8af44817eebf8" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 45211 } } }
I20260811 08:13:49.286273 29231 sys_catalog.cc:458] T 00000000000000000000000000000000 P edc18ef082c8437193a8af44817eebf8 [sys.catalog]: This master's current role is: LEADER
W20260811 08:13:49.287763 29251 catalog_manager.cc:1558] T 00000000000000000000000000000000 P edc18ef082c8437193a8af44817eebf8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:13:49.287905 29251 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:13:49.288127 29237 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:13:49.288393 29237 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:13:49.290096 29237 catalog_manager.cc:1347] Generated new cluster ID: bd7ca8897d5848818bd05408468618bb
I20260811 08:13:49.290159 29237 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:13:49.325896 29237 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:13:49.326476 29237 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:13:49.329241 29237 catalog_manager.cc:5868] T 00000000000000000000000000000000 P edc18ef082c8437193a8af44817eebf8: Generated new TSK 0
I20260811 08:13:49.329440 29237 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260811 08:13:49.352198 29266 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260811 08:13:49.352303 29266 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260811 08:13:49.352643 29229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:49.337593 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36786 (local address 127.20.158.190:45211)
0811 08:13:49.337644 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:49.337646 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:49.337654 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:13:49.337684 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:49.337685 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:49.337695 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:49.337757 (+ 62us) server_negotiation.cc:226] Negotiated authn=JWT
0811 08:13:49.338018 (+ 261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:49.338563 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:49.339720 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:49.339922 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:49.339975 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:49.340151 (+ 176us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 08:13:49.352456 (+ 12305us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36449/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 08:13:49.352590 (+ 134us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36786: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36449/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":26}
W20260811 08:13:49.352716 29229 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36786: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36449/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260811 08:13:49.352838 29265 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:49.336947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:45211 (local address 127.0.0.1:36786)
0811 08:13:49.337187 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:49.337222 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:49.337283 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:49.337776 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:49.337777 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:49.337780 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0811 08:13:49.337866 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:49.337868 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:49.338646 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:49.338647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:49.339632 (+ 985us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:49.339636 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:49.339995 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:49.339996 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:49.340058 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:49.340064 (+ 6us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 08:13:49.352578 (+ 12514us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36449/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0811 08:13:49.352729 (+ 151us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.158.190:45211: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:36449/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":211,"thread_start_us":105,"threads_started":1}
I20260811 08:13:49.353029 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 29107
2026-08-11T08:13:49Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (337 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260811 08:13:49.402549 21114 mini_oidc.cc:152] Starting JWKS server
I20260811 08:13:49.403254 21114 webserver.cc:460] Webserver started at https://127.0.0.1:44301/ using document root <none> and password file <none>
I20260811 08:13:49.403299 21114 mini_oidc.cc:189] Starting OIDC Discovery server
I20260811 08:13:49.403453 21114 webserver.cc:460] Webserver started at http://127.0.0.1:35617/ using document root <none> and password file <none>
2026-08-11T08:13:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:13:49Z Disabled control of system clock
I20260811 08:13:49.412099 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:41773
--webserver_interface=127.20.158.190
--webserver_port=0
--builtin_ntp_servers=127.20.158.148:39009
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:41773
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44301/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 08:13:49.496022 29275 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:49.496246 29275 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:49.496269 29275 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:49.497401 29275 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:49.497440 29275 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:49.497453 29275 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:49.497466 29275 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:49.497478 29275 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 08:13:49.497490 29275 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 08:13:49.497515 29275 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:44301/jwks.json
I20260811 08:13:49.498908 29275 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:39009
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:41773
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:41773
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:44301/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29275
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:49.499122 29275 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:49.499379 29275 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:49.504372 29294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:49.504411 29287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:49.504387 29290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:49.504679 29275 server_base.cc:1034] running on GCE node
I20260811 08:13:49.504920 29275 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:49.505234 29275 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:49.506412 29275 hybrid_clock.cc:648] HybridClock initialized: now 1786436029506394 us; error 44 us; skew 500 ppm
I20260811 08:13:49.507762 29275 webserver.cc:460] Webserver started at http://127.20.158.190:43651/ using document root <none> and password file <none>
I20260811 08:13:49.508031 29275 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:49.508103 29275 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:49.508280 29275 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:49.509358 29275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "7a0fa029ad6344c08cca607b4fbad7c9"
format_stamp: "Formatted at 2026-08-11 08:13:49 on dist-test-slave-gkw7"
server_key: "2bdbfba15234d91c84b9ad9196e9336d"
server_key_iv: "b4abe337487f9774c1c049f0340e1983"
server_key_version: "encryptionkey@0"
I20260811 08:13:49.509773 29275 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "7a0fa029ad6344c08cca607b4fbad7c9"
format_stamp: "Formatted at 2026-08-11 08:13:49 on dist-test-slave-gkw7"
server_key: "2bdbfba15234d91c84b9ad9196e9336d"
server_key_iv: "b4abe337487f9774c1c049f0340e1983"
server_key_version: "encryptionkey@0"
I20260811 08:13:49.511142 29275 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:13:49.511859 29304 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:49.512053 29275 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:13:49.512166 29275 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "7a0fa029ad6344c08cca607b4fbad7c9"
format_stamp: "Formatted at 2026-08-11 08:13:49 on dist-test-slave-gkw7"
server_key: "2bdbfba15234d91c84b9ad9196e9336d"
server_key_iv: "b4abe337487f9774c1c049f0340e1983"
server_key_version: "encryptionkey@0"
I20260811 08:13:49.512239 29275 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:49.524010 29275 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:49.524328 29275 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:49.524487 29275 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:49.528546 29275 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:41773
I20260811 08:13:49.528577 29391 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:41773 every 8 connection(s)
I20260811 08:13:49.528918 29275 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:13:49.529645 29393 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:49.532455 29393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a0fa029ad6344c08cca607b4fbad7c9: Bootstrap starting.
I20260811 08:13:49.533043 29393 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7a0fa029ad6344c08cca607b4fbad7c9: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:49.533291 29393 log.cc:824] T 00000000000000000000000000000000 P 7a0fa029ad6344c08cca607b4fbad7c9: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:49.534015 29393 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a0fa029ad6344c08cca607b4fbad7c9: No bootstrap required, opened a new log
I20260811 08:13:49.535596 29393 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7a0fa029ad6344c08cca607b4fbad7c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a0fa029ad6344c08cca607b4fbad7c9" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 41773 } }
I20260811 08:13:49.535732 29393 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7a0fa029ad6344c08cca607b4fbad7c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:49.535754 29393 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7a0fa029ad6344c08cca607b4fbad7c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a0fa029ad6344c08cca607b4fbad7c9, State: Initialized, Role: FOLLOWER
I20260811 08:13:49.535897 29393 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7a0fa029ad6344c08cca607b4fbad7c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a0fa029ad6344c08cca607b4fbad7c9" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 41773 } }
I20260811 08:13:49.535984 29393 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7a0fa029ad6344c08cca607b4fbad7c9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:13:49.536007 29393 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7a0fa029ad6344c08cca607b4fbad7c9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:13:49.536036 29393 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7a0fa029ad6344c08cca607b4fbad7c9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:49.536456 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 29275
I20260811 08:13:49.536572 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:13:49.536749 21114 external_mini_cluster.cc:1428] Setting key 01f1d18b781ef336ae9387bbbcc31947
I20260811 08:13:49.541872 29403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:49.537213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51734 (local address 127.20.158.190:41773)
0811 08:13:49.537444 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:49.537453 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:49.537489 (+ 36us) server_negotiation.cc:407] Connection header received
0811 08:13:49.537629 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:49.537635 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:49.537704 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:49.537840 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:49.538062 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:49.539014 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:49.539830 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:49.540237 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:49.540375 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:49.541007 (+ 632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:49.541011 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:49.541011 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:13:49.541223 (+ 212us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:49.541260 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:13:49.541271 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:49.541338 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:49.541419 (+ 81us) server_negotiation.cc:299] Negotiation successful
0811 08:13:49.541500 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":83,"threads_started":1}
I20260811 08:13:49.542783 21114 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:13:49.571718 29393 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7a0fa029ad6344c08cca607b4fbad7c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a0fa029ad6344c08cca607b4fbad7c9" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 41773 } }
I20260811 08:13:49.571954 29393 leader_election.cc:302] T 00000000000000000000000000000000 P 7a0fa029ad6344c08cca607b4fbad7c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7a0fa029ad6344c08cca607b4fbad7c9; no voters:
I20260811 08:13:49.572201 29393 leader_election.cc:288] T 00000000000000000000000000000000 P 7a0fa029ad6344c08cca607b4fbad7c9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:13:49.572291 29408 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7a0fa029ad6344c08cca607b4fbad7c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:49.572477 29408 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7a0fa029ad6344c08cca607b4fbad7c9 [term 1 LEADER]: Becoming Leader. State: Replica: 7a0fa029ad6344c08cca607b4fbad7c9, State: Running, Role: LEADER
I20260811 08:13:49.572510 29393 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7a0fa029ad6344c08cca607b4fbad7c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:49.572590 29408 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7a0fa029ad6344c08cca607b4fbad7c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a0fa029ad6344c08cca607b4fbad7c9" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 41773 } }
I20260811 08:13:49.573072 29409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a0fa029ad6344c08cca607b4fbad7c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7a0fa029ad6344c08cca607b4fbad7c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a0fa029ad6344c08cca607b4fbad7c9" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 41773 } } }
I20260811 08:13:49.573163 29409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a0fa029ad6344c08cca607b4fbad7c9 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:49.573402 29410 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a0fa029ad6344c08cca607b4fbad7c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7a0fa029ad6344c08cca607b4fbad7c9. Latest consensus state: current_term: 1 leader_uuid: "7a0fa029ad6344c08cca607b4fbad7c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a0fa029ad6344c08cca607b4fbad7c9" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 41773 } } }
I20260811 08:13:49.573738 29410 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a0fa029ad6344c08cca607b4fbad7c9 [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:49.573958 29420 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:13:49.574529 29420 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:13:49.576822 29420 catalog_manager.cc:1347] Generated new cluster ID: 835a017e80b249f5bd7c3286000e3c9d
I20260811 08:13:49.576893 29420 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:13:49.581749 29420 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:13:49.582530 29420 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:13:49.587098 29420 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7a0fa029ad6344c08cca607b4fbad7c9: Generated new TSK 0
I20260811 08:13:49.587280 29420 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:13:49.601905 29403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:49.597974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51736 (local address 127.20.158.190:41773)
0811 08:13:49.598035 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:49.598037 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:49.598137 (+ 100us) server_negotiation.cc:407] Connection header received
0811 08:13:49.598213 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:49.598214 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:49.598228 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:49.598313 (+ 85us) server_negotiation.cc:226] Negotiated authn=JWT
0811 08:13:49.598440 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:49.599238 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:49.600005 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:49.600333 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:49.600405 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:49.600579 (+ 174us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 08:13:49.601677 (+ 1098us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44301/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 08:13:49.601832 (+ 155us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51736: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44301/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":33}
W20260811 08:13:49.601990 29403 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51736: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44301/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260811 08:13:49.603860 29443 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:49.597890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:41773 (local address 127.0.0.1:51736)
0811 08:13:49.598063 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:49.598074 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:49.598138 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:49.598318 (+ 180us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:49.598319 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:49.598321 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 08:13:49.598378 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:49.598380 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:49.599340 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:49.599341 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:49.599932 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:49.599934 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:49.600424 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:49.600424 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:49.600474 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:49.600479 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 08:13:49.601771 (+ 1292us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44301/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0811 08:13:49.603760 (+ 1989us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.158.190:41773: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:44301/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":148,"mutex_wait_us":1780,"thread_start_us":100,"threads_started":1}
I20260811 08:13:49.604090 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 29275
E20260811 08:13:49.622510 29447 webserver.cc:533] Webserver: sslize failed:
E20260811 08:13:49.622596 29447 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-08-11T08:13:49Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (249 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-11T08:13:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:13:49Z Disabled control of system clock
I20260811 08:13:49.661289 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:38911
--webserver_interface=127.20.158.190
--webserver_port=0
--builtin_ntp_servers=127.20.158.148:34603
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:38911
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786436003833085-21114-0/testchainca.cert with env {}
W20260811 08:13:49.747466 29453 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:49.747707 29453 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:49.747748 29453 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:49.748904 29453 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:49.748970 29453 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:49.748991 29453 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:49.749011 29453 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:49.749038 29453 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260811 08:13:49.749063 29453 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260811 08:13:49.749089 29453 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260811 08:13:49.750627 29453 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:34603
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:38911
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:38911
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786436003833085-21114-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29453
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:49.750908 29453 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:49.751121 29453 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:13:49.756315 29453 server_base.cc:1034] running on GCE node
W20260811 08:13:49.756279 29461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:49.756292 29459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:49.756292 29464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:49.756784 29453 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:49.757108 29453 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:49.758271 29453 hybrid_clock.cc:648] HybridClock initialized: now 1786436029758257 us; error 37 us; skew 500 ppm
I20260811 08:13:49.759496 29453 webserver.cc:460] Webserver started at http://127.20.158.190:38909/ using document root <none> and password file <none>
I20260811 08:13:49.759753 29453 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:49.759829 29453 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:49.759975 29453 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:49.761305 29453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "517924b890cb4b71aefde904979fe2ec"
format_stamp: "Formatted at 2026-08-11 08:13:49 on dist-test-slave-gkw7"
server_key: "89e0da5372cd6b790b54f4c5f268e3e9"
server_key_iv: "9bec57a02b3a5e27fd9cf84f5428c20b"
server_key_version: "encryptionkey@0"
I20260811 08:13:49.761721 29453 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "517924b890cb4b71aefde904979fe2ec"
format_stamp: "Formatted at 2026-08-11 08:13:49 on dist-test-slave-gkw7"
server_key: "89e0da5372cd6b790b54f4c5f268e3e9"
server_key_iv: "9bec57a02b3a5e27fd9cf84f5428c20b"
server_key_version: "encryptionkey@0"
I20260811 08:13:49.763090 29453 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:13:49.763784 29474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:49.763963 29453 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:13:49.764063 29453 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "517924b890cb4b71aefde904979fe2ec"
format_stamp: "Formatted at 2026-08-11 08:13:49 on dist-test-slave-gkw7"
server_key: "89e0da5372cd6b790b54f4c5f268e3e9"
server_key_iv: "9bec57a02b3a5e27fd9cf84f5428c20b"
server_key_version: "encryptionkey@0"
I20260811 08:13:49.764145 29453 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:49.772526 29453 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:49.772825 29453 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:49.772975 29453 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:49.777241 29453 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:38911
I20260811 08:13:49.777273 29556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:38911 every 8 connection(s)
I20260811 08:13:49.778339 29453 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:13:49.779400 29557 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:49.781771 29557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 517924b890cb4b71aefde904979fe2ec: Bootstrap starting.
I20260811 08:13:49.782341 29557 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 517924b890cb4b71aefde904979fe2ec: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:49.782598 29557 log.cc:824] T 00000000000000000000000000000000 P 517924b890cb4b71aefde904979fe2ec: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:49.783309 29557 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 517924b890cb4b71aefde904979fe2ec: No bootstrap required, opened a new log
I20260811 08:13:49.784883 29557 raft_consensus.cc:348] T 00000000000000000000000000000000 P 517924b890cb4b71aefde904979fe2ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "517924b890cb4b71aefde904979fe2ec" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38911 } }
I20260811 08:13:49.785022 29557 raft_consensus.cc:374] T 00000000000000000000000000000000 P 517924b890cb4b71aefde904979fe2ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:49.785046 29557 raft_consensus.cc:729] T 00000000000000000000000000000000 P 517924b890cb4b71aefde904979fe2ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 517924b890cb4b71aefde904979fe2ec, State: Initialized, Role: FOLLOWER
I20260811 08:13:49.785152 29557 consensus_queue.cc:260] T 00000000000000000000000000000000 P 517924b890cb4b71aefde904979fe2ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "517924b890cb4b71aefde904979fe2ec" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38911 } }
I20260811 08:13:49.785203 29557 raft_consensus.cc:388] T 00000000000000000000000000000000 P 517924b890cb4b71aefde904979fe2ec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:13:49.785234 29557 raft_consensus.cc:482] T 00000000000000000000000000000000 P 517924b890cb4b71aefde904979fe2ec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:13:49.785265 29557 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 517924b890cb4b71aefde904979fe2ec [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:49.785871 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 29453
I20260811 08:13:49.785989 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:13:49.786171 21114 external_mini_cluster.cc:1428] Setting key a3caf07958e74153217edeefd842c9c3
I20260811 08:13:49.791049 29562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:49.786690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40348 (local address 127.20.158.190:38911)
0811 08:13:49.786900 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:49.786907 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:49.786932 (+ 25us) server_negotiation.cc:407] Connection header received
0811 08:13:49.787029 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:49.787034 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:49.787086 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:49.787199 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:49.787388 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:49.788530 (+ 1142us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:49.789245 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:49.789697 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:49.789811 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:49.790403 (+ 592us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:49.790407 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:49.790407 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:13:49.790577 (+ 170us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:49.790610 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:13:49.790621 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:49.790674 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:49.790743 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 08:13:49.790852 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":92,"threads_started":1}
I20260811 08:13:49.792047 21114 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:13:49.870745 29557 raft_consensus.cc:504] T 00000000000000000000000000000000 P 517924b890cb4b71aefde904979fe2ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "517924b890cb4b71aefde904979fe2ec" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38911 } }
I20260811 08:13:49.870962 29557 leader_election.cc:302] T 00000000000000000000000000000000 P 517924b890cb4b71aefde904979fe2ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 517924b890cb4b71aefde904979fe2ec; no voters:
I20260811 08:13:49.871249 29557 leader_election.cc:288] T 00000000000000000000000000000000 P 517924b890cb4b71aefde904979fe2ec [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:13:49.871318 29563 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 517924b890cb4b71aefde904979fe2ec [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:49.871537 29563 raft_consensus.cc:686] T 00000000000000000000000000000000 P 517924b890cb4b71aefde904979fe2ec [term 1 LEADER]: Becoming Leader. State: Replica: 517924b890cb4b71aefde904979fe2ec, State: Running, Role: LEADER
I20260811 08:13:49.871551 29557 sys_catalog.cc:564] T 00000000000000000000000000000000 P 517924b890cb4b71aefde904979fe2ec [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:49.871726 29563 consensus_queue.cc:237] T 00000000000000000000000000000000 P 517924b890cb4b71aefde904979fe2ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "517924b890cb4b71aefde904979fe2ec" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38911 } }
I20260811 08:13:49.872152 29564 sys_catalog.cc:455] T 00000000000000000000000000000000 P 517924b890cb4b71aefde904979fe2ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "517924b890cb4b71aefde904979fe2ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "517924b890cb4b71aefde904979fe2ec" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38911 } } }
I20260811 08:13:49.872238 29564 sys_catalog.cc:458] T 00000000000000000000000000000000 P 517924b890cb4b71aefde904979fe2ec [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:49.872450 29567 sys_catalog.cc:455] T 00000000000000000000000000000000 P 517924b890cb4b71aefde904979fe2ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader 517924b890cb4b71aefde904979fe2ec. Latest consensus state: current_term: 1 leader_uuid: "517924b890cb4b71aefde904979fe2ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "517924b890cb4b71aefde904979fe2ec" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38911 } } }
I20260811 08:13:49.872582 29567 sys_catalog.cc:458] T 00000000000000000000000000000000 P 517924b890cb4b71aefde904979fe2ec [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:49.872922 29571 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:13:49.873585 29571 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:13:49.875965 29571 catalog_manager.cc:1347] Generated new cluster ID: e67a06f8ca5f4541b1e23be7df903f3f
I20260811 08:13:49.876040 29571 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:13:49.881945 29571 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:13:49.882472 29571 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:13:49.888171 29571 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 517924b890cb4b71aefde904979fe2ec: Generated new TSK 0
I20260811 08:13:49.888355 29571 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:13:49.915055 29562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:49.896559 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40356 (local address 127.20.158.190:38911)
0811 08:13:49.896612 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:49.896615 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:49.896725 (+ 110us) server_negotiation.cc:407] Connection header received
0811 08:13:49.896790 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:49.896791 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:49.896805 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:49.896878 (+ 73us) server_negotiation.cc:226] Negotiated authn=JWT
0811 08:13:49.897008 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:49.897798 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:49.898656 (+ 858us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:49.898979 (+ 323us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:49.899061 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:49.899243 (+ 182us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0811 08:13:49.914793 (+ 15550us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 08:13:49.914975 (+ 182us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:40356: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":26}
W20260811 08:13:49.915133 29562 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:40356: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260811 08:13:49.915179 29608 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:49.896455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38911 (local address 127.0.0.1:40356)
0811 08:13:49.896641 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:49.896651 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:49.896717 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:49.896884 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:49.896885 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:49.896887 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0811 08:13:49.896940 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:49.896942 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:49.897909 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:49.897909 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:49.898540 (+ 631us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:49.898543 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:49.899066 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:49.899066 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:49.899139 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:49.899144 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0811 08:13:49.914935 (+ 15791us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0811 08:13:49.915043 (+ 108us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.20.158.190:38911: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":113,"threads_started":1}
I20260811 08:13:49.915715 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 29453
2026-08-11T08:13:49Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (288 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (96 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (99 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:13:50 dist-test-slave-gkw7 krb5kdc[29628](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:13:50 dist-test-slave-gkw7 krb5kdc[29628](info): set up 2 sockets
Aug 11 08:13:50 dist-test-slave-gkw7 krb5kdc[29628](info): commencing operation
krb5kdc: starting...
W20260811 08:13:51.516947 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.380s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:13:51 dist-test-slave-gkw7 krb5kdc[29628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436031, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:13:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:13:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:13:51.644085 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:34195
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:38103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:34195
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:51.732805 29650 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:51.733021 29650 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:51.733047 29650 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:51.734257 29650 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:51.734301 29650 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:51.734315 29650 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:51.734328 29650 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:51.734381 29650 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:13:51.735846 29650 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:38103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:34195
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:34195
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29650
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:51.736114 29650 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:51.736349 29650 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:51.741390 29662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:51.741453 29659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:51.741601 29650 server_base.cc:1034] running on GCE node
W20260811 08:13:51.741657 29660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:51.741945 29650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:51.742287 29650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:51.743456 29650 hybrid_clock.cc:648] HybridClock initialized: now 1786436031743443 us; error 43 us; skew 500 ppm
Aug 11 08:13:51 dist-test-slave-gkw7 krb5kdc[29628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436031, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:51.746057 29650 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:13:51.746565 29650 webserver.cc:460] Webserver started at http://127.20.158.190:38427/ using document root <none> and password file <none>
I20260811 08:13:51.746836 29650 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:51.746903 29650 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:51.747059 29650 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:51.748149 29650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "1fd9e2b47b6c434e84e007d6e274d87a"
format_stamp: "Formatted at 2026-08-11 08:13:51 on dist-test-slave-gkw7"
server_key: "255ebb8618f24404393565e668a6858c"
server_key_iv: "0d7a67efc56a1aa4d5ad4c50560f3cf9"
server_key_version: "encryptionkey@0"
I20260811 08:13:51.748534 29650 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "1fd9e2b47b6c434e84e007d6e274d87a"
format_stamp: "Formatted at 2026-08-11 08:13:51 on dist-test-slave-gkw7"
server_key: "255ebb8618f24404393565e668a6858c"
server_key_iv: "0d7a67efc56a1aa4d5ad4c50560f3cf9"
server_key_version: "encryptionkey@0"
I20260811 08:13:51.749958 29650 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:13:51.750782 29674 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:51.751009 29650 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:51.751114 29650 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "1fd9e2b47b6c434e84e007d6e274d87a"
format_stamp: "Formatted at 2026-08-11 08:13:51 on dist-test-slave-gkw7"
server_key: "255ebb8618f24404393565e668a6858c"
server_key_iv: "0d7a67efc56a1aa4d5ad4c50560f3cf9"
server_key_version: "encryptionkey@0"
I20260811 08:13:51.751192 29650 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:51.764815 29650 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:51.766994 29650 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:51.767166 29650 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:51.771572 29650 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:34195
I20260811 08:13:51.771627 29758 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:34195 every 8 connection(s)
I20260811 08:13:51.772006 29650 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:13:51.772943 29759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:51.775349 29759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fd9e2b47b6c434e84e007d6e274d87a: Bootstrap starting.
I20260811 08:13:51.775902 29759 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1fd9e2b47b6c434e84e007d6e274d87a: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:51.776154 29759 log.cc:824] T 00000000000000000000000000000000 P 1fd9e2b47b6c434e84e007d6e274d87a: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:51.776811 29759 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fd9e2b47b6c434e84e007d6e274d87a: No bootstrap required, opened a new log
I20260811 08:13:51.778430 29759 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1fd9e2b47b6c434e84e007d6e274d87a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fd9e2b47b6c434e84e007d6e274d87a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34195 } }
I20260811 08:13:51.778571 29759 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1fd9e2b47b6c434e84e007d6e274d87a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:51.778595 29759 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1fd9e2b47b6c434e84e007d6e274d87a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fd9e2b47b6c434e84e007d6e274d87a, State: Initialized, Role: FOLLOWER
I20260811 08:13:51.778713 29759 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1fd9e2b47b6c434e84e007d6e274d87a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fd9e2b47b6c434e84e007d6e274d87a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34195 } }
I20260811 08:13:51.778810 29759 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1fd9e2b47b6c434e84e007d6e274d87a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:13:51.778849 29759 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1fd9e2b47b6c434e84e007d6e274d87a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:13:51.778903 29759 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1fd9e2b47b6c434e84e007d6e274d87a [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:51.779470 29759 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1fd9e2b47b6c434e84e007d6e274d87a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fd9e2b47b6c434e84e007d6e274d87a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34195 } }
I20260811 08:13:51.779597 29759 leader_election.cc:302] T 00000000000000000000000000000000 P 1fd9e2b47b6c434e84e007d6e274d87a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1fd9e2b47b6c434e84e007d6e274d87a; no voters:
I20260811 08:13:51.779799 29759 leader_election.cc:288] T 00000000000000000000000000000000 P 1fd9e2b47b6c434e84e007d6e274d87a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:13:51.779882 29765 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1fd9e2b47b6c434e84e007d6e274d87a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:51.779902 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 29650
I20260811 08:13:51.780011 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:13:51.780114 29759 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1fd9e2b47b6c434e84e007d6e274d87a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:51.780220 21114 external_mini_cluster.cc:1428] Setting key 0f7491ac32d86e2e131f4fcc428cafa6
I20260811 08:13:51.780292 29765 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1fd9e2b47b6c434e84e007d6e274d87a [term 1 LEADER]: Becoming Leader. State: Replica: 1fd9e2b47b6c434e84e007d6e274d87a, State: Running, Role: LEADER
I20260811 08:13:51.780378 29765 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1fd9e2b47b6c434e84e007d6e274d87a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fd9e2b47b6c434e84e007d6e274d87a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34195 } }
I20260811 08:13:51.781051 29773 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fd9e2b47b6c434e84e007d6e274d87a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1fd9e2b47b6c434e84e007d6e274d87a. Latest consensus state: current_term: 1 leader_uuid: "1fd9e2b47b6c434e84e007d6e274d87a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fd9e2b47b6c434e84e007d6e274d87a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34195 } } }
I20260811 08:13:51.781147 29773 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fd9e2b47b6c434e84e007d6e274d87a [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:51.781184 29772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fd9e2b47b6c434e84e007d6e274d87a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1fd9e2b47b6c434e84e007d6e274d87a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fd9e2b47b6c434e84e007d6e274d87a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34195 } } }
I20260811 08:13:51.781267 29772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fd9e2b47b6c434e84e007d6e274d87a [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:51.781682 29798 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:13:51.782567 29798 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:13:51.784168 29798 catalog_manager.cc:1347] Generated new cluster ID: 6191ba79563a40e68a388e90022770dc
I20260811 08:13:51.784235 29798 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:13:51 dist-test-slave-gkw7 krb5kdc[29628](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436031, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:51.791935 29796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:51.780761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42546 (local address 127.20.158.190:34195)
0811 08:13:51.781004 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:51.781015 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:51.781048 (+ 33us) server_negotiation.cc:407] Connection header received
0811 08:13:51.781911 (+ 863us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:51.781920 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:51.781984 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:51.782078 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:51.782914 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:51.783850 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:51.784763 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:51.785241 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:51.785366 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:51.787791 (+ 2425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:51.787795 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:51.787796 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:51.787810 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:51.790217 (+ 2407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:51.790619 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:51.790622 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:51.790623 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:51.790718 (+ 95us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:51.790936 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:51.790936 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:51.790937 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:51.791191 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:51.791373 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:51.791442 (+ 69us) server_negotiation.cc:299] Negotiation successful
0811 08:13:51.791724 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":179,"thread_start_us":84,"threads_started":1}
I20260811 08:13:51.792395 29798 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:13:51.793095 29798 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:13:51.803035 29798 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1fd9e2b47b6c434e84e007d6e274d87a: Generated new TSK 0
I20260811 08:13:51.803267 29798 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.158.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
I20260811 08:13:51.834930 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:0
--local_ip_for_outbound_sockets=127.20.158.129
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:34195
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:38103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:51.953728 29820 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:51.954072 29820 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:51.954133 29820 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:51.955526 29820 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:51.955595 29820 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:51.955642 29820 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:13:51.957216 29820 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:38103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:34195
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29820
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:51.957502 29820 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:51.957811 29820 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:51.964274 29833 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:51.964360 29837 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:51.964690 29820 server_base.cc:1034] running on GCE node
W20260811 08:13:51.964269 29835 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:51.965015 29820 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:51.965368 29820 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:51.966570 29820 hybrid_clock.cc:648] HybridClock initialized: now 1786436031966554 us; error 29 us; skew 500 ppm
Aug 11 08:13:51 dist-test-slave-gkw7 krb5kdc[29628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436031, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:51.974378 29820 init.cc:377] Logged in from keytab as kudu/127.20.158.129@KRBTEST.COM (short username kudu)
I20260811 08:13:51.974926 29820 webserver.cc:460] Webserver started at http://127.20.158.129:36035/ using document root <none> and password file <none>
I20260811 08:13:51.975196 29820 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:51.975253 29820 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:51.975401 29820 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:51.976629 29820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-0/data/instance:
uuid: "5e1d8e3e78f24735a19c2c79e269c890"
format_stamp: "Formatted at 2026-08-11 08:13:51 on dist-test-slave-gkw7"
server_key: "c827afd209a2339212829ab2ccf3ce6e"
server_key_iv: "f20d670ce9c129925d9c3d1fd7a29950"
server_key_version: "encryptionkey@0"
I20260811 08:13:51.977034 29820 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance:
uuid: "5e1d8e3e78f24735a19c2c79e269c890"
format_stamp: "Formatted at 2026-08-11 08:13:51 on dist-test-slave-gkw7"
server_key: "c827afd209a2339212829ab2ccf3ce6e"
server_key_iv: "f20d670ce9c129925d9c3d1fd7a29950"
server_key_version: "encryptionkey@0"
I20260811 08:13:51.978700 29820 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:13:51.979734 29853 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:51.979984 29820 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:13:51.980080 29820 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "5e1d8e3e78f24735a19c2c79e269c890"
format_stamp: "Formatted at 2026-08-11 08:13:51 on dist-test-slave-gkw7"
server_key: "c827afd209a2339212829ab2ccf3ce6e"
server_key_iv: "f20d670ce9c129925d9c3d1fd7a29950"
server_key_version: "encryptionkey@0"
I20260811 08:13:51.980197 29820 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:51.990233 29820 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:51.992693 29820 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:51.992828 29820 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:51.993021 29820 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:51.993355 29820 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:51.993418 29820 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:51.993461 29820 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:51.993481 29820 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:51.999658 29820 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:39759
I20260811 08:13:51.999701 30038 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:39759 every 8 connection(s)
I20260811 08:13:52.000059 29820 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:13:52.002492 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 29820
I20260811 08:13:52.002610 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance
I20260811 08:13:52.002842 21114 external_mini_cluster.cc:1428] Setting key e20d85f8238819b838a8b098e6d9e444
Aug 11 08:13:52 dist-test-slave-gkw7 krb5kdc[29628](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436031, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:52.011730 29796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:52.000917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:50059 (local address 127.20.158.190:34195)
0811 08:13:52.000992 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:52.000994 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:52.001234 (+ 240us) server_negotiation.cc:407] Connection header received
0811 08:13:52.002350 (+ 1116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:52.002351 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:52.002368 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:52.002427 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:52.003316 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:52.003955 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:52.005517 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:52.005875 (+ 358us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:52.005953 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:52.008500 (+ 2547us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:52.008502 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:52.008502 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:52.008509 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:52.010154 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:52.010707 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:52.010708 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:52.010708 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:52.010761 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:52.011076 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:52.011077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:52.011077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:52.011181 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:52.011233 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:52.011590 (+ 357us) server_negotiation.cc:299] Negotiation successful
0811 08:13:52.011661 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 08:13:52.012043 30042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:52.000898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:34195 (local address 127.20.158.129:50059)
0811 08:13:52.001105 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:52.001143 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:52.002185 (+ 1042us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:52.002510 (+ 325us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:52.002515 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:52.002900 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:52.003205 (+ 305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:52.003212 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:52.004060 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:52.004061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:52.005413 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:52.005417 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:52.005966 (+ 549us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:52.005967 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:52.006076 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:52.006650 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:52.006659 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:52.008390 (+ 1731us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:52.010252 (+ 1862us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:52.010262 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:52.010265 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:52.010616 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:52.010837 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:52.010838 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:52.010839 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:52.010999 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:52.011253 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:52.011261 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:52.011443 (+ 182us) client_negotiation.cc:769] Sending connection context
0811 08:13:52.011574 (+ 131us) client_negotiation.cc:240] Negotiation successful
0811 08:13:52.011776 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":120,"threads_started":1}
I20260811 08:13:52.012687 30039 heartbeater.cc:347] Connected to a master server at 127.20.158.190:34195
I20260811 08:13:52.012823 30039 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:52.013023 30039 heartbeater.cc:511] Master 127.20.158.190:34195 requested a full tablet report, sending...
I20260811 08:13:52.013634 29697 ts_manager.cc:194] Registered new tserver with Master: 5e1d8e3e78f24735a19c2c79e269c890 (127.20.158.129:39759)
WARNING: no policy specified for kudu/127.20.158.130@KRBTEST.COM; defaulting to no policy
I20260811 08:13:52.014312 29697 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.129@KRBTEST.COM'} at 127.20.158.129:50059
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
I20260811 08:13:52.033812 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:0
--local_ip_for_outbound_sockets=127.20.158.130
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:34195
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:38103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:52.119685 30046 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:52.119912 30046 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:52.119937 30046 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:52.121055 30046 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:52.121089 30046 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:52.121115 30046 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:13:52.122612 30046 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:38103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:34195
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30046
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:52.122829 30046 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:52.123023 30046 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:52.128322 30058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:52.128371 30053 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:52.128338 30051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:52.128804 30046 server_base.cc:1034] running on GCE node
I20260811 08:13:52.129043 30046 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:52.129371 30046 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:52.130534 30046 hybrid_clock.cc:648] HybridClock initialized: now 1786436032130527 us; error 70 us; skew 500 ppm
Aug 11 08:13:52 dist-test-slave-gkw7 krb5kdc[29628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436032, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:52.133291 30046 init.cc:377] Logged in from keytab as kudu/127.20.158.130@KRBTEST.COM (short username kudu)
I20260811 08:13:52.133824 30046 webserver.cc:460] Webserver started at http://127.20.158.130:37407/ using document root <none> and password file <none>
I20260811 08:13:52.134068 30046 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:52.134142 30046 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:52.134310 30046 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:52.135392 30046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-1/data/instance:
uuid: "c9f53a5cad084976a49c5e3bdec5b690"
format_stamp: "Formatted at 2026-08-11 08:13:52 on dist-test-slave-gkw7"
server_key: "ea2e6640861aaa8761a7a798a60e785e"
server_key_iv: "bd98b4870722cb5934c328a6647df3fe"
server_key_version: "encryptionkey@0"
I20260811 08:13:52.135776 30046 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance:
uuid: "c9f53a5cad084976a49c5e3bdec5b690"
format_stamp: "Formatted at 2026-08-11 08:13:52 on dist-test-slave-gkw7"
server_key: "ea2e6640861aaa8761a7a798a60e785e"
server_key_iv: "bd98b4870722cb5934c328a6647df3fe"
server_key_version: "encryptionkey@0"
I20260811 08:13:52.137195 30046 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:13:52.138058 30068 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:52.138377 30046 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:13:52.138489 30046 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "c9f53a5cad084976a49c5e3bdec5b690"
format_stamp: "Formatted at 2026-08-11 08:13:52 on dist-test-slave-gkw7"
server_key: "ea2e6640861aaa8761a7a798a60e785e"
server_key_iv: "bd98b4870722cb5934c328a6647df3fe"
server_key_version: "encryptionkey@0"
I20260811 08:13:52.138564 30046 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:52.148537 30046 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:52.150713 30046 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:52.150892 30046 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:52.151142 30046 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:52.151475 30046 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:52.151510 30046 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:52.151530 30046 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:52.151582 30046 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:52.158667 30046 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:40611
I20260811 08:13:52.158744 30263 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:40611 every 8 connection(s)
I20260811 08:13:52.159101 30046 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
I20260811 08:13:52.159861 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 30046
I20260811 08:13:52.160002 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance
I20260811 08:13:52.160296 21114 external_mini_cluster.cc:1428] Setting key c0044c6aac3080ad4b8d8db28c245274
Aug 11 08:13:52 dist-test-slave-gkw7 krb5kdc[29628](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436032, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:52.171224 30267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:52.160091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:34195 (local address 127.20.158.130:51583)
0811 08:13:52.160298 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:52.160353 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:52.162042 (+ 1689us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:52.162339 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:52.162343 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:52.162764 (+ 421us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:52.163095 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:52.163102 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:52.164180 (+ 1078us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:52.164180 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:52.165000 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:52.165002 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:52.165469 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:52.165470 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:52.165648 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:52.166198 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:52.166217 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:52.167942 (+ 1725us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:52.169853 (+ 1911us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:52.169859 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:52.169861 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:52.170082 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:52.170324 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:52.170325 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:52.170325 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:52.170423 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:52.170720 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:52.170725 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:52.170856 (+ 131us) client_negotiation.cc:769] Sending connection context
0811 08:13:52.170940 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 08:13:52.171058 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":92,"threads_started":1}
I20260811 08:13:52.171255 29796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:52.160098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:51583 (local address 127.20.158.190:34195)
0811 08:13:52.160175 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:52.160178 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:52.160453 (+ 275us) server_negotiation.cc:407] Connection header received
0811 08:13:52.162178 (+ 1725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:52.162179 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:52.162191 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:52.162254 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:52.163212 (+ 958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:52.164069 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:52.165095 (+ 1026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:52.165348 (+ 253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:52.165419 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:52.168046 (+ 2627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:52.168047 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:52.168048 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:52.168056 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:52.169758 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:52.170173 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:52.170174 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:52.170174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:52.170251 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:52.170498 (+ 247us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:52.170499 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:52.170500 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:52.170650 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:52.170725 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:52.170999 (+ 274us) server_negotiation.cc:299] Negotiation successful
0811 08:13:52.171104 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
WARNING: no policy specified for kudu/127.20.158.131@KRBTEST.COM; defaulting to no policy
I20260811 08:13:52.171788 30265 heartbeater.cc:347] Connected to a master server at 127.20.158.190:34195
I20260811 08:13:52.171904 30265 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:52.172118 30265 heartbeater.cc:511] Master 127.20.158.190:34195 requested a full tablet report, sending...
I20260811 08:13:52.172509 29697 ts_manager.cc:194] Registered new tserver with Master: c9f53a5cad084976a49c5e3bdec5b690 (127.20.158.130:40611)
I20260811 08:13:52.172951 29697 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.130@KRBTEST.COM'} at 127.20.158.130:51583
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
I20260811 08:13:52.192155 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:0
--local_ip_for_outbound_sockets=127.20.158.131
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:34195
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:38103
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:52.276227 30270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:52.276492 30270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:52.276537 30270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:52.277704 30270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:52.277789 30270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:52.277834 30270 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:13:52.279379 30270 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:38103
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:34195
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30270
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:52.279675 30270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:52.279968 30270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:13:52.285832 30270 server_base.cc:1034] running on GCE node
W20260811 08:13:52.285777 30277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:52.285766 30282 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:52.285763 30280 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:52.286242 30270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:52.286514 30270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:52.287681 30270 hybrid_clock.cc:648] HybridClock initialized: now 1786436032287669 us; error 30 us; skew 500 ppm
Aug 11 08:13:52 dist-test-slave-gkw7 krb5kdc[29628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436032, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:52.291112 30270 init.cc:377] Logged in from keytab as kudu/127.20.158.131@KRBTEST.COM (short username kudu)
I20260811 08:13:52.291720 30270 webserver.cc:460] Webserver started at http://127.20.158.131:35571/ using document root <none> and password file <none>
I20260811 08:13:52.292033 30270 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:52.292104 30270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:52.292292 30270 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:52.293424 30270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-2/data/instance:
uuid: "4db588f3fc19440faaf22dc58741f100"
format_stamp: "Formatted at 2026-08-11 08:13:52 on dist-test-slave-gkw7"
server_key: "71b6169c24596205475fd1b97d27b57e"
server_key_iv: "309b410d1b164e1a26d337080401cb0c"
server_key_version: "encryptionkey@0"
I20260811 08:13:52.293860 30270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance:
uuid: "4db588f3fc19440faaf22dc58741f100"
format_stamp: "Formatted at 2026-08-11 08:13:52 on dist-test-slave-gkw7"
server_key: "71b6169c24596205475fd1b97d27b57e"
server_key_iv: "309b410d1b164e1a26d337080401cb0c"
server_key_version: "encryptionkey@0"
I20260811 08:13:52.295264 30270 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:52.296042 30296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:52.296222 30270 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:13:52.296332 30270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "4db588f3fc19440faaf22dc58741f100"
format_stamp: "Formatted at 2026-08-11 08:13:52 on dist-test-slave-gkw7"
server_key: "71b6169c24596205475fd1b97d27b57e"
server_key_iv: "309b410d1b164e1a26d337080401cb0c"
server_key_version: "encryptionkey@0"
I20260811 08:13:52.296427 30270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:52.305382 30270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:52.307287 30270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:52.307461 30270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:52.307698 30270 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:52.308053 30270 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:52.308086 30270 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:52.308109 30270 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:52.308161 30270 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:52.314357 30270 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:43905
I20260811 08:13:52.314404 30477 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:43905 every 8 connection(s)
I20260811 08:13:52.314719 30270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
I20260811 08:13:52.318063 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 30270
I20260811 08:13:52.318168 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance
I20260811 08:13:52.318377 21114 external_mini_cluster.cc:1428] Setting key 5b9c3cb60e73482f6d75fb93570d9f54
Aug 11 08:13:52 dist-test-slave-gkw7 krb5kdc[29628](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436032, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:13:52.324487 29796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:52.315517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:59735 (local address 127.20.158.190:34195)
0811 08:13:52.315593 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:52.315596 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:52.315804 (+ 208us) server_negotiation.cc:407] Connection header received
0811 08:13:52.316710 (+ 906us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:52.316711 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:52.316723 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:52.316780 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:52.317418 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:52.318062 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:52.319238 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:52.319453 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:52.319545 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:52.321758 (+ 2213us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:52.321760 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:52.321761 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:52.321769 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:52.322980 (+ 1211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:52.323423 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:52.323424 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:52.323425 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:52.323492 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:52.323773 (+ 281us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:52.323774 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:52.323774 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:52.323902 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:52.324007 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:52.324309 (+ 302us) server_negotiation.cc:299] Negotiation successful
0811 08:13:52.324394 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 08:13:52.324728 30482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:52.315493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:34195 (local address 127.20.158.131:59735)
0811 08:13:52.315674 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:52.315712 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:52.316620 (+ 908us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:52.316880 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:52.316883 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:52.317143 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:52.317342 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:52.317346 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:52.318185 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:52.318186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:52.319131 (+ 945us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:52.319133 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:52.319553 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:52.319554 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:52.319693 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:52.320190 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:52.320198 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:52.321658 (+ 1460us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:52.323091 (+ 1433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:52.323098 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:52.323101 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:52.323336 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:52.323570 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:52.323571 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:52.323572 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:52.323689 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:52.323998 (+ 309us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:52.324006 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:52.324153 (+ 147us) client_negotiation.cc:769] Sending connection context
0811 08:13:52.324274 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 08:13:52.324442 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":96,"threads_started":1}
I20260811 08:13:52.325243 30478 heartbeater.cc:347] Connected to a master server at 127.20.158.190:34195
I20260811 08:13:52.325341 30478 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:52.325493 30478 heartbeater.cc:511] Master 127.20.158.190:34195 requested a full tablet report, sending...
I20260811 08:13:52.325956 29697 ts_manager.cc:194] Registered new tserver with Master: 4db588f3fc19440faaf22dc58741f100 (127.20.158.131:43905)
I20260811 08:13:52.326345 29697 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.131@KRBTEST.COM'} at 127.20.158.131:59735
I20260811 08:13:52.330206 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/test-admin.keytab.
Aug 11 08:13:52 dist-test-slave-gkw7 krb5kdc[29628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:52.347783 21114 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260811 08:13:52.349571 30497 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:52.348726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58486 (local address 127.20.158.129:39759)
0811 08:13:52.348914 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:52.348919 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:52.348930 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:13:52.348957 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:52.348959 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:52.348973 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:52.349043 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:52.349461 (+ 418us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58486: BlockingRecv error: recv got EOF from 127.0.0.1:58486 (error 108)
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":102,"threads_started":1}
W20260811 08:13:52.349704 21114 init.cc:244] Error while opening credential cache '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/krb5cc' of type FILE: Runtime error: Bad format in credentials cache (filename: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/krb5cc)
Aug 11 08:13:52 dist-test-slave-gkw7 krb5kdc[29628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:52.350718 21114 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 08:13:52 dist-test-slave-gkw7 krb5kdc[29628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:52.351658 21114 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 08:13:52 dist-test-slave-gkw7 krb5kdc[29628](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.129@KRBTEST.COM
I20260811 08:13:52.359937 30497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:52.352209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58492 (local address 127.20.158.129:39759)
0811 08:13:52.352289 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:52.352291 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:52.352301 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:13:52.352327 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:52.352328 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:52.352340 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:52.352416 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:52.352829 (+ 413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:52.353727 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:52.354476 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:52.354912 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:52.355004 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:52.357091 (+ 2087us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:52.357101 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:52.357102 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:52.357109 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:52.358664 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:52.359066 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:52.359070 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:52.359070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:52.359133 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:52.359358 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:52.359359 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:52.359359 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:52.359507 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:52.359689 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:52.359736 (+ 47us) server_negotiation.cc:299] Negotiation successful
0811 08:13:52.359817 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
W20260811 08:13:52.361860 30497 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:52.361297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58502 (local address 127.20.158.129:39759)
0811 08:13:52.361352 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:52.361355 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:52.361364 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:13:52.361430 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:52.361431 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:52.361441 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:52.361490 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:52.361812 (+ 322us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58502: BlockingRecv error: recv got EOF from 127.0.0.1:58502 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
W20260811 08:13:52.361939 21114 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/krb5cc' of type FILE
Aug 11 08:13:52 dist-test-slave-gkw7 krb5kdc[29628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:52.362870 21114 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 08:13:52 dist-test-slave-gkw7 krb5kdc[29628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:52.363718 21114 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 08:13:52 dist-test-slave-gkw7 krb5kdc[29628](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.129@KRBTEST.COM
I20260811 08:13:52.370587 30497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:52.364225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58506 (local address 127.20.158.129:39759)
0811 08:13:52.364292 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:52.364294 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:52.364319 (+ 25us) server_negotiation.cc:407] Connection header received
0811 08:13:52.364339 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:52.364339 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:52.364347 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:52.364392 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:52.364761 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:52.365239 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:52.366065 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:52.366279 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:52.366371 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:52.368292 (+ 1921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:52.368294 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:52.368294 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:52.368301 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:52.369463 (+ 1162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:52.369842 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:52.369843 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:52.369844 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:52.369901 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:52.370109 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:52.370110 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:52.370110 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:52.370209 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:52.370318 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:52.370419 (+ 101us) server_negotiation.cc:299] Negotiation successful
0811 08:13:52.370496 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260811 08:13:52.372232 30497 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:13:52.371750 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58522 (local address 127.20.158.129:39759)
0811 08:13:52.371804 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:52.371806 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:52.371814 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:13:52.371855 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:52.371856 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:52.371864 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:52.371910 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:52.372183 (+ 273us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58522: BlockingRecv error: recv got EOF from 127.0.0.1:58522 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260811 08:13:52.372334 21114 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786436003833085-21114-0/krb5kdc/krb5cc' of type FILE
Aug 11 08:13:52 dist-test-slave-gkw7 krb5kdc[29628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:52.373255 21114 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 11 08:13:52 dist-test-slave-gkw7 krb5kdc[29628](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:52.374135 21114 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 11 08:13:52 dist-test-slave-gkw7 krb5kdc[29628](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436032, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.129@KRBTEST.COM
I20260811 08:13:52.381240 30497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:52.374613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58530 (local address 127.20.158.129:39759)
0811 08:13:52.374672 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:52.374674 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:52.374697 (+ 23us) server_negotiation.cc:407] Connection header received
0811 08:13:52.374780 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:52.374780 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:52.374788 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:52.374837 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:52.375201 (+ 364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:52.375658 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:52.376371 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:52.376577 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:52.376660 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:52.378687 (+ 2027us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:52.378689 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:52.378690 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:52.378698 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:52.379998 (+ 1300us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:52.380378 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:52.380379 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:52.380379 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:52.380472 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:52.380693 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:52.380694 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:52.380695 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:52.380803 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:52.380907 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:52.381037 (+ 130us) server_negotiation.cc:299] Negotiation successful
0811 08:13:52.381117 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 08:13:52.382091 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 29820
I20260811 08:13:52.395707 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 30046
I20260811 08:13:52.411875 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 30270
I20260811 08:13:52.422859 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 29650
2026-08-11T08:13:52Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (2311 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:13:52 dist-test-slave-gkw7 krb5kdc[30520](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:13:52 dist-test-slave-gkw7 krb5kdc[30520](info): set up 2 sockets
Aug 11 08:13:52 dist-test-slave-gkw7 krb5kdc[30520](info): commencing operation
krb5kdc: starting...
W20260811 08:13:53.702373 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.253s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:13:53 dist-test-slave-gkw7 krb5kdc[30520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:13:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:13:53Z Disabled control of system clock
WARNING: no policy specified for oryx/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.190.keytab.
Entry for principal oryx/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.190.keytab.
I20260811 08:13:53.837023 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:42743
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.190.keytab
--principal=oryx/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:46827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:42743
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:53.923578 30539 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:53.923804 30539 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:53.923830 30539 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:53.925052 30539 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:53.925127 30539 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:53.925143 30539 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:53.925155 30539 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:53.925223 30539 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:13:53.926774 30539 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:46827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:42743
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.190.keytab
--principal=oryx/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:42743
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30539
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:53.927132 30539 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:53.927417 30539 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:53.933102 30546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:53.933102 30545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:53.933372 30539 server_base.cc:1034] running on GCE node
W20260811 08:13:53.933148 30548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:53.933758 30539 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:53.934103 30539 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:53.935307 30539 hybrid_clock.cc:648] HybridClock initialized: now 1786436033935279 us; error 40 us; skew 500 ppm
Aug 11 08:13:53 dist-test-slave-gkw7 krb5kdc[30520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436033, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:53.938426 30539 init.cc:377] Logged in from keytab as oryx/127.20.158.190@KRBTEST.COM (short username oryx)
I20260811 08:13:53.938938 30539 webserver.cc:460] Webserver started at http://127.20.158.190:41065/ using document root <none> and password file <none>
I20260811 08:13:53.939271 30539 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:53.939368 30539 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:53.939543 30539 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:53.940727 30539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "0c7c55b6e5de4652970c2f9776857e5d"
format_stamp: "Formatted at 2026-08-11 08:13:53 on dist-test-slave-gkw7"
server_key: "7c377dd18b035b4b8bc689ac62d1b1ad"
server_key_iv: "85aeca7a34043876de00858db14df62c"
server_key_version: "encryptionkey@0"
I20260811 08:13:53.941136 30539 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "0c7c55b6e5de4652970c2f9776857e5d"
format_stamp: "Formatted at 2026-08-11 08:13:53 on dist-test-slave-gkw7"
server_key: "7c377dd18b035b4b8bc689ac62d1b1ad"
server_key_iv: "85aeca7a34043876de00858db14df62c"
server_key_version: "encryptionkey@0"
I20260811 08:13:53.942765 30539 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260811 08:13:53.943552 30558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:53.943746 30539 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:13:53.943871 30539 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "0c7c55b6e5de4652970c2f9776857e5d"
format_stamp: "Formatted at 2026-08-11 08:13:53 on dist-test-slave-gkw7"
server_key: "7c377dd18b035b4b8bc689ac62d1b1ad"
server_key_iv: "85aeca7a34043876de00858db14df62c"
server_key_version: "encryptionkey@0"
I20260811 08:13:53.943956 30539 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:53.957522 30539 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:53.959735 30539 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:53.959937 30539 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:53.964563 30539 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:42743
I20260811 08:13:53.964632 30653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:42743 every 8 connection(s)
I20260811 08:13:53.965047 30539 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:13:53.966192 30656 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:53.968616 30656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d: Bootstrap starting.
I20260811 08:13:53.969242 30656 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:53.969589 30656 log.cc:824] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:53.970364 30656 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d: No bootstrap required, opened a new log
I20260811 08:13:53.971949 30656 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } }
I20260811 08:13:53.972091 30656 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:53.972115 30656 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c7c55b6e5de4652970c2f9776857e5d, State: Initialized, Role: FOLLOWER
I20260811 08:13:53.972314 30656 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } }
I20260811 08:13:53.972388 30656 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:13:53.972411 30656 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:13:53.972486 30656 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:53.973132 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 30539
I20260811 08:13:53.973274 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:13:53.973397 30656 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } }
I20260811 08:13:53.973515 21114 external_mini_cluster.cc:1428] Setting key 561d57fba1297161a1eca38648fb9b87
I20260811 08:13:53.973517 30656 leader_election.cc:302] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0c7c55b6e5de4652970c2f9776857e5d; no voters:
I20260811 08:13:53.973730 30656 leader_election.cc:288] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:13:53.973774 30661 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:53.973919 30661 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [term 1 LEADER]: Becoming Leader. State: Replica: 0c7c55b6e5de4652970c2f9776857e5d, State: Running, Role: LEADER
I20260811 08:13:53.974061 30656 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:53.974083 30661 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } }
I20260811 08:13:53.974658 30661 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c7c55b6e5de4652970c2f9776857e5d. Latest consensus state: current_term: 1 leader_uuid: "0c7c55b6e5de4652970c2f9776857e5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } }
I20260811 08:13:53.974663 30663 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0c7c55b6e5de4652970c2f9776857e5d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } }
I20260811 08:13:53.974764 30661 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:53.974785 30663 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:53.975001 30677 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:13:53.975589 30677 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:13:53.977254 30677 catalog_manager.cc:1347] Generated new cluster ID: 4f01a006eb6d4cb98524ade29d05c262
I20260811 08:13:53.977317 30677 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:13:53 dist-test-slave-gkw7 krb5kdc[30520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM
I20260811 08:13:53.986799 30667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:53.974268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43380 (local address 127.20.158.190:42743)
0811 08:13:53.974483 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:53.974494 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:53.974550 (+ 56us) server_negotiation.cc:407] Connection header received
0811 08:13:53.974678 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:53.974685 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:53.974746 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:53.975725 (+ 979us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:53.975839 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:53.977376 (+ 1537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:53.978468 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:53.979117 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:53.979253 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:53.982196 (+ 2943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:53.982201 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:53.982202 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:53.982215 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:53.984937 (+ 2722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:53.985403 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:53.985407 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:53.985407 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:53.985522 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:53.985765 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:53.985766 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:53.985766 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:53.986108 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:53.986267 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:53.986405 (+ 138us) server_negotiation.cc:299] Negotiation successful
0811 08:13:53.986547 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":73,"threads_started":1}
I20260811 08:13:53.993265 30677 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:13:53.994053 30677 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:13:54.004662 30677 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d: Generated new TSK 0
I20260811 08:13:54.004922 30677 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.20.158.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.158.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.158.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.129.keytab.
Entry for principal oryx/127.20.158.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.129.keytab.
I20260811 08:13:54.041071 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:0
--local_ip_for_outbound_sockets=127.20.158.129
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:42743
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.129.keytab
--principal=oryx/127.20.158.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:46827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:54.132150 30696 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:54.132365 30696 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:54.132390 30696 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:54.133621 30696 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:54.133669 30696 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:54.133697 30696 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:13:54.135201 30696 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:46827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.129.keytab
--principal=oryx/127.20.158.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:42743
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30696
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:54.135466 30696 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:54.135722 30696 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:54.141062 30712 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:54.141131 30706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:54.141088 30707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:54.141363 30696 server_base.cc:1034] running on GCE node
I20260811 08:13:54.141649 30696 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:54.141937 30696 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:54.143148 30696 hybrid_clock.cc:648] HybridClock initialized: now 1786436034143143 us; error 40 us; skew 500 ppm
Aug 11 08:13:54 dist-test-slave-gkw7 krb5kdc[30520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436034, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:54.145939 30696 init.cc:377] Logged in from keytab as oryx/127.20.158.129@KRBTEST.COM (short username oryx)
I20260811 08:13:54.146493 30696 webserver.cc:460] Webserver started at http://127.20.158.129:46179/ using document root <none> and password file <none>
I20260811 08:13:54.146759 30696 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:54.146880 30696 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:54.147055 30696 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:54.148275 30696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/data/instance:
uuid: "695df11ce5ca41f891ded65eb66c8037"
format_stamp: "Formatted at 2026-08-11 08:13:54 on dist-test-slave-gkw7"
server_key: "5eefeb00e3ab6908865c4b8a24379fe2"
server_key_iv: "8a814e6a3064cc0ea8c2b54977eca313"
server_key_version: "encryptionkey@0"
I20260811 08:13:54.148764 30696 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance:
uuid: "695df11ce5ca41f891ded65eb66c8037"
format_stamp: "Formatted at 2026-08-11 08:13:54 on dist-test-slave-gkw7"
server_key: "5eefeb00e3ab6908865c4b8a24379fe2"
server_key_iv: "8a814e6a3064cc0ea8c2b54977eca313"
server_key_version: "encryptionkey@0"
I20260811 08:13:54.150319 30696 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.004s
I20260811 08:13:54.151125 30727 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:54.151310 30696 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:13:54.151424 30696 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "695df11ce5ca41f891ded65eb66c8037"
format_stamp: "Formatted at 2026-08-11 08:13:54 on dist-test-slave-gkw7"
server_key: "5eefeb00e3ab6908865c4b8a24379fe2"
server_key_iv: "8a814e6a3064cc0ea8c2b54977eca313"
server_key_version: "encryptionkey@0"
I20260811 08:13:54.151513 30696 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:54.163727 30696 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:54.165810 30696 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:54.165980 30696 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:54.166220 30696 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:54.166553 30696 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:54.166616 30696 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:54.166659 30696 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:54.166683 30696 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:54.173489 30696 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:45099
I20260811 08:13:54.173620 30920 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:45099 every 8 connection(s)
I20260811 08:13:54.173944 30696 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:13:54.178122 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 30696
I20260811 08:13:54.178236 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance
I20260811 08:13:54.178445 21114 external_mini_cluster.cc:1428] Setting key 74c5c12ac9814322ac7661a00e1db5c8
Aug 11 08:13:54 dist-test-slave-gkw7 krb5kdc[30520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436034, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM
I20260811 08:13:54.184845 30667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:54.174787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:49231 (local address 127.20.158.190:42743)
0811 08:13:54.174832 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:54.174834 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:54.175060 (+ 226us) server_negotiation.cc:407] Connection header received
0811 08:13:54.175677 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:54.175679 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:54.175694 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:54.175768 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:54.176793 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.177303 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.178665 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.178972 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.179043 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:54.181591 (+ 2548us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:54.181593 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:54.181594 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:54.181602 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:54.183304 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:54.183760 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:54.183761 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:54.183762 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:54.183834 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:54.184112 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:54.184113 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:54.184113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:54.184272 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:54.184358 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:54.184630 (+ 272us) server_negotiation.cc:299] Negotiation successful
0811 08:13:54.184740 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 08:13:54.184871 30925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:54.174747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.20.158.129:49231)
0811 08:13:54.174918 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:54.174962 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:54.175517 (+ 555us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:54.175871 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:54.175874 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:54.176480 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:54.176702 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:54.176707 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.177399 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.177400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:54.178554 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:54.178558 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.179065 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.179066 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:54.179241 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:54.179794 (+ 553us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:54.179805 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:54.181454 (+ 1649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:54.183418 (+ 1964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:54.183425 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:54.183427 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:54.183670 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:54.183921 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:54.183921 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:54.183922 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:54.184028 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:54.184348 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:54.184353 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:54.184481 (+ 128us) client_negotiation.cc:769] Sending connection context
0811 08:13:54.184572 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 08:13:54.184700 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":99,"threads_started":1}
I20260811 08:13:54.185525 30921 heartbeater.cc:347] Connected to a master server at 127.20.158.190:42743
I20260811 08:13:54.185675 30921 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:54.185895 30921 heartbeater.cc:511] Master 127.20.158.190:42743 requested a full tablet report, sending...
I20260811 08:13:54.186528 30584 ts_manager.cc:194] Registered new tserver with Master: 695df11ce5ca41f891ded65eb66c8037 (127.20.158.129:45099)
I20260811 08:13:54.187168 30584 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.158.129@KRBTEST.COM'} at 127.20.158.129:49231
WARNING: no policy specified for oryx/127.20.158.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.158.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.158.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.130.keytab.
Entry for principal oryx/127.20.158.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.130.keytab.
I20260811 08:13:54.208685 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:0
--local_ip_for_outbound_sockets=127.20.158.130
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:42743
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.130.keytab
--principal=oryx/127.20.158.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:46827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:54.292790 30930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:54.293011 30930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:54.293036 30930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:54.294271 30930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:54.294319 30930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:54.294348 30930 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:13:54.295987 30930 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:46827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.130.keytab
--principal=oryx/127.20.158.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:42743
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30930
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:54.296250 30930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:54.296535 30930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:54.303269 30939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:54.303272 30938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:54.303340 30941 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:54.303447 30930 server_base.cc:1034] running on GCE node
I20260811 08:13:54.303785 30930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:54.303992 30930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:54.305142 30930 hybrid_clock.cc:648] HybridClock initialized: now 1786436034305132 us; error 31 us; skew 500 ppm
Aug 11 08:13:54 dist-test-slave-gkw7 krb5kdc[30520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436034, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:54.307863 30930 init.cc:377] Logged in from keytab as oryx/127.20.158.130@KRBTEST.COM (short username oryx)
I20260811 08:13:54.308367 30930 webserver.cc:460] Webserver started at http://127.20.158.130:40795/ using document root <none> and password file <none>
I20260811 08:13:54.308568 30930 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:54.308614 30930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:54.308707 30930 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:54.309808 30930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/data/instance:
uuid: "051b4710423449f3aa3321f20aeabed1"
format_stamp: "Formatted at 2026-08-11 08:13:54 on dist-test-slave-gkw7"
server_key: "d10b92f96de4f57f6275c87f7fee0b26"
server_key_iv: "c1e168c9831690e2cca7c063ce7b997b"
server_key_version: "encryptionkey@0"
I20260811 08:13:54.310139 30930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance:
uuid: "051b4710423449f3aa3321f20aeabed1"
format_stamp: "Formatted at 2026-08-11 08:13:54 on dist-test-slave-gkw7"
server_key: "d10b92f96de4f57f6275c87f7fee0b26"
server_key_iv: "c1e168c9831690e2cca7c063ce7b997b"
server_key_version: "encryptionkey@0"
I20260811 08:13:54.311450 30930 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:54.312186 30951 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:54.312505 30930 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:54.312597 30930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "051b4710423449f3aa3321f20aeabed1"
format_stamp: "Formatted at 2026-08-11 08:13:54 on dist-test-slave-gkw7"
server_key: "d10b92f96de4f57f6275c87f7fee0b26"
server_key_iv: "c1e168c9831690e2cca7c063ce7b997b"
server_key_version: "encryptionkey@0"
I20260811 08:13:54.312647 30930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:54.323688 30930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:54.325773 30930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:54.325891 30930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:54.326110 30930 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:54.326452 30930 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:54.326486 30930 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:54.326509 30930 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:54.326561 30930 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:54.332672 30930 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:35183
I20260811 08:13:54.332748 31149 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:35183 every 8 connection(s)
I20260811 08:13:54.333098 30930 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
I20260811 08:13:54.334693 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 30930
I20260811 08:13:54.334820 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance
I20260811 08:13:54.335109 21114 external_mini_cluster.cc:1428] Setting key fb21b8d347cedf55485fe25555c4210c
Aug 11 08:13:54 dist-test-slave-gkw7 krb5kdc[30520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436034, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM
I20260811 08:13:54.344774 30667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:54.333963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:51207 (local address 127.20.158.190:42743)
0811 08:13:54.334056 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:54.334059 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:54.334202 (+ 143us) server_negotiation.cc:407] Connection header received
0811 08:13:54.335029 (+ 827us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:54.335030 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:54.335040 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:54.335088 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:54.336528 (+ 1440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.337035 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.338611 (+ 1576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.338938 (+ 327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.339018 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:54.341728 (+ 2710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:54.341730 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:54.341731 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:54.341739 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:54.343290 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:54.343741 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:54.343742 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:54.343743 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:54.343803 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:54.344083 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:54.344084 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:54.344084 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:54.344205 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:54.344289 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:54.344580 (+ 291us) server_negotiation.cc:299] Negotiation successful
0811 08:13:54.344669 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":58}
I20260811 08:13:54.344946 31155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:54.333888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.20.158.130:51207)
0811 08:13:54.334050 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:54.334106 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:54.334902 (+ 796us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:54.335169 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:54.335175 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:54.336098 (+ 923us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:54.336421 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:54.336428 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.337147 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.337149 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:54.338504 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:54.338507 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.339037 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.339038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:54.339153 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:54.339748 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:54.339759 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:54.341610 (+ 1851us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:54.343385 (+ 1775us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:54.343392 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:54.343395 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:54.343624 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:54.343885 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:54.343886 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:54.343887 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:54.343998 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:54.344279 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:54.344286 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:54.344432 (+ 146us) client_negotiation.cc:769] Sending connection context
0811 08:13:54.344545 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 08:13:54.344707 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":69,"threads_started":1}
I20260811 08:13:54.345497 31150 heartbeater.cc:347] Connected to a master server at 127.20.158.190:42743
I20260811 08:13:54.345645 31150 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:54.345836 31150 heartbeater.cc:511] Master 127.20.158.190:42743 requested a full tablet report, sending...
WARNING: no policy specified for oryx/127.20.158.131@KRBTEST.COM; defaulting to no policy
I20260811 08:13:54.346339 30584 ts_manager.cc:194] Registered new tserver with Master: 051b4710423449f3aa3321f20aeabed1 (127.20.158.130:35183)
I20260811 08:13:54.346915 30584 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.158.130@KRBTEST.COM'} at 127.20.158.130:51207
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.158.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.158.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.131.keytab.
Entry for principal oryx/127.20.158.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.131.keytab.
I20260811 08:13:54.364900 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:0
--local_ip_for_outbound_sockets=127.20.158.131
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:42743
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.131.keytab
--principal=oryx/127.20.158.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:46827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:54.448132 31161 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:54.448338 31161 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:54.448361 31161 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:54.449666 31161 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:54.449708 31161 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:54.449735 31161 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:13:54.451121 31161 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:46827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.131.keytab
--principal=oryx/127.20.158.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:42743
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31161
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:54.451316 31161 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:54.451484 31161 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:54.456840 31168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:54.456804 31171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:54.456815 31167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:54.457113 31161 server_base.cc:1034] running on GCE node
I20260811 08:13:54.457343 31161 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:54.457631 31161 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:54.458760 31161 hybrid_clock.cc:648] HybridClock initialized: now 1786436034458734 us; error 39 us; skew 500 ppm
Aug 11 08:13:54 dist-test-slave-gkw7 krb5kdc[30520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436034, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:54.461344 31161 init.cc:377] Logged in from keytab as oryx/127.20.158.131@KRBTEST.COM (short username oryx)
I20260811 08:13:54.461907 31161 webserver.cc:460] Webserver started at http://127.20.158.131:43035/ using document root <none> and password file <none>
I20260811 08:13:54.462167 31161 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:54.462250 31161 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:54.462416 31161 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:54.463447 31161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/data/instance:
uuid: "bc0425573d80435b8fd3087778815fb4"
format_stamp: "Formatted at 2026-08-11 08:13:54 on dist-test-slave-gkw7"
server_key: "0ba646a00bb48a767d444e5d306ef19b"
server_key_iv: "dc27e539cf2892af76884c63dff390e9"
server_key_version: "encryptionkey@0"
I20260811 08:13:54.463826 31161 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance:
uuid: "bc0425573d80435b8fd3087778815fb4"
format_stamp: "Formatted at 2026-08-11 08:13:54 on dist-test-slave-gkw7"
server_key: "0ba646a00bb48a767d444e5d306ef19b"
server_key_iv: "dc27e539cf2892af76884c63dff390e9"
server_key_version: "encryptionkey@0"
I20260811 08:13:54.465205 31161 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:13:54.466176 31181 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:54.466396 31161 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:13:54.466511 31161 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "bc0425573d80435b8fd3087778815fb4"
format_stamp: "Formatted at 2026-08-11 08:13:54 on dist-test-slave-gkw7"
server_key: "0ba646a00bb48a767d444e5d306ef19b"
server_key_iv: "dc27e539cf2892af76884c63dff390e9"
server_key_version: "encryptionkey@0"
I20260811 08:13:54.466598 31161 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:54.488909 31161 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:54.491678 31161 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:54.491863 31161 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:54.492118 31161 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:54.492449 31161 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:54.492509 31161 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:54.492549 31161 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:54.492584 31161 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:54.498739 31161 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:36963
I20260811 08:13:54.498778 31364 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:36963 every 8 connection(s)
I20260811 08:13:54.499104 31161 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
I20260811 08:13:54.500376 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 31161
I20260811 08:13:54.500484 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance
I20260811 08:13:54.500666 21114 external_mini_cluster.cc:1428] Setting key 218c6c8a219ea05c576e64771a44dbb1
Aug 11 08:13:54 dist-test-slave-gkw7 krb5kdc[30520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436034, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM
I20260811 08:13:54.508963 30667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:54.499840 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:38107 (local address 127.20.158.190:42743)
0811 08:13:54.499926 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:54.499928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:54.500124 (+ 196us) server_negotiation.cc:407] Connection header received
0811 08:13:54.500891 (+ 767us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:54.500892 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:54.500907 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:54.500956 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:54.502109 (+ 1153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.502624 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.503706 (+ 1082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.503917 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.504015 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:54.506362 (+ 2347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:54.506363 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:54.506363 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:54.506370 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:54.507799 (+ 1429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:54.508150 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:54.508151 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:54.508151 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:54.508203 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:54.508420 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:54.508420 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:54.508421 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:54.508521 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:54.508572 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:54.508836 (+ 264us) server_negotiation.cc:299] Negotiation successful
0811 08:13:54.508899 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 08:13:54.509151 31368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:54.499811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.20.158.131:38107)
0811 08:13:54.499973 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:54.500014 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:54.500780 (+ 766us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:54.501027 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:54.501031 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:54.501807 (+ 776us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:54.502000 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:54.502005 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.502732 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.502733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:54.503604 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:54.503606 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.504026 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.504027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:54.504156 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:54.504705 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:54.504729 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:54.506270 (+ 1541us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:54.507874 (+ 1604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:54.507879 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:54.507881 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:54.508084 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:54.508266 (+ 182us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:54.508267 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:54.508267 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:54.508362 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:54.508581 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:54.508600 (+ 19us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:54.508714 (+ 114us) client_negotiation.cc:769] Sending connection context
0811 08:13:54.508802 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 08:13:54.508918 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":89,"threads_started":1}
I20260811 08:13:54.509691 31365 heartbeater.cc:347] Connected to a master server at 127.20.158.190:42743
I20260811 08:13:54.509778 31365 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:54.509918 31365 heartbeater.cc:511] Master 127.20.158.190:42743 requested a full tablet report, sending...
I20260811 08:13:54.510286 30584 ts_manager.cc:194] Registered new tserver with Master: bc0425573d80435b8fd3087778815fb4 (127.20.158.131:36963)
I20260811 08:13:54.510668 30584 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.158.131@KRBTEST.COM'} at 127.20.158.131:38107
I20260811 08:13:54.512349 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.20.158.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.158.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.158.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.189.keytab.
Entry for principal oryx/127.20.158.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.189.keytab.
I20260811 08:13:54.541381 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.189:37887
--webserver_interface=127.20.158.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.189.keytab
--principal=oryx/127.20.158.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:46827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:42743,127.20.158.189:37887
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:54.629719 31371 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:54.629935 31371 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:54.629957 31371 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:54.631040 31371 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:54.631078 31371 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:54.631091 31371 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:54.631109 31371 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:54.631121 31371 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:13:54.632524 31371 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:46827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:42743,127.20.158.189:37887
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.189.keytab
--principal=oryx/127.20.158.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.189:37887
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.158.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31371
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
W20260811 08:13:54.632633 31371 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.20.158.190:42743,127.20.158.189:37887'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260811 08:13:54.632746 31371 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:54.632918 31371 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:54.638399 31381 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:54.638541 31371 server_base.cc:1034] running on GCE node
W20260811 08:13:54.638406 31386 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:54.638670 31378 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:54.638926 31371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:54.639179 31371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:54.640396 31371 hybrid_clock.cc:648] HybridClock initialized: now 1786436034640398 us; error 44 us; skew 500 ppm
Aug 11 08:13:54 dist-test-slave-gkw7 krb5kdc[30520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436034, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:54.643187 31371 init.cc:377] Logged in from keytab as oryx/127.20.158.189@KRBTEST.COM (short username oryx)
I20260811 08:13:54.643708 31371 webserver.cc:460] Webserver started at http://127.20.158.189:45219/ using document root <none> and password file <none>
I20260811 08:13:54.643944 31371 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:54.644017 31371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:54.644189 31371 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:54.645274 31371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-1/data/instance:
uuid: "a8b7920051704b6789caa713e738bd9d"
format_stamp: "Formatted at 2026-08-11 08:13:54 on dist-test-slave-gkw7"
server_key: "9661c07ec5fd8596d3a91ab4209e1e6d"
server_key_iv: "b4cdca153641fb2b5f0c640367de8b5f"
server_key_version: "encryptionkey@0"
I20260811 08:13:54.645746 31371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-1/wal/instance:
uuid: "a8b7920051704b6789caa713e738bd9d"
format_stamp: "Formatted at 2026-08-11 08:13:54 on dist-test-slave-gkw7"
server_key: "9661c07ec5fd8596d3a91ab4209e1e6d"
server_key_iv: "b4cdca153641fb2b5f0c640367de8b5f"
server_key_version: "encryptionkey@0"
I20260811 08:13:54.647297 31371 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:13:54.648156 31398 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:54.648377 31371 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:13:54.648455 31371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-1/wal
uuid: "a8b7920051704b6789caa713e738bd9d"
format_stamp: "Formatted at 2026-08-11 08:13:54 on dist-test-slave-gkw7"
server_key: "9661c07ec5fd8596d3a91ab4209e1e6d"
server_key_iv: "b4cdca153641fb2b5f0c640367de8b5f"
server_key_version: "encryptionkey@0"
I20260811 08:13:54.648546 31371 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:54.678496 31371 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:54.680598 31371 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:54.680766 31371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:54.685266 31371 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.189:37887
I20260811 08:13:54.685338 31481 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.189:37887 every 8 connection(s)
I20260811 08:13:54.685740 31371 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-1/data/info.pb
I20260811 08:13:54.686828 31482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:54.687790 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 31371
I20260811 08:13:54.688988 31482 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:13:54 dist-test-slave-gkw7 krb5kdc[30520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436034, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.189@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM
Aug 11 08:13:54 dist-test-slave-gkw7 krb5kdc[30520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.158.189@KRBTEST.COM
I20260811 08:13:54.699420 30667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:54.690178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43394 (local address 127.20.158.190:42743)
0811 08:13:54.690278 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:54.690281 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:54.690422 (+ 141us) server_negotiation.cc:407] Connection header received
0811 08:13:54.690473 (+ 51us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:54.690474 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:54.690484 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:54.690533 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:54.691158 (+ 625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.691706 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.692714 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.692933 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.693027 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:54.695459 (+ 2432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:54.695461 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:54.695461 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:54.695471 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:54.697386 (+ 1915us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:54.698136 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:54.698137 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:54.698138 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:54.698205 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:54.698511 (+ 306us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:54.698512 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:54.698512 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:54.698788 (+ 276us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:54.698856 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:54.699194 (+ 338us) server_negotiation.cc:299] Negotiation successful
0811 08:13:54.699295 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260811 08:13:54.699576 31486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:54.690100 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.0.0.1:43394)
0811 08:13:54.690305 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:54.690345 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:54.690415 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:54.690578 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:54.690582 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:54.690933 (+ 351us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:54.691052 (+ 119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:54.691057 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.691851 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.691852 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:54.692590 (+ 738us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:54.692592 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.693036 (+ 444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.693037 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:54.693133 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:54.693710 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:54.693719 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:54.695290 (+ 1571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:54.697479 (+ 2189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:54.697484 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:54.697487 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:54.697983 (+ 496us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:54.698283 (+ 300us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:54.698284 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:54.698284 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:54.698424 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:54.698871 (+ 447us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:54.698876 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:54.699034 (+ 158us) client_negotiation.cc:769] Sending connection context
0811 08:13:54.699132 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 08:13:54.699306 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"mutex_wait_us":6,"thread_start_us":131,"threads_started":1}
I20260811 08:13:54.699828 31485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:54.688625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46374 (local address 127.20.158.189:37887)
0811 08:13:54.688810 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:54.688821 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:54.688855 (+ 34us) server_negotiation.cc:407] Connection header received
0811 08:13:54.689272 (+ 417us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:54.689279 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:54.689328 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:54.689445 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:54.690297 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.691521 (+ 1224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.692277 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.692730 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.692890 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:54.695983 (+ 3093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:54.695995 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:54.695995 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:54.696002 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:54.698006 (+ 2004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:54.698452 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:54.698456 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:54.698456 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:54.698515 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:54.698761 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:54.698762 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:54.698762 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:54.699040 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:54.699192 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:54.699327 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 08:13:54.699391 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":45,"server-negotiator.queue_time_us":136,"thread_start_us":96,"threads_started":1}
I20260811 08:13:54.700400 31482 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:13:54 dist-test-slave-gkw7 krb5kdc[30520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436034, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.189@KRBTEST.COM for oryx/127.20.158.189@KRBTEST.COM
I20260811 08:13:54.706949 31486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:54.700732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:37887 (local address 127.0.0.1:46384)
0811 08:13:54.700765 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:54.700775 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:54.700811 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:54.700906 (+ 95us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:54.700907 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:54.701030 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:54.701066 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:54.701067 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.701747 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.701748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:54.702306 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:54.702308 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.702641 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.702642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:54.702697 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:54.703057 (+ 360us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:54.703061 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:54.704256 (+ 1195us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:54.705983 (+ 1727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:54.705983 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:54.705984 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:54.706145 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:54.706428 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:54.706428 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:54.706428 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:54.706480 (+ 52us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:54.706719 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:54.706720 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:54.706754 (+ 34us) client_negotiation.cc:769] Sending connection context
0811 08:13:54.706810 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 08:13:54.706883 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16}
I20260811 08:13:54.707177 31485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:54.700764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46384 (local address 127.20.158.189:37887)
0811 08:13:54.700799 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:54.700801 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:54.700810 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:13:54.700852 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:54.700853 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:54.700861 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:54.700904 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:54.701127 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.701670 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.702382 (+ 712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.702569 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.702623 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:54.704367 (+ 1744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:54.704369 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:54.704369 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:54.704375 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:54.705898 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:54.706277 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:54.706278 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:54.706278 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:54.706341 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:54.706544 (+ 203us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:54.706545 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:54.706545 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:54.706659 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:54.706717 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:54.706859 (+ 142us) server_negotiation.cc:299] Negotiation successful
0811 08:13:54.706936 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":14}
I20260811 08:13:54.708593 31482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d: Bootstrap starting.
I20260811 08:13:54.709511 31482 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:54.709831 31482 log.cc:824] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:54.710592 31482 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d: No bootstrap required, opened a new log
I20260811 08:13:54.711951 31482 raft_consensus.cc:348] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } }
I20260811 08:13:54.712075 31482 raft_consensus.cc:374] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:54.712097 31482 raft_consensus.cc:729] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8b7920051704b6789caa713e738bd9d, State: Initialized, Role: FOLLOWER
I20260811 08:13:54.712237 31482 consensus_queue.cc:260] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } }
I20260811 08:13:54.712605 31482 sys_catalog.cc:564] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:54.712563 31491 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } } }
I20260811 08:13:54.712669 31491 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [sys.catalog]: This master's current role is: FOLLOWER
W20260811 08:13:54.714671 31504 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:13:54.714793 31504 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:13:54.716670 31371 master_runner.cc:428] Detected that this master a8b7920051704b6789caa713e738bd9d is joining an existing cluster
I20260811 08:13:54.716764 31371 master_runner.cc:432] Initiating AddMaster RPC to add 127.20.158.189:37887
I20260811 08:13:54.725004 30667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:54.717993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43402 (local address 127.20.158.190:42743)
0811 08:13:54.718036 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:54.718038 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:54.718215 (+ 177us) server_negotiation.cc:407] Connection header received
0811 08:13:54.718297 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:54.718298 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:54.718311 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:54.718371 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:54.718790 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.719299 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.720069 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.720269 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.720355 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:54.721636 (+ 1281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:54.721638 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:54.721638 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:54.721646 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:54.723545 (+ 1899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:54.724057 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:54.724059 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:54.724060 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:54.724116 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:54.724365 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:54.724367 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:54.724367 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:54.724517 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:54.724567 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:54.724811 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 08:13:54.724907 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:13:54.725013 31513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:54.717941 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.0.0.1:43402)
0811 08:13:54.718136 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:54.718146 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:54.718232 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:54.718376 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:54.718377 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:54.718614 (+ 237us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:54.718709 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:54.718711 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.719393 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.719394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:54.719974 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:54.719976 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.720355 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.720356 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:54.720423 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:54.720936 (+ 513us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:54.720941 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:54.721271 (+ 330us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:54.723647 (+ 2376us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:54.723648 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:54.723648 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:54.723988 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:54.724197 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:54.724198 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:54.724198 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:54.724272 (+ 74us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:54.724621 (+ 349us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:54.724623 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:54.724675 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 08:13:54.724768 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 08:13:54.724885 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":103,"threads_started":1}
I20260811 08:13:54.725077 31485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:54.718254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46398 (local address 127.20.158.189:37887)
0811 08:13:54.718304 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:54.718306 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:54.718502 (+ 196us) server_negotiation.cc:407] Connection header received
0811 08:13:54.718527 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:54.718527 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:54.718538 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:54.718594 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:54.718969 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.719677 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.720730 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.721018 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.721058 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:54.722176 (+ 1118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:54.722178 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:54.722178 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:54.722186 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:54.723904 (+ 1718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:54.724267 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:54.724269 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:54.724269 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:54.724318 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:54.724534 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:54.724535 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:54.724535 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:54.724650 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:54.724729 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:54.724881 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 08:13:54.724946 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 08:13:54.725406 31514 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:54.718295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:37887 (local address 127.0.0.1:46398)
0811 08:13:54.718418 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:54.718427 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:54.718488 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:54.718599 (+ 111us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:54.718599 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:54.718815 (+ 216us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:54.718882 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:54.718883 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.719778 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.719779 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:54.720636 (+ 857us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:54.720638 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.721125 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.721126 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:54.721185 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:54.721634 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:54.721639 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:54.722063 (+ 424us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:54.723987 (+ 1924us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:54.723988 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:54.723988 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:54.724216 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:54.724399 (+ 183us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:54.724400 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:54.724400 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:54.724457 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:54.724733 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:54.724734 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:54.724775 (+ 41us) client_negotiation.cc:769] Sending connection context
0811 08:13:54.725028 (+ 253us) client_negotiation.cc:240] Negotiation successful
0811 08:13:54.725326 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":63,"threads_started":1}
Aug 11 08:13:54 dist-test-slave-gkw7 krb5kdc[30520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436033, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.190@KRBTEST.COM for oryx/127.20.158.189@KRBTEST.COM
I20260811 08:13:54.736166 31485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:54.728322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46410 (local address 127.20.158.189:37887)
0811 08:13:54.728362 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:54.728364 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:54.728482 (+ 118us) server_negotiation.cc:407] Connection header received
0811 08:13:54.728583 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:54.728584 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:54.728591 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:54.728635 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:54.729188 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.729746 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.730887 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.731061 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.731114 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:54.733401 (+ 2287us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:54.733407 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:54.733408 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:54.733414 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:54.734862 (+ 1448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:54.735291 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:54.735292 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:54.735293 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:54.735356 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:54.735575 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:54.735576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:54.735576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:54.735692 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:54.735777 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:54.735972 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 08:13:54.736055 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:13:54.736182 31515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:54.728190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:37887 (local address 127.0.0.1:46410)
0811 08:13:54.728382 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:54.728429 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:54.728509 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:54.728649 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:54.728652 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:54.729004 (+ 352us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:54.729068 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:54.729071 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.729835 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.729836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:54.730799 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:54.730802 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.731146 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.731148 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:54.731237 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:54.731674 (+ 437us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:54.731680 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:54.733245 (+ 1565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:54.734974 (+ 1729us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:54.734983 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:54.734985 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:54.735206 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:54.735433 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:54.735435 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:54.735435 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:54.735505 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:54.735770 (+ 265us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:54.735779 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:54.735836 (+ 57us) client_negotiation.cc:769] Sending connection context
0811 08:13:54.735944 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 08:13:54.736071 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":112,"threads_started":1}
I20260811 08:13:54.736876 30584 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.20.158.189:37887: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "a8b7920051704b6789caa713e738bd9d"
member_type: NON_VOTER
last_known_addr {
host: "127.20.158.189"
port: 37887
}
attrs {
promote: true
}
}
dest_uuid: "0c7c55b6e5de4652970c2f9776857e5d"
cas_config_opid_index: -1
I20260811 08:13:54.737315 30584 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: NON_VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: true } }
I20260811 08:13:54.737922 31518 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER a8b7920051704b6789caa713e738bd9d (127.20.158.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: NON_VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: true } } }
I20260811 08:13:54.738216 31444 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:54.738952 31444 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 1 FOLLOWER]: Refusing update from remote peer 0c7c55b6e5de4652970c2f9776857e5d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260811 08:13:54.739007 31518 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.20.158.189:37887
I20260811 08:13:54.739090 31518 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "0c7c55b6e5de4652970c2f9776857e5d" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: NON_VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: true } } }
I20260811 08:13:54.739146 31518 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:54.739391 31371 master.cc:537] Master@127.20.158.189:37887 shutting down...
I20260811 08:13:54.739588 31516 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: NON_VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 08:13:54.740401 30559 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260811 08:13:54.740863 30559 consensus_peers.cc:487] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d -> Peer a8b7920051704b6789caa713e738bd9d (127.20.158.189:37887): Couldn't send request to peer a8b7920051704b6789caa713e738bd9d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 08:13:54.742805 31371 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:13:54.742901 31371 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:54.742954 31371 tablet_replica.cc:330] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d: stopping tablet replica
I20260811 08:13:54.755681 31371 master.cc:552] Master@127.20.158.189:37887 shutdown complete.
I20260811 08:13:54.755745 31371 master_runner.cc:305] Clearing existing system tablet
I20260811 08:13:54.755893 31371 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:54.755947 31371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:54.756703 31371 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:54.757702 31524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:54.757922 31371 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:54.757994 31371 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:13:54.758023 31371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-1/wal
uuid: "a8b7920051704b6789caa713e738bd9d"
format_stamp: "Formatted at 2026-08-11 08:13:54 on dist-test-slave-gkw7"
server_key: "9661c07ec5fd8596d3a91ab4209e1e6d"
server_key_iv: "b4cdca153641fb2b5f0c640367de8b5f"
server_key_version: "encryptionkey@0"
I20260811 08:13:54.759075 31371 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:13:54.760653 31371 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 08:13:54.760730 31371 log.cc:1196] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260811 08:13:54.760967 31371 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d: Deleting consensus metadata
I20260811 08:13:54.761097 31371 master_runner.cc:315] Copying system tablet from 127.20.158.190:42743
I20260811 08:13:54.761899 31371 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d: tablet copy: Beginning tablet copy session from remote peer at address 127.20.158.190:42743
I20260811 08:13:54.769032 31535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:54.762275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.0.0.1:43418)
0811 08:13:54.762418 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:54.762429 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:54.762499 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:54.762668 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:54.762669 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:54.762830 (+ 161us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:54.762887 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:54.762889 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.763849 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.763850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:54.764409 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:54.764410 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.764886 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.764887 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:54.764936 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:54.765439 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:54.765444 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:54.765816 (+ 372us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:54.767775 (+ 1959us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:54.767776 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:54.767776 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:54.767971 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:54.768210 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:54.768210 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:54.768211 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:54.768275 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:54.768690 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:54.768692 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:54.768750 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 08:13:54.768845 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 08:13:54.768946 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":101,"threads_started":1}
I20260811 08:13:54.769078 30667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:54.762372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43418 (local address 127.20.158.190:42743)
0811 08:13:54.762429 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:54.762431 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:54.762500 (+ 69us) server_negotiation.cc:407] Connection header received
0811 08:13:54.762573 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:54.762575 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:54.762586 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:54.762645 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:54.762962 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.763754 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.764495 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.764807 (+ 312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.764879 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:54.765907 (+ 1028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:54.765910 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:54.765910 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:54.765917 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:54.767646 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:54.768060 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:54.768061 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:54.768062 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:54.768130 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:54.768347 (+ 217us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:54.768348 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:54.768348 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:54.768489 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:54.768611 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:54.768894 (+ 283us) server_negotiation.cc:299] Negotiation successful
0811 08:13:54.768983 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 08:13:54.769579 30626 tablet_copy_service.cc:140] P 0c7c55b6e5de4652970c2f9776857e5d: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer a8b7920051704b6789caa713e738bd9d ({username='oryx', principal='oryx/127.20.158.189@KRBTEST.COM'} at 127.0.0.1:43418)
I20260811 08:13:54.769769 30626 tablet_copy_service.cc:161] P 0c7c55b6e5de4652970c2f9776857e5d: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer a8b7920051704b6789caa713e738bd9d at {username='oryx', principal='oryx/127.20.158.189@KRBTEST.COM'} at 127.0.0.1:43418: session id = a8b7920051704b6789caa713e738bd9d-00000000000000000000000000000000
I20260811 08:13:54.770624 30626 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 08:13:54.771394 31371 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 08:13:54.772823 31371 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d: tablet copy: Starting download of 0 data blocks...
I20260811 08:13:54.772984 31371 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d: tablet copy: Starting download of 1 WAL segments...
I20260811 08:13:54.774348 31371 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 08:13:54.775349 30626 tablet_copy_service.cc:342] P 0c7c55b6e5de4652970c2f9776857e5d: Request end of tablet copy session a8b7920051704b6789caa713e738bd9d-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.20.158.189@KRBTEST.COM'} at 127.0.0.1:43418
I20260811 08:13:54.775421 30626 tablet_copy_service.cc:433] P 0c7c55b6e5de4652970c2f9776857e5d: ending tablet copy session a8b7920051704b6789caa713e738bd9d-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer a8b7920051704b6789caa713e738bd9d
I20260811 08:13:54.778791 31371 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:54.780191 31538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:54.780211 31536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:54.780488 31542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:54.780515 31371 server_base.cc:1034] running on GCE node
I20260811 08:13:54.780638 31371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:54.780800 31371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:54.781953 31371 hybrid_clock.cc:648] HybridClock initialized: now 1786436034781945 us; error 33 us; skew 500 ppm
Aug 11 08:13:54 dist-test-slave-gkw7 krb5kdc[30520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436034, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:54.783618 31371 init.cc:377] Logged in from keytab as oryx/127.20.158.189@KRBTEST.COM (short username oryx)
I20260811 08:13:54.783984 31371 webserver.cc:460] Webserver started at http://127.20.158.189:43379/ using document root <none> and password file <none>
I20260811 08:13:54.784163 31371 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:54.784224 31371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:54.785001 31371 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:54.785719 31554 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:54.785881 31371 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:13:54.785971 31371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-1/wal
uuid: "a8b7920051704b6789caa713e738bd9d"
format_stamp: "Formatted at 2026-08-11 08:13:54 on dist-test-slave-gkw7"
server_key: "9661c07ec5fd8596d3a91ab4209e1e6d"
server_key_iv: "b4cdca153641fb2b5f0c640367de8b5f"
server_key_version: "encryptionkey@0"
I20260811 08:13:54.786091 31371 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:54.796470 31371 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:54.798712 31371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:54.802736 31371 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.189:37887
I20260811 08:13:54.802933 31639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.189:37887 every 8 connection(s)
I20260811 08:13:54.803193 31371 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-1/data/info.pb
I20260811 08:13:54.804312 31640 sys_catalog.cc:263] Verifying existing consensus state
I20260811 08:13:54.804901 31640 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d: Bootstrap starting.
I20260811 08:13:54.808277 31640 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:13:54.808557 31640 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d: Bootstrap complete.
I20260811 08:13:54.808804 31640 raft_consensus.cc:348] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: NON_VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: true } }
I20260811 08:13:54.808900 31640 raft_consensus.cc:729] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a8b7920051704b6789caa713e738bd9d, State: Initialized, Role: LEARNER
I20260811 08:13:54.808944 31640 consensus_queue.cc:260] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: NON_VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: true } }
I20260811 08:13:54.809131 31640 sys_catalog.cc:564] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:54.809149 31645 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: NON_VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: true } } }
I20260811 08:13:54.809291 31645 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [sys.catalog]: This master's current role is: LEARNER
I20260811 08:13:54.810832 31664 catalog_manager.cc:1259] Loaded cluster ID: 4f01a006eb6d4cb98524ade29d05c262
I20260811 08:13:54.810892 31664 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d: loading cluster ID for follower catalog manager: success
I20260811 08:13:54.812016 31664 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d: acquiring CA information for follower catalog manager: success
I20260811 08:13:54.812420 31664 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 08:13:54.861708 31665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:54.852417 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46436 (local address 127.20.158.189:37887)
0811 08:13:54.852566 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:54.852569 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:54.852708 (+ 139us) server_negotiation.cc:407] Connection header received
0811 08:13:54.852743 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:54.852744 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:54.852759 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:54.853694 (+ 935us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:54.853768 (+ 74us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.854984 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.856136 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:54.856462 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:54.858160 (+ 1698us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:54.858214 (+ 54us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:54.858215 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:54.858215 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:54.858220 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:54.860093 (+ 1873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:54.860511 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:54.860512 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:54.860513 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:54.860591 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:54.860799 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:54.860800 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:54.860800 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:54.860929 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:54.861411 (+ 482us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:54.861456 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 08:13:54.861556 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":86,"threads_started":1}
WARNING: no policy specified for oryx/127.20.158.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.158.188@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.158.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.188.keytab.
Entry for principal oryx/127.20.158.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.188.keytab.
I20260811 08:13:54.901050 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.188:36775
--webserver_interface=127.20.158.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.188.keytab
--principal=oryx/127.20.158.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:46827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:42743,127.20.158.189:37887,127.20.158.188:36775
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:55.009941 31671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:55.010226 31671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:55.010253 31671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:55.011588 31671 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:13:55.011633 31671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:55.011649 31671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:55.011664 31671 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:13:55.011678 31671 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:13:55.013283 31671 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:46827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:42743,127.20.158.189:37887,127.20.158.188:36775
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.188.keytab
--principal=oryx/127.20.158.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.188:36775
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.158.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:55.013504 31671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:55.013803 31671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:55.018988 31681 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:55.019063 31671 server_base.cc:1034] running on GCE node
W20260811 08:13:55.018996 31688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:55.018997 31682 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:55.019649 31671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:55.019933 31671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:55.021090 31671 hybrid_clock.cc:648] HybridClock initialized: now 1786436035021077 us; error 31 us; skew 500 ppm
Aug 11 08:13:55 dist-test-slave-gkw7 krb5kdc[30520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:55.024326 31671 init.cc:377] Logged in from keytab as oryx/127.20.158.188@KRBTEST.COM (short username oryx)
I20260811 08:13:55.024822 31671 webserver.cc:460] Webserver started at http://127.20.158.188:36393/ using document root <none> and password file <none>
I20260811 08:13:55.025139 31671 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:55.025229 31671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:55.025396 31671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:13:55.026660 31671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-2/data/instance:
uuid: "4a4168ab51744a179ae43449d338fa23"
format_stamp: "Formatted at 2026-08-11 08:13:55 on dist-test-slave-gkw7"
server_key: "2d90006ba90faf2fd8cd87db35383122"
server_key_iv: "385dd647756bd8121b288dd6e79300cc"
server_key_version: "encryptionkey@0"
I20260811 08:13:55.027066 31671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-2/wal/instance:
uuid: "4a4168ab51744a179ae43449d338fa23"
format_stamp: "Formatted at 2026-08-11 08:13:55 on dist-test-slave-gkw7"
server_key: "2d90006ba90faf2fd8cd87db35383122"
server_key_iv: "385dd647756bd8121b288dd6e79300cc"
server_key_version: "encryptionkey@0"
I20260811 08:13:55.028564 31671 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:13:55.029508 31699 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:55.029748 31671 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:55.029868 31671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-2/wal
uuid: "4a4168ab51744a179ae43449d338fa23"
format_stamp: "Formatted at 2026-08-11 08:13:55 on dist-test-slave-gkw7"
server_key: "2d90006ba90faf2fd8cd87db35383122"
server_key_iv: "385dd647756bd8121b288dd6e79300cc"
server_key_version: "encryptionkey@0"
I20260811 08:13:55.029963 31671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:55.042883 31671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:55.045099 31671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:55.045295 31671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:55.050451 31671 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.188:36775
I20260811 08:13:55.050586 31785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.188:36775 every 8 connection(s)
I20260811 08:13:55.050926 31671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-2/data/info.pb
I20260811 08:13:55.051983 31786 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:55.053653 31786 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:13:55.059526 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 31671
Aug 11 08:13:55 dist-test-slave-gkw7 krb5kdc[30520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.188@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM
I20260811 08:13:55.063687 30667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.054505 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43422 (local address 127.20.158.190:42743)
0811 08:13:55.054621 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.054623 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.054810 (+ 187us) server_negotiation.cc:407] Connection header received
0811 08:13:55.055371 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.055372 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.055386 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.055447 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:55.056329 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.056829 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.057975 (+ 1146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.058179 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.058272 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.060645 (+ 2373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:55.060647 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:55.060648 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:55.060656 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:55.062202 (+ 1546us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.062667 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.062669 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.062669 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.062733 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.063006 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.063007 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.063008 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.063135 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:55.063221 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.063508 (+ 287us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.063591 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260811 08:13:55.063930 31790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.054402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.0.0.1:43422)
0811 08:13:55.054679 (+ 277us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.054716 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:55.055251 (+ 535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:55.055521 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:55.055524 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:55.055857 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:55.056208 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.056213 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.056944 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.056949 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.057868 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.057871 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.058327 (+ 456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.058328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.058444 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.058927 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:55.058936 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:55.060531 (+ 1595us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:55.062316 (+ 1785us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.062323 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.062326 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.062557 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.062808 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.062809 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.062809 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.062924 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.063211 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:55.063218 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:55.063365 (+ 147us) client_negotiation.cc:769] Sending connection context
0811 08:13:55.063484 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 08:13:55.063650 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":129,"threads_started":1}
I20260811 08:13:55.064577 31786 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:13:55 dist-test-slave-gkw7 krb5kdc[30520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436033, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.158.188@KRBTEST.COM
Aug 11 08:13:55 dist-test-slave-gkw7 krb5kdc[30520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.188@KRBTEST.COM for oryx/127.20.158.189@KRBTEST.COM
I20260811 08:13:55.069749 31793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.060212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49290 (local address 127.20.158.188:36775)
0811 08:13:55.060424 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.060430 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.060454 (+ 24us) server_negotiation.cc:407] Connection header received
0811 08:13:55.060477 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.060479 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.060508 (+ 29us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.060612 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:55.061257 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.062072 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.062829 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.063155 (+ 326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.063260 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.066343 (+ 3083us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:55.066350 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:55.066350 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:55.066356 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:55.068207 (+ 1851us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.068709 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.068713 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.068714 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.068786 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.069002 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.069003 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.069003 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.069206 (+ 203us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:55.069391 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.069496 (+ 105us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.069612 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":96,"threads_started":1}
I20260811 08:13:55.072177 31790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.064893 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:37887 (local address 127.0.0.1:46448)
0811 08:13:55.064957 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.064968 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:55.065012 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:55.065279 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:55.065280 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:55.065436 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:55.065495 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.065496 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.066311 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.066312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.066868 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.066870 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.067385 (+ 515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.067387 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.067471 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.067820 (+ 349us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:55.067825 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:55.069421 (+ 1596us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:55.071368 (+ 1947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.071369 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.071369 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.071530 (+ 161us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.071731 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.071731 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.071731 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.071782 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.071970 (+ 188us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:55.071971 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:55.072004 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 08:13:55.072050 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 08:13:55.072120 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 08:13:55.072221 31665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.065003 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46448 (local address 127.20.158.189:37887)
0811 08:13:55.065097 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.065099 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.065112 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:13:55.065143 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.065144 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.065162 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.065251 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:55.065623 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.066194 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.066963 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.067297 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.067375 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.069508 (+ 2133us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:55.069510 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:55.069510 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:55.069518 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:55.071292 (+ 1774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.071604 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.071605 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.071605 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.071666 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.071823 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.071823 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.071824 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.071918 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:55.071969 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.072079 (+ 110us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.072158 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260811 08:13:55.072748 31786 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.188" port: 36775 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:13:55 dist-test-slave-gkw7 krb5kdc[30520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.188@KRBTEST.COM for oryx/127.20.158.188@KRBTEST.COM
I20260811 08:13:55.079074 31790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.073030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:36775 (local address 127.0.0.1:49300)
0811 08:13:55.073072 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.073081 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:55.073114 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:55.073291 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:55.073292 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:55.073421 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:55.073445 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.073446 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.074181 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.074182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.074645 (+ 463us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.074646 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.075083 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.075084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.075130 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.075480 (+ 350us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:55.075484 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:55.076519 (+ 1035us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:55.078053 (+ 1534us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.078054 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.078054 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.078219 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.078440 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.078441 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.078441 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.078494 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.078764 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:55.078765 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:55.078802 (+ 37us) client_negotiation.cc:769] Sending connection context
0811 08:13:55.078865 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 08:13:55.078963 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 08:13:55.079133 31793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.073106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49300 (local address 127.20.158.188:36775)
0811 08:13:55.073181 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.073182 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.073189 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:13:55.073204 (+ 15us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.073205 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.073214 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.073288 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:55.073520 (+ 232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.074093 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.074797 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.075026 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.075086 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.076623 (+ 1537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:55.076624 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:55.076624 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:55.076631 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:55.077954 (+ 1323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.078313 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.078314 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.078314 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.078365 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.078583 (+ 218us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.078584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.078584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.078693 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:55.078772 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.078907 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.079012 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":59}
I20260811 08:13:55.080570 31786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23: Bootstrap starting.
I20260811 08:13:55.081418 31786 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:55.081946 31786 log.cc:824] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:55.082782 31786 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23: No bootstrap required, opened a new log
I20260811 08:13:55.084218 31786 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 36775 } }
I20260811 08:13:55.084342 31786 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:55.084364 31786 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a4168ab51744a179ae43449d338fa23, State: Initialized, Role: FOLLOWER
I20260811 08:13:55.084497 31786 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 36775 } }
I20260811 08:13:55.084776 31786 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:55.084815 31796 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 36775 } } }
I20260811 08:13:55.084959 31796 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 08:13:55.086643 31819 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:13:55.086709 31819 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:13:55.089659 31671 master_runner.cc:428] Detected that this master 4a4168ab51744a179ae43449d338fa23 is joining an existing cluster
I20260811 08:13:55.089715 31671 master_runner.cc:432] Initiating AddMaster RPC to add 127.20.158.188:36775
I20260811 08:13:55.098313 31793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.091359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49306 (local address 127.20.158.188:36775)
0811 08:13:55.091399 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.091401 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.091544 (+ 143us) server_negotiation.cc:407] Connection header received
0811 08:13:55.091621 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.091622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.091630 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.091676 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:55.092182 (+ 506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.092941 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.094059 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.094352 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.094396 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.095575 (+ 1179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:55.095576 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:55.095576 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:55.095582 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:55.097083 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.097501 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.097502 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.097502 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.097605 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.097851 (+ 246us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.097851 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.097852 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.097952 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:55.098004 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.098186 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.098253 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:13:55.098438 31832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.091012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:36775 (local address 127.0.0.1:49306)
0811 08:13:55.091459 (+ 447us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.091468 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:55.091566 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:55.091712 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:55.091713 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:55.092021 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:55.092096 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.092098 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.093034 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.093034 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.093966 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.093969 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.094478 (+ 509us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.094479 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.094534 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.094995 (+ 461us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:55.095000 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:55.095488 (+ 488us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:55.097198 (+ 1710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.097199 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.097200 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.097424 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.097687 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.097688 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.097688 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.097779 (+ 91us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.098025 (+ 246us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:55.098026 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:55.098075 (+ 49us) client_negotiation.cc:769] Sending connection context
0811 08:13:55.098170 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 08:13:55.098324 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":431,"mutex_wait_us":51,"thread_start_us":75,"threads_started":1}
I20260811 08:13:55.114362 30667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.091048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43430 (local address 127.20.158.190:42743)
0811 08:13:55.091095 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.091097 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.091438 (+ 341us) server_negotiation.cc:407] Connection header received
0811 08:13:55.091564 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.091566 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.091579 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.091643 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:55.092246 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.093027 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.094213 (+ 1186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.094514 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.094555 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.110704 (+ 16149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:55.110706 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:55.110706 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:55.110715 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:55.113028 (+ 2313us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.113411 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.113412 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.113413 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.113463 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.113698 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.113699 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.113700 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.113851 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:55.113894 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.114098 (+ 204us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.114205 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:13:55.114687 31665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.091313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46454 (local address 127.20.158.189:37887)
0811 08:13:55.091403 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.091405 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.091741 (+ 336us) server_negotiation.cc:407] Connection header received
0811 08:13:55.091834 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.091835 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.091845 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.091877 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:55.092306 (+ 429us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.093051 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.094213 (+ 1162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.094515 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.094555 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.110703 (+ 16148us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:55.110705 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:55.110706 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:55.110715 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:55.112635 (+ 1920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.113105 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.113106 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.113107 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.113168 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.113383 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.113384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.113385 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.113578 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:55.113635 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.113871 (+ 236us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.114587 (+ 716us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260811 08:13:55.114733 31833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.090994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.0.0.1:43430)
0811 08:13:55.091367 (+ 373us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.091378 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:55.091466 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:55.091701 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:55.091702 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:55.091996 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:55.092085 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.092087 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.093139 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.093140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.094107 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.094118 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.094637 (+ 519us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.094638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.095002 (+ 364us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.110020 (+ 15018us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:55.110027 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:55.110560 (+ 533us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:55.113121 (+ 2561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.113122 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.113122 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.113326 (+ 204us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.113558 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.113558 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.113559 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.113620 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.113944 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:55.113945 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:55.113985 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 08:13:55.114487 (+ 502us) client_negotiation.cc:240] Negotiation successful
0811 08:13:55.114618 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":344,"mutex_wait_us":24,"thread_start_us":87,"threads_started":1}
I20260811 08:13:55.115406 31831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.091218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:37887 (local address 127.0.0.1:46454)
0811 08:13:55.091687 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.091696 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:55.091764 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:55.091957 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:55.091958 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:55.092159 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:55.092219 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.092221 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.093139 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.093140 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.094109 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.094111 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.094642 (+ 531us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.094642 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.094743 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.110184 (+ 15441us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:55.110188 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:55.110584 (+ 396us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:55.112778 (+ 2194us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.112780 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.112780 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.113010 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.113245 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.113246 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.113246 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.113307 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.113686 (+ 379us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:55.113686 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:55.113750 (+ 64us) client_negotiation.cc:769] Sending connection context
0811 08:13:55.114921 (+ 1171us) client_negotiation.cc:240] Negotiation successful
0811 08:13:55.115313 (+ 392us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"mutex_wait_us":68,"thread_start_us":91,"threads_started":1}
Aug 11 08:13:55 dist-test-slave-gkw7 krb5kdc[30520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436033, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.190@KRBTEST.COM for oryx/127.20.158.188@KRBTEST.COM
I20260811 08:13:55.121304 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 30696
I20260811 08:13:55.124187 31515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.117044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:36775 (local address 127.0.0.1:49308)
0811 08:13:55.117083 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.117093 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:55.117156 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:55.117340 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:55.117341 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:55.117493 (+ 152us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:55.117588 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.117590 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.118246 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.118247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.118772 (+ 525us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.118774 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.119168 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.119169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.119239 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.119704 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:55.119709 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:55.121159 (+ 1450us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:55.123188 (+ 2029us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.123189 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.123189 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.123385 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.123549 (+ 164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.123549 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.123550 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.123601 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.123842 (+ 241us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:55.123843 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:55.123883 (+ 40us) client_negotiation.cc:769] Sending connection context
0811 08:13:55.123935 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 08:13:55.124036 (+ 101us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260811 08:13:55.124480 31793 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.117101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49308 (local address 127.20.158.188:36775)
0811 08:13:55.117226 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.117228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.117235 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:13:55.117268 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.117269 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.117278 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.117322 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:55.117659 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.118153 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.118874 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.119088 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.119170 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.121239 (+ 2069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:55.121240 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:55.121240 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:55.121247 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:55.123093 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.123449 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.123451 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.123451 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.123495 (+ 44us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.123655 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.123656 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.123656 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.123775 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:55.123822 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.124293 (+ 471us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.124364 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260811 08:13:55.134904 30584 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.20.158.188:36775: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "4a4168ab51744a179ae43449d338fa23"
member_type: NON_VOTER
last_known_addr {
host: "127.20.158.188"
port: 36775
}
attrs {
promote: true
}
}
dest_uuid: "0c7c55b6e5de4652970c2f9776857e5d"
cas_config_opid_index: 5
I20260811 08:13:55.135201 30584 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: NON_VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: true } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: NON_VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: true } }
I20260811 08:13:55.135622 31516 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 4a4168ab51744a179ae43449d338fa23 (127.20.158.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: NON_VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: true } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: NON_VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: true } } }
I20260811 08:13:55.135808 31748 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:55.136831 31748 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [term 1 FOLLOWER]: Refusing update from remote peer 0c7c55b6e5de4652970c2f9776857e5d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 08:13:55.136868 31516 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.20.158.188:36775
I20260811 08:13:55.136945 31516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "0c7c55b6e5de4652970c2f9776857e5d" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: NON_VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: true } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: NON_VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: true } } }
I20260811 08:13:55.137020 31516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:55.137418 31518 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: NON_VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:13:55.137705 31671 master.cc:537] Master@127.20.158.188:36775 shutting down...
W20260811 08:13:55.138116 30564 consensus_peers.cc:487] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d -> Peer 4a4168ab51744a179ae43449d338fa23 (127.20.158.188:36775): Couldn't send request to peer 4a4168ab51744a179ae43449d338fa23. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260811 08:13:55.140352 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:45099
--local_ip_for_outbound_sockets=127.20.158.129
--tserver_master_addrs=127.20.158.190:42743
--webserver_port=46179
--webserver_interface=127.20.158.129
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.129.keytab
--principal=oryx/127.20.158.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:46827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.20.158.190:42743,127.20.158.189:37887
--tserver_master_addrs=127.20.158.190:42743,127.20.158.189:37887,127.20.158.188:36775 with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:13:55.141568 31671 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:13:55.141669 31671 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:55.141726 31671 tablet_replica.cc:330] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23: stopping tablet replica
I20260811 08:13:55.142913 31665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.137326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46466 (local address 127.20.158.189:37887)
0811 08:13:55.137372 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.137374 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.138232 (+ 858us) server_negotiation.cc:407] Connection header received
0811 08:13:55.138267 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.138269 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.138297 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.138362 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:55.138564 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.139342 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.141752 (+ 2410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.142419 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.142497 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.142588 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.142806 (+ 218us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.142846 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:13:55.142913 31515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.137225 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:37887 (local address 127.0.0.1:46466)
0811 08:13:55.138074 (+ 849us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.138087 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:55.138140 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:55.138416 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:55.138417 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:55.138420 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:55.138469 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.138471 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.139440 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.139441 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.141646 (+ 2205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.141650 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.142625 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.142626 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.142699 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.142716 (+ 17us) client_negotiation.cc:769] Sending connection context
0811 08:13:55.142800 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 08:13:55.142846 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":828}
I20260811 08:13:55.143201 31605 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 1 LEARNER]: Refusing update from remote peer 0c7c55b6e5de4652970c2f9776857e5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260811 08:13:55.143409 31518 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: NON_VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260811 08:13:55.143992 31605 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 4a4168ab51744a179ae43449d338fa23 (127.20.158.188) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: NON_VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: true } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: NON_VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: true } } }
I20260811 08:13:55.145468 31518 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d: attempting to promote NON_VOTER a8b7920051704b6789caa713e738bd9d to VOTER
I20260811 08:13:55.145576 31645 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c7c55b6e5de4652970c2f9776857e5d. Latest consensus state: current_term: 1 leader_uuid: "0c7c55b6e5de4652970c2f9776857e5d" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: NON_VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: true } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: NON_VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: true } } }
I20260811 08:13:55.145653 31645 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [sys.catalog]: This master's current role is: LEARNER
I20260811 08:13:55.145689 31645 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0c7c55b6e5de4652970c2f9776857e5d" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: NON_VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: true } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: NON_VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: true } } }
I20260811 08:13:55.145740 31645 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [sys.catalog]: This master's current role is: LEARNER
I20260811 08:13:55.145706 31518 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: NON_VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: true } }
I20260811 08:13:55.146270 31515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.146151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:36775 (local address 127.0.0.1:49318)
0811 08:13:55.146194 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.146238 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:36775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 08:13:55.146556 31515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.146482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:36775 (local address 127.0.0.1:49324)
0811 08:13:55.146510 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.146529 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:36775: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260811 08:13:55.146716 30564 consensus_peers.cc:487] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d -> Peer 4a4168ab51744a179ae43449d338fa23 (127.20.158.188:36775): Couldn't send request to peer 4a4168ab51744a179ae43449d338fa23. Status: Network error: Client connection negotiation failed: client connection to 127.20.158.188:36775: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 08:13:55.146737 31671 master.cc:552] Master@127.20.158.188:36775 shutdown complete.
I20260811 08:13:55.146770 31671 master_runner.cc:305] Clearing existing system tablet
I20260811 08:13:55.146919 31671 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:55.146965 31671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:55.146955 31605 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 1 LEARNER]: Refusing update from remote peer 0c7c55b6e5de4652970c2f9776857e5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260811 08:13:55.147147 31516 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260811 08:13:55.147758 31516 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, a8b7920051704b6789caa713e738bd9d (127.20.158.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: NON_VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: true } } }
I20260811 08:13:55.148460 31671 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:13:55.148999 31516 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "0c7c55b6e5de4652970c2f9776857e5d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: NON_VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: true } } }
I20260811 08:13:55.149108 31516 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:55.149088 31518 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0c7c55b6e5de4652970c2f9776857e5d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: NON_VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: true } } }
I20260811 08:13:55.149158 31518 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:55.149504 31839 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:55.149507 31605 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, a8b7920051704b6789caa713e738bd9d (127.20.158.189) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: NON_VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: true } } }
I20260811 08:13:55.149722 31671 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:55.149784 31671 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:13:55.149812 31671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-2/wal
uuid: "4a4168ab51744a179ae43449d338fa23"
format_stamp: "Formatted at 2026-08-11 08:13:55 on dist-test-slave-gkw7"
server_key: "2d90006ba90faf2fd8cd87db35383122"
server_key_iv: "385dd647756bd8121b288dd6e79300cc"
server_key_version: "encryptionkey@0"
I20260811 08:13:55.150669 31671 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:13:55.150866 31836 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0c7c55b6e5de4652970c2f9776857e5d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: NON_VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: true } } }
I20260811 08:13:55.150949 31836 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:13:55.152200 31671 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260811 08:13:55.152302 31671 log.cc:1196] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260811 08:13:55.152527 31671 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23: Deleting consensus metadata
I20260811 08:13:55.152704 31671 master_runner.cc:315] Copying system tablet from 127.20.158.190:42743
I20260811 08:13:55.153380 31671 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23: tablet copy: Beginning tablet copy session from remote peer at address 127.20.158.190:42743
I20260811 08:13:55.162284 30667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.153836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43438 (local address 127.20.158.190:42743)
0811 08:13:55.153886 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.153888 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.155562 (+ 1674us) server_negotiation.cc:407] Connection header received
0811 08:13:55.155655 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.155656 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.155669 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.155720 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:55.156093 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.156641 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.157463 (+ 822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.157793 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.157903 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.159009 (+ 1106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:55.159011 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:55.159012 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:55.159019 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:55.160703 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.161142 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.161143 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.161144 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.161212 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.161469 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.161470 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.161470 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.161780 (+ 310us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:55.161882 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.162104 (+ 222us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.162187 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:13:55.162312 31849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.153751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.0.0.1:43438)
0811 08:13:55.155460 (+ 1709us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.155472 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:55.155594 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:55.155738 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:55.155739 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:55.155936 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:55.155991 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.155993 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.156743 (+ 750us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.156745 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.157354 (+ 609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.157356 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.157906 (+ 550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.157907 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.157996 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.158547 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:55.158552 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:55.158879 (+ 327us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:55.160826 (+ 1947us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.160827 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.160828 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.161029 (+ 201us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.161312 (+ 283us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.161313 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.161313 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.161388 (+ 75us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.161893 (+ 505us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:55.161894 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:55.161948 (+ 54us) client_negotiation.cc:769] Sending connection context
0811 08:13:55.162051 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 08:13:55.162180 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1686,"thread_start_us":93,"threads_started":1}
I20260811 08:13:55.162955 30626 tablet_copy_service.cc:140] P 0c7c55b6e5de4652970c2f9776857e5d: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 4a4168ab51744a179ae43449d338fa23 ({username='oryx', principal='oryx/127.20.158.188@KRBTEST.COM'} at 127.0.0.1:43438)
I20260811 08:13:55.163049 30626 tablet_copy_service.cc:161] P 0c7c55b6e5de4652970c2f9776857e5d: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 4a4168ab51744a179ae43449d338fa23 at {username='oryx', principal='oryx/127.20.158.188@KRBTEST.COM'} at 127.0.0.1:43438: session id = 4a4168ab51744a179ae43449d338fa23-00000000000000000000000000000000
I20260811 08:13:55.163573 30626 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d: Tablet Copy: opened 0 blocks and 1 log segments
I20260811 08:13:55.164163 31671 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260811 08:13:55.165233 31671 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23: tablet copy: Starting download of 0 data blocks...
I20260811 08:13:55.165434 31671 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23: tablet copy: Starting download of 1 WAL segments...
I20260811 08:13:55.166412 31671 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260811 08:13:55.167248 30626 tablet_copy_service.cc:342] P 0c7c55b6e5de4652970c2f9776857e5d: Request end of tablet copy session 4a4168ab51744a179ae43449d338fa23-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.20.158.188@KRBTEST.COM'} at 127.0.0.1:43438
I20260811 08:13:55.167306 30626 tablet_copy_service.cc:433] P 0c7c55b6e5de4652970c2f9776857e5d: ending tablet copy session 4a4168ab51744a179ae43449d338fa23-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 4a4168ab51744a179ae43449d338fa23
I20260811 08:13:55.170390 31671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:55.171779 31850 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:55.172101 31671 server_base.cc:1034] running on GCE node
W20260811 08:13:55.173738 31855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:55.178606 31852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:55.178889 31671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:55.179126 31671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:55.180299 31671 hybrid_clock.cc:648] HybridClock initialized: now 1786436035180282 us; error 39 us; skew 500 ppm
Aug 11 08:13:55 dist-test-slave-gkw7 krb5kdc[30520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:55.181839 31671 init.cc:377] Logged in from keytab as oryx/127.20.158.188@KRBTEST.COM (short username oryx)
I20260811 08:13:55.182159 31671 webserver.cc:460] Webserver started at http://127.20.158.188:42515/ using document root <none> and password file <none>
I20260811 08:13:55.182286 31671 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:55.182323 31671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:55.182972 31671 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:13:55.183598 31864 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:55.183743 31671 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:55.183792 31671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-2/wal
uuid: "4a4168ab51744a179ae43449d338fa23"
format_stamp: "Formatted at 2026-08-11 08:13:55 on dist-test-slave-gkw7"
server_key: "2d90006ba90faf2fd8cd87db35383122"
server_key_iv: "385dd647756bd8121b288dd6e79300cc"
server_key_version: "encryptionkey@0"
I20260811 08:13:55.183856 31671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:55.188786 31671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:55.190876 31671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:55.194561 31671 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.188:36775
I20260811 08:13:55.194597 31949 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.188:36775 every 8 connection(s)
I20260811 08:13:55.194897 31671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/master-2/data/info.pb
I20260811 08:13:55.195595 31950 sys_catalog.cc:263] Verifying existing consensus state
I20260811 08:13:55.196121 31950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23: Bootstrap starting.
I20260811 08:13:55.198509 31950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:13:55.198746 31950 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23: Bootstrap complete.
I20260811 08:13:55.198958 31950 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: NON_VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: true } }
I20260811 08:13:55.199054 31950 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 4a4168ab51744a179ae43449d338fa23, State: Initialized, Role: LEARNER
I20260811 08:13:55.199164 31950 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: NON_VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: true } }
I20260811 08:13:55.199357 31950 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:13:55.199340 31955 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: NON_VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: true } } }
I20260811 08:13:55.199544 31955 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [sys.catalog]: This master's current role is: LEARNER
I20260811 08:13:55.200809 31973 catalog_manager.cc:1259] Loaded cluster ID: 4f01a006eb6d4cb98524ade29d05c262
I20260811 08:13:55.201350 31973 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23: loading cluster ID for follower catalog manager: success
I20260811 08:13:55.202199 31973 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23: acquiring CA information for follower catalog manager: success
I20260811 08:13:55.202490 31973 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260811 08:13:55.264130 31834 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:55.264341 31834 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:55.264367 31834 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:55.265738 31834 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:55.265782 31834 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:55.265812 31834 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:13:55.267477 31834 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:46827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.129.keytab
--principal=oryx/127.20.158.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:45099
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=46179
--tserver_master_addrs=127.20.158.190:42743,127.20.158.189:37887,127.20.158.188:36775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31834
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:55.267771 31834 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:55.268074 31834 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:55.274835 31984 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:55.274844 31980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:55.275151 31986 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:55.275377 31834 server_base.cc:1034] running on GCE node
I20260811 08:13:55.275558 31834 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:55.275820 31834 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:55.279102 31834 hybrid_clock.cc:648] HybridClock initialized: now 1786436035279072 us; error 44 us; skew 500 ppm
Aug 11 08:13:55 dist-test-slave-gkw7 krb5kdc[30520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:55.282465 31834 init.cc:377] Logged in from keytab as oryx/127.20.158.129@KRBTEST.COM (short username oryx)
I20260811 08:13:55.283002 31834 webserver.cc:460] Webserver started at http://127.20.158.129:46179/ using document root <none> and password file <none>
I20260811 08:13:55.283313 31834 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:55.283419 31834 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:55.285035 31834 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:13:55.285907 32001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:55.286160 31834 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:55.286265 31834 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "695df11ce5ca41f891ded65eb66c8037"
format_stamp: "Formatted at 2026-08-11 08:13:54 on dist-test-slave-gkw7"
server_key: "5eefeb00e3ab6908865c4b8a24379fe2"
server_key_iv: "8a814e6a3064cc0ea8c2b54977eca313"
server_key_version: "encryptionkey@0"
I20260811 08:13:55.286773 31834 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:55.323562 31834 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:55.326386 31834 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:55.326566 31834 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:55.326874 31834 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:55.327229 31834 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:55.327296 31834 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:55.327337 31834 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:55.327365 31834 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:55.335381 31834 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:45099
I20260811 08:13:55.335433 32171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:45099 every 8 connection(s)
I20260811 08:13:55.335840 31834 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:13:55.338353 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 31834
I20260811 08:13:55.338528 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 30930
Aug 11 08:13:55 dist-test-slave-gkw7 krb5kdc[30520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.188@KRBTEST.COM
Aug 11 08:13:55 dist-test-slave-gkw7 krb5kdc[30520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM
Aug 11 08:13:55 dist-test-slave-gkw7 krb5kdc[30520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.189@KRBTEST.COM
I20260811 08:13:55.352344 31665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.336672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:58179 (local address 127.20.158.189:37887)
0811 08:13:55.336751 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.336754 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.337096 (+ 342us) server_negotiation.cc:407] Connection header received
0811 08:13:55.337708 (+ 612us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.337710 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.337723 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.337785 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:55.343226 (+ 5441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.343971 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.345045 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.345415 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.345487 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.348516 (+ 3029us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:55.348518 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:55.348518 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:55.348527 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:55.350519 (+ 1992us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.350918 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.350919 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.350919 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.350974 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.351792 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.351793 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.351793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.351930 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:55.351975 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.352132 (+ 157us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.352210 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 08:13:55.352492 30667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.337089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:59871 (local address 127.20.158.190:42743)
0811 08:13:55.337136 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.337137 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.337147 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:13:55.337745 (+ 598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.337747 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.337760 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.337791 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:55.338872 (+ 1081us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.339914 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.344158 (+ 4244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.344551 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.344619 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.348130 (+ 3511us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:55.348132 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:55.348132 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:55.348147 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:55.350641 (+ 2494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.351298 (+ 657us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.351299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.351300 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.351371 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.351657 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.351659 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.351659 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.351852 (+ 193us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:55.351931 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.352249 (+ 318us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.352356 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:13:55.352788 32181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.336751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:55203 (local address 127.20.158.188:36775)
0811 08:13:55.336872 (+ 121us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.336875 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.337129 (+ 254us) server_negotiation.cc:407] Connection header received
0811 08:13:55.337848 (+ 719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.337850 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.337863 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.337937 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:55.339160 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.339924 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.341196 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.341433 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.341473 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.345349 (+ 3876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:55.345350 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:55.345351 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:55.345360 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:55.348401 (+ 3041us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.348918 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.348920 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.348920 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.348990 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.351251 (+ 2261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.351252 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.351253 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.351411 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:55.351470 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.352581 (+ 1111us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.352684 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96,"thread_start_us":63,"threads_started":1}
I20260811 08:13:55.352993 32184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.336946 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.20.158.129:59871)
0811 08:13:55.337054 (+ 108us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.337066 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:55.337589 (+ 523us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:55.337896 (+ 307us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:55.337901 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:55.338428 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:55.338759 (+ 331us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.338765 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.342917 (+ 4152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.342918 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.344029 (+ 1111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.344033 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.344719 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.344721 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.344807 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.345848 (+ 1041us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:55.345853 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:55.347532 (+ 1679us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:55.350765 (+ 3233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.350766 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.350767 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.351098 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.351462 (+ 364us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.351463 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.351463 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.351547 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.351979 (+ 432us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:55.351981 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:55.352066 (+ 85us) client_negotiation.cc:769] Sending connection context
0811 08:13:55.352581 (+ 515us) client_negotiation.cc:240] Negotiation successful
0811 08:13:55.352738 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":90,"mutex_wait_us":48,"thread_start_us":65,"threads_started":1}
I20260811 08:13:55.353057 32178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.336635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:37887 (local address 127.20.158.129:58179)
0811 08:13:55.336946 (+ 311us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.336996 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:55.337584 (+ 588us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:55.338271 (+ 687us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:55.338272 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:55.338473 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:55.343071 (+ 4598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.343074 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.344091 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.344092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.344912 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.344915 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.345596 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.345597 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.345690 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.346427 (+ 737us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:55.346431 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:55.348004 (+ 1573us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:55.350630 (+ 2626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.350631 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.350631 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.350833 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.351065 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.351066 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.351066 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.351174 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.352003 (+ 829us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:55.352004 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:55.352037 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 08:13:55.352451 (+ 414us) client_negotiation.cc:240] Negotiation successful
0811 08:13:55.352677 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":261,"mutex_wait_us":3,"thread_start_us":112,"threads_started":1}
I20260811 08:13:55.353204 32177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.336635 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:36775 (local address 127.20.158.129:55203)
0811 08:13:55.336963 (+ 328us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.336995 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:55.337584 (+ 589us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:55.337983 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:55.337984 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:55.338431 (+ 447us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:55.339054 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.339057 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.340066 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.340067 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.341089 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.341091 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.341588 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.341589 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.341716 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.343191 (+ 1475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:55.343202 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:55.345234 (+ 2032us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:55.348495 (+ 3261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.348503 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.348506 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.348811 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.349448 (+ 637us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.349450 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.349450 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.351192 (+ 1742us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.351496 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:55.351502 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:55.351675 (+ 173us) client_negotiation.cc:769] Sending connection context
0811 08:13:55.352907 (+ 1232us) client_negotiation.cc:240] Negotiation successful
0811 08:13:55.353012 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"mutex_wait_us":373,"thread_start_us":107,"threads_started":1}
I20260811 08:13:55.353638 32174 heartbeater.cc:347] Connected to a master server at 127.20.158.189:37887
I20260811 08:13:55.353740 32174 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:55.353906 32172 heartbeater.cc:347] Connected to a master server at 127.20.158.188:36775
I20260811 08:13:55.353924 32173 heartbeater.cc:347] Connected to a master server at 127.20.158.190:42743
I20260811 08:13:55.353978 32173 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:55.353960 32172 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:55.353968 32174 heartbeater.cc:511] Master 127.20.158.189:37887 requested a full tablet report, sending...
I20260811 08:13:55.354084 32173 heartbeater.cc:511] Master 127.20.158.190:42743 requested a full tablet report, sending...
I20260811 08:13:55.354087 32172 heartbeater.cc:511] Master 127.20.158.188:36775 requested a full tablet report, sending...
I20260811 08:13:55.354525 30584 ts_manager.cc:194] Re-registered known tserver with Master: 695df11ce5ca41f891ded65eb66c8037 (127.20.158.129:45099)
I20260811 08:13:55.354604 31887 ts_manager.cc:194] Registered new tserver with Master: 695df11ce5ca41f891ded65eb66c8037 (127.20.158.129:45099)
I20260811 08:13:55.354686 31589 ts_manager.cc:194] Registered new tserver with Master: 695df11ce5ca41f891ded65eb66c8037 (127.20.158.129:45099)
I20260811 08:13:55.355034 30584 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.158.129@KRBTEST.COM'} at 127.20.158.129:59871
I20260811 08:13:55.358837 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:35183
--local_ip_for_outbound_sockets=127.20.158.130
--tserver_master_addrs=127.20.158.190:42743
--webserver_port=40795
--webserver_interface=127.20.158.130
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.130.keytab
--principal=oryx/127.20.158.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:46827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.20.158.190:42743,127.20.158.189:37887
--tserver_master_addrs=127.20.158.190:42743,127.20.158.189:37887,127.20.158.188:36775 with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:55.450838 32186 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:55.451182 32186 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:55.451246 32186 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:55.452406 32186 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:55.452447 32186 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:55.452474 32186 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:13:55.454010 32186 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:46827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.130.keytab
--principal=oryx/127.20.158.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:35183
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=40795
--tserver_master_addrs=127.20.158.190:42743,127.20.158.189:37887,127.20.158.188:36775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32186
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:55.454262 32186 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:55.454463 32186 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:55.460063 32196 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:55.460132 32195 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:55.460050 32186 server_base.cc:1034] running on GCE node
W20260811 08:13:55.460049 32200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:55.460510 32186 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:55.460796 32186 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:55.461959 32186 hybrid_clock.cc:648] HybridClock initialized: now 1786436035461946 us; error 32 us; skew 500 ppm
Aug 11 08:13:55 dist-test-slave-gkw7 krb5kdc[30520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:55.464476 32186 init.cc:377] Logged in from keytab as oryx/127.20.158.130@KRBTEST.COM (short username oryx)
I20260811 08:13:55.465004 32186 webserver.cc:460] Webserver started at http://127.20.158.130:40795/ using document root <none> and password file <none>
I20260811 08:13:55.465247 32186 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:55.465308 32186 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:55.466806 32186 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:55.467491 32210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:55.467717 32186 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:55.467797 32186 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "051b4710423449f3aa3321f20aeabed1"
format_stamp: "Formatted at 2026-08-11 08:13:54 on dist-test-slave-gkw7"
server_key: "d10b92f96de4f57f6275c87f7fee0b26"
server_key_iv: "c1e168c9831690e2cca7c063ce7b997b"
server_key_version: "encryptionkey@0"
I20260811 08:13:55.468175 32186 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:55.495607 32186 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:55.497902 32186 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:55.498070 32186 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:55.498353 32186 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:55.498772 32186 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:55.498814 32186 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:55.498838 32186 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:55.498873 32186 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:55.505208 32186 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:35183
I20260811 08:13:55.505265 32381 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:35183 every 8 connection(s)
I20260811 08:13:55.505671 32186 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
I20260811 08:13:55.512094 31365 heartbeater.cc:503] Master 127.20.158.190:42743 was elected leader, sending a full tablet report...
Aug 11 08:13:55 dist-test-slave-gkw7 krb5kdc[30520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.188@KRBTEST.COM
Aug 11 08:13:55 dist-test-slave-gkw7 krb5kdc[30520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.189@KRBTEST.COM
Aug 11 08:13:55 dist-test-slave-gkw7 krb5kdc[30520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM
I20260811 08:13:55.515074 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 32186
I20260811 08:13:55.515259 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 31161
I20260811 08:13:55.522696 31665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.506938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:37381 (local address 127.20.158.189:37887)
0811 08:13:55.507009 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.507011 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.507020 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:13:55.507923 (+ 903us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.507925 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.507937 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.507991 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:55.508763 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.509593 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.510607 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.510950 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.511016 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.515076 (+ 4060us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:55.515078 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:55.515078 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:55.515087 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:55.520397 (+ 5310us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.521098 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.521100 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.521100 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.521176 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.521588 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.521590 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.521590 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.521819 (+ 229us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:55.521885 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.522412 (+ 527us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.522536 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 08:13:55.523427 32390 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.506751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:37887 (local address 127.20.158.130:37381)
0811 08:13:55.506923 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.506932 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:55.507743 (+ 811us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:55.508009 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:55.508014 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:55.508468 (+ 454us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:55.508647 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.508653 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.509705 (+ 1052us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.509706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.510496 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.510498 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.511021 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.511022 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.511163 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.511905 (+ 742us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:55.511916 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:55.514965 (+ 3049us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:55.520503 (+ 5538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.520516 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.520520 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.520982 (+ 462us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.521269 (+ 287us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.521270 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.521271 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.521455 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.521948 (+ 493us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:55.521957 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:55.522199 (+ 242us) client_negotiation.cc:769] Sending connection context
0811 08:13:55.522824 (+ 625us) client_negotiation.cc:240] Negotiation successful
0811 08:13:55.523093 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":25,"thread_start_us":57,"threads_started":1}
I20260811 08:13:55.533730 32385 heartbeater.cc:347] Connected to a master server at 127.20.158.189:37887
I20260811 08:13:55.533841 32385 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:55.534044 32385 heartbeater.cc:511] Master 127.20.158.189:37887 requested a full tablet report, sending...
I20260811 08:13:55.534468 31589 ts_manager.cc:194] Registered new tserver with Master: 051b4710423449f3aa3321f20aeabed1 (127.20.158.130:35183)
I20260811 08:13:55.540098 32181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.506457 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:56765 (local address 127.20.158.188:36775)
0811 08:13:55.506701 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.506703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.506722 (+ 19us) server_negotiation.cc:407] Connection header received
0811 08:13:55.508042 (+ 1320us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.508043 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.508051 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.508129 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:55.508762 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.509323 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.510737 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.511044 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.511102 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.514040 (+ 2938us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:55.514041 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:55.514042 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:55.514049 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:55.515924 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.539106 (+ 23182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.539108 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.539108 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.539187 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.539432 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.539433 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.539433 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.539592 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:55.539655 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.539887 (+ 232us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.540006 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206}
I20260811 08:13:55.540503 32388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.506430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:36775 (local address 127.20.158.130:56765)
0811 08:13:55.506614 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.506657 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:55.507742 (+ 1085us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:55.508133 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:55.508134 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:55.508436 (+ 302us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:55.508646 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.508651 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.509453 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.509454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.510648 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.510650 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.511160 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.511161 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.511256 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.511979 (+ 723us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:55.511983 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:55.513940 (+ 1957us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:55.538755 (+ 24815us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.538756 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.538756 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.538980 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.539277 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.539278 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.539279 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.539344 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.539691 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:55.539692 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:55.539754 (+ 62us) client_negotiation.cc:769] Sending connection context
0811 08:13:55.540260 (+ 506us) client_negotiation.cc:240] Negotiation successful
0811 08:13:55.540390 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":111,"threads_started":1}
I20260811 08:13:55.540875 32382 heartbeater.cc:347] Connected to a master server at 127.20.158.188:36775
I20260811 08:13:55.540930 32382 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:55.540932 32387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.506432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.20.158.130:47839)
0811 08:13:55.506640 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.506664 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:55.507729 (+ 1065us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:55.508009 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:55.508014 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:55.508479 (+ 465us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:55.508647 (+ 168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.508653 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.509710 (+ 1057us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.509711 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.510646 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.510649 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.511239 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.511240 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.511297 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.512051 (+ 754us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:55.512055 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:55.537140 (+ 25085us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:55.539407 (+ 2267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.539408 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.539408 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.539637 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.539872 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.539873 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.539873 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.539928 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.540293 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:55.540294 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:55.540349 (+ 55us) client_negotiation.cc:769] Sending connection context
0811 08:13:55.540441 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 08:13:55.540566 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"mutex_wait_us":6,"thread_start_us":101,"threads_started":1}
I20260811 08:13:55.541038 32382 heartbeater.cc:511] Master 127.20.158.188:36775 requested a full tablet report, sending...
I20260811 08:13:55.541010 30667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.506471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:47839 (local address 127.20.158.190:42743)
0811 08:13:55.506526 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.506528 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.506767 (+ 239us) server_negotiation.cc:407] Connection header received
0811 08:13:55.507861 (+ 1094us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.507862 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.507876 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.507921 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:55.508773 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.509589 (+ 816us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.510837 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.511150 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.511232 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.537276 (+ 26044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:55.537279 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:55.537279 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:55.537289 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:55.539309 (+ 2020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.539731 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.539733 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.539733 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.539795 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.540015 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.540016 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.540017 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.540180 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:55.540260 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.540485 (+ 225us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.540810 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:13:55.541342 31887 ts_manager.cc:194] Registered new tserver with Master: 051b4710423449f3aa3321f20aeabed1 (127.20.158.130:35183)
I20260811 08:13:55.541492 32383 heartbeater.cc:347] Connected to a master server at 127.20.158.190:42743
I20260811 08:13:55.541574 32383 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:55.541649 32383 heartbeater.cc:511] Master 127.20.158.190:42743 requested a full tablet report, sending...
I20260811 08:13:55.541927 30584 ts_manager.cc:194] Re-registered known tserver with Master: 051b4710423449f3aa3321f20aeabed1 (127.20.158.130:35183)
I20260811 08:13:55.542465 30584 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.158.130@KRBTEST.COM'} at 127.20.158.130:47839
I20260811 08:13:55.543839 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:36963
--local_ip_for_outbound_sockets=127.20.158.131
--tserver_master_addrs=127.20.158.190:42743
--webserver_port=43035
--webserver_interface=127.20.158.131
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.131.keytab
--principal=oryx/127.20.158.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:46827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.20.158.190:42743,127.20.158.189:37887
--tserver_master_addrs=127.20.158.190:42743,127.20.158.189:37887,127.20.158.188:36775 with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:13:55.630569 32391 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:13:55.630795 32391 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:13:55.630820 32391 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:13:55.632017 32391 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:13:55.632069 32391 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:13:55.632099 32391 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:13:55.633699 32391 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:46827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.131.keytab
--principal=oryx/127.20.158.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:36963
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=43035
--tserver_master_addrs=127.20.158.190:42743,127.20.158.189:37887,127.20.158.188:36775
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32391
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:13:55.633987 32391 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:13:55.634285 32391 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:13:55.639686 32405 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:13:55.639680 32403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:55.639698 32391 server_base.cc:1034] running on GCE node
W20260811 08:13:55.639680 32408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:13:55.640188 32391 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:13:55.640410 32391 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:13:55.641600 32391 hybrid_clock.cc:648] HybridClock initialized: now 1786436035641584 us; error 29 us; skew 500 ppm
Aug 11 08:13:55 dist-test-slave-gkw7 krb5kdc[30520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:13:55.644256 32391 init.cc:377] Logged in from keytab as oryx/127.20.158.131@KRBTEST.COM (short username oryx)
I20260811 08:13:55.644646 32391 webserver.cc:460] Webserver started at http://127.20.158.131:43035/ using document root <none> and password file <none>
I20260811 08:13:55.644912 32391 fs_manager.cc:359] Metadata directory not provided
I20260811 08:13:55.644972 32391 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:13:55.646481 32391 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:55.647187 32419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:55.647367 32391 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:55.647475 32391 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "bc0425573d80435b8fd3087778815fb4"
format_stamp: "Formatted at 2026-08-11 08:13:54 on dist-test-slave-gkw7"
server_key: "0ba646a00bb48a767d444e5d306ef19b"
server_key_iv: "dc27e539cf2892af76884c63dff390e9"
server_key_version: "encryptionkey@0"
I20260811 08:13:55.647826 32391 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:13:55.673157 32391 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:13:55.675433 32391 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:13:55.675607 32391 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:13:55.675861 32391 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:13:55.676201 32391 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:13:55.676261 32391 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:55.676311 32391 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:13:55.676339 32391 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:13:55.682734 32391 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:36963
I20260811 08:13:55.682817 32611 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:36963 every 8 connection(s)
I20260811 08:13:55.683192 32391 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
I20260811 08:13:55.690065 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 32391
Aug 11 08:13:55 dist-test-slave-gkw7 krb5kdc[30520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.189@KRBTEST.COM
Aug 11 08:13:55 dist-test-slave-gkw7 krb5kdc[30520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.188@KRBTEST.COM
Aug 11 08:13:55 dist-test-slave-gkw7 krb5kdc[30520](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436035, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM
I20260811 08:13:55.697234 32624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.683999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:36775 (local address 127.20.158.131:58323)
0811 08:13:55.684471 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.684520 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:55.685856 (+ 1336us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:55.686136 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:55.686140 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:55.686657 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:55.686930 (+ 273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.686936 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.688803 (+ 1867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.688804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.689690 (+ 886us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.689693 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.690266 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.690267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.690342 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.691003 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:55.691009 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:55.693562 (+ 2553us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:55.695410 (+ 1848us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.695417 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.695420 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.695701 (+ 281us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.695929 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.695929 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.695930 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.696074 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.696385 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:55.696392 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:55.696627 (+ 235us) client_negotiation.cc:769] Sending connection context
0811 08:13:55.696734 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 08:13:55.696964 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":423,"mutex_wait_us":40,"thread_start_us":121,"threads_started":1}
I20260811 08:13:55.697757 32181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.684070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:58323 (local address 127.20.158.188:36775)
0811 08:13:55.684128 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.684130 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.684631 (+ 501us) server_negotiation.cc:407] Connection header received
0811 08:13:55.685977 (+ 1346us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.685978 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.685992 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.686046 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:55.687958 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.688698 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.689787 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.690098 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.690148 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.693670 (+ 3522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:55.693671 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:55.693671 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:55.693678 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:55.695319 (+ 1641us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.695795 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.695796 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.695796 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.695858 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.696150 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.696151 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.696152 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.696299 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:55.696359 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.697557 (+ 1198us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.697647 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 08:13:55.698182 32612 heartbeater.cc:347] Connected to a master server at 127.20.158.188:36775
I20260811 08:13:55.698310 32612 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:55.698532 32612 heartbeater.cc:511] Master 127.20.158.188:36775 requested a full tablet report, sending...
I20260811 08:13:55.699010 31887 ts_manager.cc:194] Registered new tserver with Master: bc0425573d80435b8fd3087778815fb4 (127.20.158.131:36963)
I20260811 08:13:55.702885 32620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.684010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.20.158.131:44527)
0811 08:13:55.684471 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.684520 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:55.685856 (+ 1336us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:55.686137 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:55.686140 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:55.686684 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:55.686930 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.686936 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.687957 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.687958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.689134 (+ 1176us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.689136 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.689715 (+ 579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.689715 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.691942 (+ 2227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.692750 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:55.692755 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:55.698206 (+ 5451us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:55.700887 (+ 2681us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.700888 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.700889 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.701903 (+ 1014us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.702145 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.702145 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.702146 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.702206 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.702517 (+ 311us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:55.702518 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:55.702563 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 08:13:55.702650 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 08:13:55.702769 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":441,"mutex_wait_us":83,"thread_start_us":112,"threads_started":1}
I20260811 08:13:55.702911 30667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.684056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:44527 (local address 127.20.158.190:42743)
0811 08:13:55.684120 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.684122 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.684609 (+ 487us) server_negotiation.cc:407] Connection header received
0811 08:13:55.685993 (+ 1384us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.685995 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.686009 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.686042 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:55.687058 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.687853 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.689239 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.689573 (+ 334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.689620 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.698343 (+ 8723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:55.698345 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:55.698345 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:55.698353 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:55.700771 (+ 2418us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.701999 (+ 1228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.702000 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.702001 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.702063 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.702282 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.702283 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.702284 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.702420 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:55.702483 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.702702 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.702796 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 08:13:55.703027 32632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.691796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49340 (local address 127.20.158.188:36775)
0811 08:13:55.691919 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.691921 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.692505 (+ 584us) server_negotiation.cc:407] Connection header received
0811 08:13:55.692606 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.692607 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.692621 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.692704 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:55.693602 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.694926 (+ 1324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.696257 (+ 1331us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.696605 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.696652 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.699897 (+ 3245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:55.699899 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:55.699899 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:55.699907 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:55.701683 (+ 1776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.702112 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.702114 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.702114 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.702170 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.702407 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.702408 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.702408 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.702538 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:55.702614 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.702826 (+ 212us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.702909 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":69,"threads_started":1}
I20260811 08:13:55.703552 32616 heartbeater.cc:347] Connected to a master server at 127.20.158.190:42743
I20260811 08:13:55.703599 32616 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:55.703639 31665 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.684403 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:46805 (local address 127.20.158.189:37887)
0811 08:13:55.684463 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.684465 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.684840 (+ 375us) server_negotiation.cc:407] Connection header received
0811 08:13:55.686108 (+ 1268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.686109 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.686118 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.686191 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:55.687056 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.687845 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.689259 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.689644 (+ 385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.689701 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.698907 (+ 9206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:55.698908 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:55.698908 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:55.698916 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:55.700628 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.701198 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.701199 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.701200 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.701257 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.701493 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.701494 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.701495 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.701672 (+ 177us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:55.701746 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.703452 (+ 1706us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.703539 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 08:13:55.703670 32616 heartbeater.cc:511] Master 127.20.158.190:42743 requested a full tablet report, sending...
I20260811 08:13:55.703903 30584 ts_manager.cc:194] Re-registered known tserver with Master: bc0425573d80435b8fd3087778815fb4 (127.20.158.131:36963)
I20260811 08:13:55.704032 32621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.684327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:37887 (local address 127.20.158.131:46805)
0811 08:13:55.684764 (+ 437us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.684774 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:55.685888 (+ 1114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:55.686198 (+ 310us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:55.686199 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:55.686642 (+ 443us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:13:55.686929 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.686934 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.687963 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.687964 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.689135 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.689139 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.689796 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.689797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.689935 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.690590 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:13:55.690599 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:13:55.698750 (+ 8151us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:13:55.700765 (+ 2015us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.700766 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.700767 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.701096 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.701335 (+ 239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:13:55.701336 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:13:55.701337 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:13:55.701402 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:13:55.703260 (+ 1858us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:13:55.703261 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:13:55.703308 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 08:13:55.703830 (+ 522us) client_negotiation.cc:240] Negotiation successful
0811 08:13:55.703942 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":382,"mutex_wait_us":37,"thread_start_us":74,"threads_started":1}
I20260811 08:13:55.704324 30584 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.158.131@KRBTEST.COM'} at 127.20.158.131:44527
I20260811 08:13:55.704761 32636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.692472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46480 (local address 127.20.158.189:37887)
0811 08:13:55.694282 (+ 1810us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.694285 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.694521 (+ 236us) server_negotiation.cc:407] Connection header received
0811 08:13:55.694543 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.694544 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.694556 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.694619 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:55.695327 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.696056 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.697207 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.697701 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.697780 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.699306 (+ 1526us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:55.699307 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:55.699307 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:55.699315 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:55.702510 (+ 3195us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.703286 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.703287 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.703288 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.703359 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.704194 (+ 835us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.704196 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.704196 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.704315 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:55.704392 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.704580 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.704672 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1785,"thread_start_us":60,"threads_started":1}
I20260811 08:13:55.704826 32631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.691801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43442 (local address 127.20.158.190:42743)
0811 08:13:55.691967 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.691969 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.692347 (+ 378us) server_negotiation.cc:407] Connection header received
0811 08:13:55.692460 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.692461 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.692475 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.692518 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:55.693387 (+ 869us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.694193 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.695336 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.695626 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.695666 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.697140 (+ 1474us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:55.697142 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:55.697142 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:55.697149 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:55.702040 (+ 4891us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.702447 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.702448 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.702448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.702508 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:55.703594 (+ 1086us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:55.703595 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:55.703595 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:55.703747 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:55.703822 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.704632 (+ 810us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.704715 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":54,"threads_started":1}
I20260811 08:13:55.705385 32617 heartbeater.cc:347] Connected to a master server at 127.20.158.189:37887
I20260811 08:13:55.705471 32617 heartbeater.cc:464] Registering TS with master...
I20260811 08:13:55.705569 32617 heartbeater.cc:511] Master 127.20.158.189:37887 requested a full tablet report, sending...
I20260811 08:13:55.705905 31589 ts_manager.cc:194] Registered new tserver with Master: bc0425573d80435b8fd3087778815fb4 (127.20.158.131:36963)
I20260811 08:13:55.707141 30584 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43442:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:13:55.708784 30584 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:13:55.716536 32650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.712591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:45099 (local address 127.0.0.1:39088)
0811 08:13:55.712850 (+ 259us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.712863 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:55.712922 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:55.713343 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:55.713345 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:55.713347 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:55.713400 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.713402 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.714771 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.714772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.715514 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.715516 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.716250 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.716251 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.716364 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.716369 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:13:55.716417 (+ 48us) client_negotiation.cc:240] Negotiation successful
0811 08:13:55.716461 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":89,"threads_started":1}
I20260811 08:13:55.716661 32653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.712833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39088 (local address 127.20.158.129:45099)
0811 08:13:55.713089 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.713095 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.713107 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:13:55.713153 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.713155 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.713174 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.713265 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:55.713484 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.714666 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.715614 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.716134 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.716357 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.716439 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.716467 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.716511 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":219,"thread_start_us":122,"threads_started":1}
I20260811 08:13:55.717208 32645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.712591 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:35183 (local address 127.0.0.1:50220)
0811 08:13:55.713085 (+ 494us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.713095 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:55.713140 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:55.713468 (+ 328us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:55.713469 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:55.713472 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:55.713521 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.713523 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.714565 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.714566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.715667 (+ 1101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.715670 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.716936 (+ 1266us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.716937 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.717003 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.717008 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:13:55.717074 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 08:13:55.717121 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":475,"mutex_wait_us":2,"thread_start_us":91,"threads_started":1}
I20260811 08:13:55.717373 32074 tablet_service.cc:1467] Processing CreateTablet for tablet dccdfb843fc049c1a00839b65050e58d (DEFAULT_TABLE table=test-table [id=6c782dccc696442bae37db21414e2165]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:55.717659 32655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.713064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50220 (local address 127.20.158.130:35183)
0811 08:13:55.713293 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.713297 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.713307 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:13:55.713348 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.713349 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.713364 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.713452 (+ 88us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:55.713635 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.714443 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.715762 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.716515 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.717369 (+ 854us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.717441 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.717469 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.717516 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":107,"threads_started":1}
I20260811 08:13:55.717819 32646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.712667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:36963 (local address 127.0.0.1:50724)
0811 08:13:55.713214 (+ 547us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.713235 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:55.713281 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:55.713577 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:55.713578 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:55.713580 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:55.713619 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.713620 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.714817 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.714818 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.716167 (+ 1349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.716170 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.717570 (+ 1400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.717571 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.717646 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.717650 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:13:55.717699 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 08:13:55.717757 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":530,"mutex_wait_us":279,"thread_start_us":79,"threads_started":1}
I20260811 08:13:55.717844 32074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dccdfb843fc049c1a00839b65050e58d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:55.718432 32654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.712805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50724 (local address 127.20.158.131:36963)
0811 08:13:55.713034 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.713039 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.713336 (+ 297us) server_negotiation.cc:407] Connection header received
0811 08:13:55.713382 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.713384 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.713396 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.713492 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:55.713704 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.714727 (+ 1023us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.716262 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.717013 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.718215 (+ 1202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.718280 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.718307 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.718354 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":200,"thread_start_us":132,"threads_started":1}
I20260811 08:13:55.718359 32280 tablet_service.cc:1467] Processing CreateTablet for tablet dccdfb843fc049c1a00839b65050e58d (DEFAULT_TABLE table=test-table [id=6c782dccc696442bae37db21414e2165]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:55.718703 32280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dccdfb843fc049c1a00839b65050e58d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:55.719030 32497 tablet_service.cc:1467] Processing CreateTablet for tablet dccdfb843fc049c1a00839b65050e58d (DEFAULT_TABLE table=test-table [id=6c782dccc696442bae37db21414e2165]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:55.719372 32497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dccdfb843fc049c1a00839b65050e58d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:55.721014 32656 tablet_bootstrap.cc:492] T dccdfb843fc049c1a00839b65050e58d P 695df11ce5ca41f891ded65eb66c8037: Bootstrap starting.
I20260811 08:13:55.721818 32656 tablet_bootstrap.cc:654] T dccdfb843fc049c1a00839b65050e58d P 695df11ce5ca41f891ded65eb66c8037: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:55.722146 32656 log.cc:824] T dccdfb843fc049c1a00839b65050e58d P 695df11ce5ca41f891ded65eb66c8037: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:55.722934 32656 tablet_bootstrap.cc:492] T dccdfb843fc049c1a00839b65050e58d P 695df11ce5ca41f891ded65eb66c8037: No bootstrap required, opened a new log
I20260811 08:13:55.723028 32656 ts_tablet_manager.cc:1397] T dccdfb843fc049c1a00839b65050e58d P 695df11ce5ca41f891ded65eb66c8037: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:13:55.723237 32660 tablet_bootstrap.cc:492] T dccdfb843fc049c1a00839b65050e58d P bc0425573d80435b8fd3087778815fb4: Bootstrap starting.
I20260811 08:13:55.724006 32660 tablet_bootstrap.cc:654] T dccdfb843fc049c1a00839b65050e58d P bc0425573d80435b8fd3087778815fb4: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:55.724376 32660 log.cc:824] T dccdfb843fc049c1a00839b65050e58d P bc0425573d80435b8fd3087778815fb4: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:55.725185 32660 tablet_bootstrap.cc:492] T dccdfb843fc049c1a00839b65050e58d P bc0425573d80435b8fd3087778815fb4: No bootstrap required, opened a new log
I20260811 08:13:55.725273 32660 ts_tablet_manager.cc:1397] T dccdfb843fc049c1a00839b65050e58d P bc0425573d80435b8fd3087778815fb4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:13:55.722640 32659 tablet_bootstrap.cc:492] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1: Bootstrap starting.
I20260811 08:13:55.726266 32659 tablet_bootstrap.cc:654] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:55.726143 32656 raft_consensus.cc:348] T dccdfb843fc049c1a00839b65050e58d P 695df11ce5ca41f891ded65eb66c8037 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051b4710423449f3aa3321f20aeabed1" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35183 } } peers { permanent_uuid: "695df11ce5ca41f891ded65eb66c8037" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45099 } } peers { permanent_uuid: "bc0425573d80435b8fd3087778815fb4" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36963 } }
I20260811 08:13:55.726332 32656 raft_consensus.cc:374] T dccdfb843fc049c1a00839b65050e58d P 695df11ce5ca41f891ded65eb66c8037 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:55.726380 32656 raft_consensus.cc:729] T dccdfb843fc049c1a00839b65050e58d P 695df11ce5ca41f891ded65eb66c8037 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 695df11ce5ca41f891ded65eb66c8037, State: Initialized, Role: FOLLOWER
I20260811 08:13:55.726513 32656 consensus_queue.cc:260] T dccdfb843fc049c1a00839b65050e58d P 695df11ce5ca41f891ded65eb66c8037 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051b4710423449f3aa3321f20aeabed1" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35183 } } peers { permanent_uuid: "695df11ce5ca41f891ded65eb66c8037" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45099 } } peers { permanent_uuid: "bc0425573d80435b8fd3087778815fb4" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36963 } }
I20260811 08:13:55.726809 32656 ts_tablet_manager.cc:1428] T dccdfb843fc049c1a00839b65050e58d P 695df11ce5ca41f891ded65eb66c8037: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 08:13:55.726905 32173 heartbeater.cc:503] Master 127.20.158.190:42743 was elected leader, sending a full tablet report...
I20260811 08:13:55.727001 32659 log.cc:824] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1: Log is configured to *not* fsync() on all Append() calls
I20260811 08:13:55.727417 32660 raft_consensus.cc:348] T dccdfb843fc049c1a00839b65050e58d P bc0425573d80435b8fd3087778815fb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051b4710423449f3aa3321f20aeabed1" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35183 } } peers { permanent_uuid: "695df11ce5ca41f891ded65eb66c8037" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45099 } } peers { permanent_uuid: "bc0425573d80435b8fd3087778815fb4" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36963 } }
I20260811 08:13:55.727579 32660 raft_consensus.cc:374] T dccdfb843fc049c1a00839b65050e58d P bc0425573d80435b8fd3087778815fb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:55.727624 32660 raft_consensus.cc:729] T dccdfb843fc049c1a00839b65050e58d P bc0425573d80435b8fd3087778815fb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc0425573d80435b8fd3087778815fb4, State: Initialized, Role: FOLLOWER
I20260811 08:13:55.727770 32659 tablet_bootstrap.cc:492] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1: No bootstrap required, opened a new log
I20260811 08:13:55.727734 32660 consensus_queue.cc:260] T dccdfb843fc049c1a00839b65050e58d P bc0425573d80435b8fd3087778815fb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051b4710423449f3aa3321f20aeabed1" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35183 } } peers { permanent_uuid: "695df11ce5ca41f891ded65eb66c8037" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45099 } } peers { permanent_uuid: "bc0425573d80435b8fd3087778815fb4" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36963 } }
I20260811 08:13:55.727845 32659 ts_tablet_manager.cc:1397] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260811 08:13:55.728019 32660 ts_tablet_manager.cc:1428] T dccdfb843fc049c1a00839b65050e58d P bc0425573d80435b8fd3087778815fb4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:13:55.728330 32616 heartbeater.cc:503] Master 127.20.158.190:42743 was elected leader, sending a full tablet report...
I20260811 08:13:55.730598 32659 raft_consensus.cc:348] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051b4710423449f3aa3321f20aeabed1" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35183 } } peers { permanent_uuid: "695df11ce5ca41f891ded65eb66c8037" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45099 } } peers { permanent_uuid: "bc0425573d80435b8fd3087778815fb4" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36963 } }
I20260811 08:13:55.730759 32659 raft_consensus.cc:374] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:55.730831 32659 raft_consensus.cc:729] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051b4710423449f3aa3321f20aeabed1, State: Initialized, Role: FOLLOWER
I20260811 08:13:55.730945 32659 consensus_queue.cc:260] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051b4710423449f3aa3321f20aeabed1" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35183 } } peers { permanent_uuid: "695df11ce5ca41f891ded65eb66c8037" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45099 } } peers { permanent_uuid: "bc0425573d80435b8fd3087778815fb4" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36963 } }
I20260811 08:13:55.731230 32659 ts_tablet_manager.cc:1428] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 08:13:55.731267 32383 heartbeater.cc:503] Master 127.20.158.190:42743 was elected leader, sending a full tablet report...
I20260811 08:13:55.749362 32646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.746758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:36775 (local address 127.0.0.1:49344)
0811 08:13:55.746832 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.746845 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:55.746910 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:55.747089 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:55.747090 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:55.747092 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:55.747142 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.747144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.747791 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.747792 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.748584 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.748587 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.749162 (+ 575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.749163 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.749214 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.749218 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:13:55.749261 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 08:13:55.749299 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 08:13:55.749368 32632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.746849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49344 (local address 127.20.158.188:36775)
0811 08:13:55.746911 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.746913 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.746923 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:13:55.746981 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.746982 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.747004 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.747067 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:55.747215 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.747719 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.748667 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.749076 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.749140 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.749196 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.749278 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.749316 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 08:13:55.749792 31902 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.9] Dedup: 1.7->[1.8-1.9]
I20260811 08:13:55.750824 32672 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c7c55b6e5de4652970c2f9776857e5d. Latest consensus state: current_term: 1 leader_uuid: "0c7c55b6e5de4652970c2f9776857e5d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: NON_VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: true } } }
I20260811 08:13:55.750948 32672 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [sys.catalog]: This master's current role is: LEARNER
W20260811 08:13:55.756433 32386 tablet.cc:2369] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:13:55.836839 32176 tablet.cc:2369] T dccdfb843fc049c1a00839b65050e58d P 695df11ce5ca41f891ded65eb66c8037: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:13:55.935441 32618 tablet.cc:2369] T dccdfb843fc049c1a00839b65050e58d P bc0425573d80435b8fd3087778815fb4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:13:55.979333 32670 raft_consensus.cc:482] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:13:55.979472 32670 raft_consensus.cc:504] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051b4710423449f3aa3321f20aeabed1" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35183 } } peers { permanent_uuid: "695df11ce5ca41f891ded65eb66c8037" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45099 } } peers { permanent_uuid: "bc0425573d80435b8fd3087778815fb4" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36963 } }
I20260811 08:13:55.979938 32670 leader_election.cc:288] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 695df11ce5ca41f891ded65eb66c8037 (127.20.158.129:45099), bc0425573d80435b8fd3087778815fb4 (127.20.158.131:36963)
I20260811 08:13:55.982981 32654 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.980262 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:34795 (local address 127.20.158.131:36963)
0811 08:13:55.980306 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.980308 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.980318 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:13:55.980420 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.980422 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.980431 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.980503 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:55.980697 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.981171 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.982208 (+ 1037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.982576 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.982670 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.982679 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.982866 (+ 187us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.982902 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:13:55.983009 32388 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.980151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:36963 (local address 127.20.158.130:34795)
0811 08:13:55.980242 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.980258 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:55.980330 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:55.980522 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:55.980523 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:55.980525 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:55.980601 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.980603 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.981273 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.981274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.982101 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.982104 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.982667 (+ 563us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.982668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.982778 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.982782 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:13:55.982860 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 08:13:55.982902 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 08:13:55.982995 32653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.980297 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:56481 (local address 127.20.158.129:45099)
0811 08:13:55.980342 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.980344 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.980353 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:13:55.980383 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.980384 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.980393 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.980470 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:55.980644 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.981137 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.982255 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.982626 (+ 371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.982719 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.982728 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.982887 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.982925 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:13:55.983027 32387 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.980151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:45099 (local address 127.20.158.130:56481)
0811 08:13:55.980248 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.980261 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:55.980309 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:55.980476 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:55.980477 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:55.980479 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:55.980556 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.980558 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.981243 (+ 685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.981244 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.982163 (+ 919us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.982166 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.982718 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.982719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.982804 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.982807 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:13:55.982880 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 08:13:55.982923 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80,"mutex_wait_us":57}
I20260811 08:13:55.983356 32669 raft_consensus.cc:482] T dccdfb843fc049c1a00839b65050e58d P bc0425573d80435b8fd3087778815fb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:13:55.983397 32102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dccdfb843fc049c1a00839b65050e58d" candidate_uuid: "051b4710423449f3aa3321f20aeabed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "695df11ce5ca41f891ded65eb66c8037" is_pre_election: true
I20260811 08:13:55.983461 32669 raft_consensus.cc:504] T dccdfb843fc049c1a00839b65050e58d P bc0425573d80435b8fd3087778815fb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051b4710423449f3aa3321f20aeabed1" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35183 } } peers { permanent_uuid: "695df11ce5ca41f891ded65eb66c8037" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45099 } } peers { permanent_uuid: "bc0425573d80435b8fd3087778815fb4" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36963 } }
I20260811 08:13:55.983548 32102 raft_consensus.cc:2454] T dccdfb843fc049c1a00839b65050e58d P 695df11ce5ca41f891ded65eb66c8037 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051b4710423449f3aa3321f20aeabed1 in term 0.
I20260811 08:13:55.983670 32534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dccdfb843fc049c1a00839b65050e58d" candidate_uuid: "051b4710423449f3aa3321f20aeabed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc0425573d80435b8fd3087778815fb4" is_pre_election: true
I20260811 08:13:55.983789 32211 leader_election.cc:302] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051b4710423449f3aa3321f20aeabed1, 695df11ce5ca41f891ded65eb66c8037; no voters:
I20260811 08:13:55.983821 32669 leader_election.cc:288] T dccdfb843fc049c1a00839b65050e58d P bc0425573d80435b8fd3087778815fb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051b4710423449f3aa3321f20aeabed1 (127.20.158.130:35183), 695df11ce5ca41f891ded65eb66c8037 (127.20.158.129:45099)
I20260811 08:13:55.983930 32670 raft_consensus.cc:2781] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:13:55.983987 32670 raft_consensus.cc:482] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:13:55.984023 32670 raft_consensus.cc:3037] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:55.983820 32534 raft_consensus.cc:2454] T dccdfb843fc049c1a00839b65050e58d P bc0425573d80435b8fd3087778815fb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 051b4710423449f3aa3321f20aeabed1 in term 0.
I20260811 08:13:55.985109 32670 raft_consensus.cc:504] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051b4710423449f3aa3321f20aeabed1" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35183 } } peers { permanent_uuid: "695df11ce5ca41f891ded65eb66c8037" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45099 } } peers { permanent_uuid: "bc0425573d80435b8fd3087778815fb4" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36963 } }
I20260811 08:13:55.985239 32670 leader_election.cc:288] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1 [CANDIDATE]: Term 1 election: Requested vote from peers 695df11ce5ca41f891ded65eb66c8037 (127.20.158.129:45099), bc0425573d80435b8fd3087778815fb4 (127.20.158.131:36963)
I20260811 08:13:55.985422 32102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dccdfb843fc049c1a00839b65050e58d" candidate_uuid: "051b4710423449f3aa3321f20aeabed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "695df11ce5ca41f891ded65eb66c8037"
I20260811 08:13:55.985495 32102 raft_consensus.cc:3037] T dccdfb843fc049c1a00839b65050e58d P 695df11ce5ca41f891ded65eb66c8037 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:55.986498 32102 raft_consensus.cc:2454] T dccdfb843fc049c1a00839b65050e58d P 695df11ce5ca41f891ded65eb66c8037 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051b4710423449f3aa3321f20aeabed1 in term 1.
I20260811 08:13:55.986646 32211 leader_election.cc:302] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051b4710423449f3aa3321f20aeabed1, 695df11ce5ca41f891ded65eb66c8037; no voters:
I20260811 08:13:55.986753 32670 raft_consensus.cc:2781] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:55.986776 32534 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dccdfb843fc049c1a00839b65050e58d" candidate_uuid: "051b4710423449f3aa3321f20aeabed1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bc0425573d80435b8fd3087778815fb4"
I20260811 08:13:55.986843 32534 raft_consensus.cc:3037] T dccdfb843fc049c1a00839b65050e58d P bc0425573d80435b8fd3087778815fb4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:55.986881 32670 raft_consensus.cc:686] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1 [term 1 LEADER]: Becoming Leader. State: Replica: 051b4710423449f3aa3321f20aeabed1, State: Running, Role: LEADER
I20260811 08:13:55.986981 32670 consensus_queue.cc:237] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051b4710423449f3aa3321f20aeabed1" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35183 } } peers { permanent_uuid: "695df11ce5ca41f891ded65eb66c8037" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45099 } } peers { permanent_uuid: "bc0425573d80435b8fd3087778815fb4" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36963 } }
I20260811 08:13:55.987730 32534 raft_consensus.cc:2454] T dccdfb843fc049c1a00839b65050e58d P bc0425573d80435b8fd3087778815fb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 051b4710423449f3aa3321f20aeabed1 in term 1.
I20260811 08:13:55.987854 32655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.984472 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:53323 (local address 127.20.158.130:35183)
0811 08:13:55.984547 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.984549 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.984556 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:13:55.984575 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.984576 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.984584 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.984645 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:55.984833 (+ 188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.985519 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.986940 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.987478 (+ 538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.987548 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.987556 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.987756 (+ 200us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.987798 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260811 08:13:55.987859 32621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.983985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:35183 (local address 127.20.158.131:53323)
0811 08:13:55.984087 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.984097 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:55.984134 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:55.984676 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:55.984677 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:55.984679 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:55.984747 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.984748 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.985630 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.985631 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.986844 (+ 1213us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.986846 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.987591 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.987592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.987666 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.987669 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:13:55.987751 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 08:13:55.987792 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85}
I20260811 08:13:55.988374 32309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dccdfb843fc049c1a00839b65050e58d" candidate_uuid: "bc0425573d80435b8fd3087778815fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051b4710423449f3aa3321f20aeabed1" is_pre_election: true
I20260811 08:13:55.988705 32653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.984147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:58291 (local address 127.20.158.129:45099)
0811 08:13:55.984188 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.984190 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.984199 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:13:55.984259 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.984259 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.984268 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:55.984314 (+ 46us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:55.984435 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.985144 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.986331 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.986844 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.986918 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.986928 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:55.988603 (+ 1675us) server_negotiation.cc:299] Negotiation successful
0811 08:13:55.988647 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:13:55.988709 32620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.984049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:45099 (local address 127.20.158.131:58291)
0811 08:13:55.984153 (+ 104us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:55.984165 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:55.984207 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:55.984327 (+ 120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:55.984328 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:55.984330 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:55.984383 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.984384 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.985237 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.985238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.986237 (+ 999us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:55.986240 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:55.988452 (+ 2212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:55.988453 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:55.988527 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:55.988531 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:13:55.988594 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 08:13:55.988634 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87}
I20260811 08:13:55.988739 30584 catalog_manager.cc:5495] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 051b4710423449f3aa3321f20aeabed1 (127.20.158.130). New cstate: current_term: 1 leader_uuid: "051b4710423449f3aa3321f20aeabed1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "051b4710423449f3aa3321f20aeabed1" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35183 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "695df11ce5ca41f891ded65eb66c8037" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bc0425573d80435b8fd3087778815fb4" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36963 } health_report { overall_health: UNKNOWN } } }
I20260811 08:13:55.988933 32102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dccdfb843fc049c1a00839b65050e58d" candidate_uuid: "bc0425573d80435b8fd3087778815fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "695df11ce5ca41f891ded65eb66c8037" is_pre_election: true
I20260811 08:13:55.989022 32102 raft_consensus.cc:2379] T dccdfb843fc049c1a00839b65050e58d P 695df11ce5ca41f891ded65eb66c8037 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bc0425573d80435b8fd3087778815fb4 in current term 1: Already voted for candidate 051b4710423449f3aa3321f20aeabed1 in this term.
I20260811 08:13:55.989252 32421 leader_election.cc:302] T dccdfb843fc049c1a00839b65050e58d P bc0425573d80435b8fd3087778815fb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bc0425573d80435b8fd3087778815fb4; no voters: 051b4710423449f3aa3321f20aeabed1, 695df11ce5ca41f891ded65eb66c8037
I20260811 08:13:55.989390 32669 raft_consensus.cc:2726] T dccdfb843fc049c1a00839b65050e58d P bc0425573d80435b8fd3087778815fb4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260811 08:13:55.989473 31837 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0c7c55b6e5de4652970c2f9776857e5d" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: NON_VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: true } } }
I20260811 08:13:55.989655 31837 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:55.990540 31837 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d: attempting to promote NON_VOTER 4a4168ab51744a179ae43449d338fa23 to VOTER
I20260811 08:13:55.990684 31837 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: false } }
I20260811 08:13:55.991461 31605 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 1 FOLLOWER]: Refusing update from remote peer 0c7c55b6e5de4652970c2f9776857e5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260811 08:13:55.991545 31902 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [term 1 LEARNER]: Refusing update from remote peer 0c7c55b6e5de4652970c2f9776857e5d: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260811 08:13:55.991685 32640 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260811 08:13:55.991842 32685 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260811 08:13:55.992478 32640 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 4a4168ab51744a179ae43449d338fa23 (127.20.158.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: false } } }
I20260811 08:13:55.992652 31605 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 4a4168ab51744a179ae43449d338fa23 (127.20.158.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: false } } }
I20260811 08:13:55.992992 31902 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 4a4168ab51744a179ae43449d338fa23 (127.20.158.188) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: false } } }
I20260811 08:13:55.993513 32640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "0c7c55b6e5de4652970c2f9776857e5d" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: false } } }
I20260811 08:13:55.993511 32687 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0c7c55b6e5de4652970c2f9776857e5d" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: false } } }
I20260811 08:13:55.993606 32640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:55.993615 32687 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:13:55.993664 32640 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0c7c55b6e5de4652970c2f9776857e5d" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: false } } }
I20260811 08:13:55.993703 32640 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:55.993732 32685 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0c7c55b6e5de4652970c2f9776857e5d" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: false } } }
I20260811 08:13:55.993808 32685 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:55.994180 32672 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0c7c55b6e5de4652970c2f9776857e5d" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: false } } }
I20260811 08:13:55.994275 32672 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:13:56.002285 32655 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:55.999845 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50236 (local address 127.20.158.130:35183)
0811 08:13:55.999900 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:55.999902 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:55.999913 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:13:55.999948 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:55.999949 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:55.999965 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:56.000029 (+ 64us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:56.000114 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:56.000727 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:56.001461 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:56.001748 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:56.001830 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:56.001947 (+ 117us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:56.002046 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:56.002106 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:56.002145 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 08:13:56.002162 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 08:13:56.004168 32534 raft_consensus.cc:1261] T dccdfb843fc049c1a00839b65050e58d P bc0425573d80435b8fd3087778815fb4 [term 1 FOLLOWER]: Refusing update from remote peer 051b4710423449f3aa3321f20aeabed1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:56.004468 32102 raft_consensus.cc:1261] T dccdfb843fc049c1a00839b65050e58d P 695df11ce5ca41f891ded65eb66c8037 [term 1 FOLLOWER]: Refusing update from remote peer 051b4710423449f3aa3321f20aeabed1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:56.004514 32670 consensus_queue.cc:1035] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bc0425573d80435b8fd3087778815fb4" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:13:56.004712 32677 consensus_queue.cc:1035] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "695df11ce5ca41f891ded65eb66c8037" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:13:56.007579 32689 mvcc.cc:205] Tried to move back new op lower bound from 7317242003470209024 to 7317242003403206656. Current Snapshot: MvccSnapshot[applied={T|T < 7317242003470209024}]
I20260811 08:13:56.007978 32691 mvcc.cc:205] Tried to move back new op lower bound from 7317242003470209024 to 7317242003403206656. Current Snapshot: MvccSnapshot[applied={T|T < 7317242003470209024}]
I20260811 08:13:56.010727 30584 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43442:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:13:56.010819 30584 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43442:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:13:56.012445 30584 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0c7c55b6e5de4652970c2f9776857e5d: Sending DeleteTablet for 3 replicas of tablet dccdfb843fc049c1a00839b65050e58d
I20260811 08:13:56.012867 32280 tablet_service.cc:1514] Processing DeleteTablet for tablet dccdfb843fc049c1a00839b65050e58d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:56 UTC) from {username='oryx', principal='oryx/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:50220
I20260811 08:13:56.013237 32074 tablet_service.cc:1514] Processing DeleteTablet for tablet dccdfb843fc049c1a00839b65050e58d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:56 UTC) from {username='oryx', principal='oryx/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:39088
I20260811 08:13:56.013504 32710 tablet_replica.cc:330] T dccdfb843fc049c1a00839b65050e58d P 695df11ce5ca41f891ded65eb66c8037: stopping tablet replica
I20260811 08:13:56.013635 32710 raft_consensus.cc:2229] T dccdfb843fc049c1a00839b65050e58d P 695df11ce5ca41f891ded65eb66c8037 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:13:56.013756 32710 raft_consensus.cc:2258] T dccdfb843fc049c1a00839b65050e58d P 695df11ce5ca41f891ded65eb66c8037 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:56.013859 32497 tablet_service.cc:1514] Processing DeleteTablet for tablet dccdfb843fc049c1a00839b65050e58d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:56 UTC) from {username='oryx', principal='oryx/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:50724
I20260811 08:13:56.014237 32712 tablet_replica.cc:330] T dccdfb843fc049c1a00839b65050e58d P bc0425573d80435b8fd3087778815fb4: stopping tablet replica
I20260811 08:13:56.014334 32712 raft_consensus.cc:2229] T dccdfb843fc049c1a00839b65050e58d P bc0425573d80435b8fd3087778815fb4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:13:56.014489 32712 raft_consensus.cc:2258] T dccdfb843fc049c1a00839b65050e58d P bc0425573d80435b8fd3087778815fb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:56.014580 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 30539
I20260811 08:13:56.017117 32712 ts_tablet_manager.cc:1905] T dccdfb843fc049c1a00839b65050e58d P bc0425573d80435b8fd3087778815fb4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:13:56.020105 32712 ts_tablet_manager.cc:1918] T dccdfb843fc049c1a00839b65050e58d P bc0425573d80435b8fd3087778815fb4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:13:56.020197 32712 log.cc:1196] T dccdfb843fc049c1a00839b65050e58d P bc0425573d80435b8fd3087778815fb4: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/wal/wals/dccdfb843fc049c1a00839b65050e58d
I20260811 08:13:56.020557 32712 ts_tablet_manager.cc:1939] T dccdfb843fc049c1a00839b65050e58d P bc0425573d80435b8fd3087778815fb4: Deleting consensus metadata
I20260811 08:13:56.024124 32708 tablet_replica.cc:330] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1: stopping tablet replica
I20260811 08:13:56.024262 32708 raft_consensus.cc:2229] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:13:56.024387 32708 raft_consensus.cc:2258] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:56.025137 32708 ts_tablet_manager.cc:1905] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:13:56.027638 32708 ts_tablet_manager.cc:1918] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:13:56.027724 32708 log.cc:1196] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/wal/wals/dccdfb843fc049c1a00839b65050e58d
I20260811 08:13:56.028082 32708 ts_tablet_manager.cc:1939] T dccdfb843fc049c1a00839b65050e58d P 051b4710423449f3aa3321f20aeabed1: Deleting consensus metadata
I20260811 08:13:56.030035 32632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:56.013423 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49348 (local address 127.20.158.188:36775)
0811 08:13:56.013467 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:56.013469 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:56.013871 (+ 402us) server_negotiation.cc:407] Connection header received
0811 08:13:56.013975 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:56.013976 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:56.013987 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:56.014020 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:56.022027 (+ 8007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:56.022815 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:56.024076 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:56.024477 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:56.024584 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:56.026417 (+ 1833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:56.026419 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:56.026419 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:56.026428 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:56.028345 (+ 1917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:56.028822 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:56.028823 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:56.028824 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:56.028909 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:56.029191 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:56.029192 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:56.029193 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:56.029385 (+ 192us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:56.029525 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:56.029802 (+ 277us) server_negotiation.cc:299] Negotiation successful
0811 08:13:56.029908 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:13:56.030485 32710 ts_tablet_manager.cc:1905] T dccdfb843fc049c1a00839b65050e58d P 695df11ce5ca41f891ded65eb66c8037: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 08:13:56.032006 32422 connection.cc:535] server connection from 127.0.0.1:50724 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260811 08:13:56.032207 32215 connection.cc:535] server connection from 127.0.0.1:50220 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 08:13:56.032574 32710 ts_tablet_manager.cc:1918] T dccdfb843fc049c1a00839b65050e58d P 695df11ce5ca41f891ded65eb66c8037: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:13:56.032689 32710 log.cc:1196] T dccdfb843fc049c1a00839b65050e58d P 695df11ce5ca41f891ded65eb66c8037: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-0/wal/wals/dccdfb843fc049c1a00839b65050e58d
I20260811 08:13:56.033034 32710 ts_tablet_manager.cc:1939] T dccdfb843fc049c1a00839b65050e58d P 695df11ce5ca41f891ded65eb66c8037: Deleting consensus metadata
W20260811 08:13:56.033438 32004 connection.cc:441] server connection from 127.0.0.1:39088 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:39088 (request call id 1) could send its response
I20260811 08:13:56.043104 32632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:56.034199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49360 (local address 127.20.158.188:36775)
0811 08:13:56.034250 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:56.034253 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:56.034418 (+ 165us) server_negotiation.cc:407] Connection header received
0811 08:13:56.034517 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:56.034518 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:56.034528 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:56.034556 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:56.035269 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:56.036057 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:56.037334 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:56.037682 (+ 348us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:56.037729 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:56.039610 (+ 1881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:56.039611 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:56.039612 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:56.039620 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:56.041675 (+ 2055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:56.042158 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:56.042159 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:56.042160 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:56.042227 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:56.042468 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:56.042469 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:56.042470 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:56.042616 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:56.042717 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:56.042912 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 08:13:56.042995 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:13:56.043303 32636 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:56.034533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46494 (local address 127.20.158.189:37887)
0811 08:13:56.034597 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:56.034600 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:56.034609 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:13:56.034637 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:56.034638 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:56.034652 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:56.034753 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:13:56.035922 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:56.036577 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:56.037425 (+ 848us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:56.037863 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:56.037974 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:56.039444 (+ 1470us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:13:56.039446 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:13:56.039446 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:13:56.039455 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:13:56.041496 (+ 2041us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:56.042021 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:56.042023 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:56.042023 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:56.042108 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:13:56.042416 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:13:56.042418 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:13:56.042418 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:13:56.042581 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:13:56.042685 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:56.042929 (+ 244us) server_negotiation.cc:299] Negotiation successful
0811 08:13:56.043171 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 08:13:57.012365 32725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:57.011012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.20.158.131:51943)
0811 08:13:57.012204 (+ 1192us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:57.012301 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1169,"thread_start_us":66,"threads_started":1}
I20260811 08:13:57.012562 32727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:57.011782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.20.158.129:49895)
0811 08:13:57.012161 (+ 379us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:57.012289 (+ 128us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":356,"thread_start_us":64,"threads_started":1}
W20260811 08:13:57.012880 32173 heartbeater.cc:644] Failed to heartbeat to 127.20.158.190:42743 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
W20260811 08:13:57.013378 32616 heartbeater.cc:644] Failed to heartbeat to 127.20.158.190:42743 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
I20260811 08:13:57.014256 32728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:57.011989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.20.158.130:54539)
0811 08:13:57.014101 (+ 2112us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:57.014174 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2092,"thread_start_us":50,"threads_started":1}
W20260811 08:13:57.014444 32383 heartbeater.cc:644] Failed to heartbeat to 127.20.158.190:42743 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
I20260811 08:13:57.513094 32730 raft_consensus.cc:482] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7c55b6e5de4652970c2f9776857e5d)
I20260811 08:13:57.513281 32731 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0c7c55b6e5de4652970c2f9776857e5d)
I20260811 08:13:57.513264 32730 raft_consensus.cc:504] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: false } }
I20260811 08:13:57.513454 32731 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: false } }
I20260811 08:13:57.513676 32730 leader_election.cc:288] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c7c55b6e5de4652970c2f9776857e5d (127.20.158.190:42743), 4a4168ab51744a179ae43449d338fa23 (127.20.158.188:36775)
I20260811 08:13:57.513840 32731 leader_election.cc:288] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0c7c55b6e5de4652970c2f9776857e5d (127.20.158.190:42743), a8b7920051704b6789caa713e738bd9d (127.20.158.189:37887)
I20260811 08:13:57.514087 32733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:57.513858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.0.0.1:56420)
0811 08:13:57.513983 (+ 125us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:57.514038 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":57,"threads_started":1}
W20260811 08:13:57.514205 31555 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
I20260811 08:13:57.514328 32738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:57.513954 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.0.0.1:56424)
0811 08:13:57.514233 (+ 279us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:57.514292 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":264,"thread_start_us":48,"threads_started":1}
W20260811 08:13:57.514432 31866 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
I20260811 08:13:57.514827 32738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:57.514750 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.0.0.1:56432)
0811 08:13:57.514783 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:57.514805 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260811 08:13:57.514828 32733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:57.514741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.0.0.1:56430)
0811 08:13:57.514781 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:57.514805 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 08:13:57.514905 31866 leader_election.cc:334] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c7c55b6e5de4652970c2f9776857e5d (127.20.158.190:42743): Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
W20260811 08:13:57.514927 31555 leader_election.cc:334] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0c7c55b6e5de4652970c2f9776857e5d (127.20.158.190:42743): Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
I20260811 08:13:57.517948 32734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:57.513865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:36775 (local address 127.0.0.1:54454)
0811 08:13:57.514061 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:57.514072 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:57.514130 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:57.514590 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:57.514591 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:57.514594 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:57.514661 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:57.514663 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:57.515697 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:57.515698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:57.516896 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:57.516899 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:57.517670 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:57.517671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:57.517743 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:57.517747 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:13:57.517806 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 08:13:57.517847 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":48,"threads_started":1}
I20260811 08:13:57.517953 32735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:57.514092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:37887 (local address 127.0.0.1:44394)
0811 08:13:57.514334 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:57.514344 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:57.514399 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:57.514611 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:57.514612 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:57.514613 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:57.514661 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:57.514663 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:57.515637 (+ 974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:57.515638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:57.516896 (+ 1258us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:57.516899 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:57.517670 (+ 771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:57.517671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:57.517738 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:57.517743 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:13:57.517806 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 08:13:57.517846 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"thread_start_us":35,"threads_started":1}
I20260811 08:13:57.518033 32741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:57.514204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44394 (local address 127.20.158.189:37887)
0811 08:13:57.514484 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:57.514486 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:57.514493 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:13:57.514515 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:57.514516 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:57.514525 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:57.514726 (+ 201us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:57.514753 (+ 27us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:57.515540 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:57.516999 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:57.517578 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:57.517657 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:57.517666 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:57.517839 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 08:13:57.517883 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":264,"thread_start_us":50,"threads_started":1}
I20260811 08:13:57.518196 32740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:57.514080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54454 (local address 127.20.158.188:36775)
0811 08:13:57.514258 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:57.514260 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:57.514270 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:13:57.514299 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:57.514300 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:57.514445 (+ 145us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:57.514726 (+ 281us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:57.514753 (+ 27us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:57.515610 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:57.516999 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:57.517577 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:57.517657 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:57.517666 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:57.517839 (+ 173us) server_negotiation.cc:299] Negotiation successful
0811 08:13:57.517883 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":55,"threads_started":1}
I20260811 08:13:57.518267 31605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a4168ab51744a179ae43449d338fa23" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a8b7920051704b6789caa713e738bd9d" is_pre_election: true
I20260811 08:13:57.518396 31605 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a4168ab51744a179ae43449d338fa23 in term 1.
I20260811 08:13:57.518371 31902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a8b7920051704b6789caa713e738bd9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "4a4168ab51744a179ae43449d338fa23" is_pre_election: true
I20260811 08:13:57.518453 31902 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8b7920051704b6789caa713e738bd9d in term 1.
I20260811 08:13:57.518570 31866 leader_election.cc:302] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a4168ab51744a179ae43449d338fa23, a8b7920051704b6789caa713e738bd9d; no voters: 0c7c55b6e5de4652970c2f9776857e5d
I20260811 08:13:57.518611 31562 leader_election.cc:302] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a4168ab51744a179ae43449d338fa23, a8b7920051704b6789caa713e738bd9d; no voters: 0c7c55b6e5de4652970c2f9776857e5d
I20260811 08:13:57.518688 32731 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 08:13:57.518734 32731 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c7c55b6e5de4652970c2f9776857e5d)
I20260811 08:13:57.518723 32730 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260811 08:13:57.518755 32731 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [term 1 FOLLOWER]: Advancing to term 2
I20260811 08:13:57.518803 32730 raft_consensus.cc:482] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0c7c55b6e5de4652970c2f9776857e5d)
I20260811 08:13:57.518834 32730 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 1 FOLLOWER]: Advancing to term 2
I20260811 08:13:57.519528 32731 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: false } }
I20260811 08:13:57.519529 32730 raft_consensus.cc:504] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: false } }
I20260811 08:13:57.519690 32731 leader_election.cc:288] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [CANDIDATE]: Term 2 election: Requested vote from peers 0c7c55b6e5de4652970c2f9776857e5d (127.20.158.190:42743), a8b7920051704b6789caa713e738bd9d (127.20.158.189:37887)
I20260811 08:13:57.519706 32730 leader_election.cc:288] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [CANDIDATE]: Term 2 election: Requested vote from peers 0c7c55b6e5de4652970c2f9776857e5d (127.20.158.190:42743), 4a4168ab51744a179ae43449d338fa23 (127.20.158.188:36775)
I20260811 08:13:57.519877 32735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:57.519775 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.0.0.1:56448)
0811 08:13:57.519814 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:57.519847 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260811 08:13:57.519901 31605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a4168ab51744a179ae43449d338fa23" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a8b7920051704b6789caa713e738bd9d"
I20260811 08:13:57.519901 31902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a8b7920051704b6789caa713e738bd9d" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "4a4168ab51744a179ae43449d338fa23"
I20260811 08:13:57.520001 31902 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a8b7920051704b6789caa713e738bd9d in current term 2: Already voted for candidate 4a4168ab51744a179ae43449d338fa23 in this term.
I20260811 08:13:57.519990 32734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:57.519839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.0.0.1:56458)
0811 08:13:57.519878 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:57.519899 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260811 08:13:57.519999 31605 raft_consensus.cc:2379] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 4a4168ab51744a179ae43449d338fa23 in current term 2: Already voted for candidate a8b7920051704b6789caa713e738bd9d in this term.
I20260811 08:13:57.520438 32734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:57.520335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.0.0.1:56472)
0811 08:13:57.520393 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:57.520420 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 08:13:57.520525 31555 leader_election.cc:334] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0c7c55b6e5de4652970c2f9776857e5d (127.20.158.190:42743): Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
I20260811 08:13:57.520581 32735 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:57.520335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.0.0.1:56462)
0811 08:13:57.520508 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:57.520529 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":159}
I20260811 08:13:57.520591 31555 leader_election.cc:302] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a8b7920051704b6789caa713e738bd9d; no voters: 0c7c55b6e5de4652970c2f9776857e5d, 4a4168ab51744a179ae43449d338fa23
W20260811 08:13:57.520674 31866 leader_election.cc:334] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0c7c55b6e5de4652970c2f9776857e5d (127.20.158.190:42743): Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
I20260811 08:13:57.520689 32730 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 08:13:57.520720 31866 leader_election.cc:302] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a4168ab51744a179ae43449d338fa23; no voters: 0c7c55b6e5de4652970c2f9776857e5d, a8b7920051704b6789caa713e738bd9d
I20260811 08:13:57.520848 32731 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260811 08:13:58.013464 32747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:58.013243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.20.158.129:34061)
0811 08:13:58.013372 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:58.013417 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":66,"threads_started":1}
I20260811 08:13:58.014052 32749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:58.013766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.20.158.131:39845)
0811 08:13:58.013966 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:58.014004 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":121,"threads_started":1}
I20260811 08:13:58.014935 32750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:58.014749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.20.158.130:38649)
0811 08:13:58.014860 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:58.014900 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":94,"thread_start_us":71,"threads_started":1}
I20260811 08:13:59.014315 32752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.014055 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.20.158.129:43067)
0811 08:13:59.014187 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:59.014231 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":65,"threads_started":1}
I20260811 08:13:59.014743 32753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.014491 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.20.158.131:57685)
0811 08:13:59.014646 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:59.014695 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":79,"threads_started":1}
I20260811 08:13:59.015570 32755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.015381 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.20.158.130:35707)
0811 08:13:59.015498 (+ 117us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:59.015534 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":59,"threads_started":1}
I20260811 08:13:59.192950 32756 raft_consensus.cc:482] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:13:59.193086 32756 raft_consensus.cc:504] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: false } }
I20260811 08:13:59.193327 32756 leader_election.cc:288] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0c7c55b6e5de4652970c2f9776857e5d (127.20.158.190:42743), 4a4168ab51744a179ae43449d338fa23 (127.20.158.188:36775)
I20260811 08:13:59.193636 31902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a8b7920051704b6789caa713e738bd9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "4a4168ab51744a179ae43449d338fa23" is_pre_election: true
I20260811 08:13:59.193755 32757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.193489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.0.0.1:56682)
0811 08:13:59.193642 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:59.193693 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":97,"threads_started":1}
I20260811 08:13:59.193758 31902 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a8b7920051704b6789caa713e738bd9d in term 2.
I20260811 08:13:59.193921 31562 leader_election.cc:302] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a4168ab51744a179ae43449d338fa23, a8b7920051704b6789caa713e738bd9d; no voters:
I20260811 08:13:59.194169 32756 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260811 08:13:59.194232 32757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.194088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.0.0.1:56690)
0811 08:13:59.194148 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:59.194176 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 08:13:59.194284 32756 raft_consensus.cc:482] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:13:59.194331 32756 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 2 FOLLOWER]: Advancing to term 3
W20260811 08:13:59.194365 31555 leader_election.cc:334] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0c7c55b6e5de4652970c2f9776857e5d (127.20.158.190:42743): Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
I20260811 08:13:59.195214 32756 raft_consensus.cc:504] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: false } }
I20260811 08:13:59.195375 32756 leader_election.cc:288] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [CANDIDATE]: Term 3 election: Requested vote from peers 0c7c55b6e5de4652970c2f9776857e5d (127.20.158.190:42743), 4a4168ab51744a179ae43449d338fa23 (127.20.158.188:36775)
I20260811 08:13:59.195565 32757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.195464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.0.0.1:56694)
0811 08:13:59.195506 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:59.195539 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260811 08:13:59.195621 31902 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a8b7920051704b6789caa713e738bd9d" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "4a4168ab51744a179ae43449d338fa23"
I20260811 08:13:59.195710 31902 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [term 2 FOLLOWER]: Advancing to term 3
I20260811 08:13:59.195873 32757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.195786 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.0.0.1:56698)
0811 08:13:59.195822 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:59.195850 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260811 08:13:59.195943 31555 leader_election.cc:334] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0c7c55b6e5de4652970c2f9776857e5d (127.20.158.190:42743): Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
I20260811 08:13:59.196419 31902 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a8b7920051704b6789caa713e738bd9d in term 3.
I20260811 08:13:59.196599 31562 leader_election.cc:302] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4a4168ab51744a179ae43449d338fa23, a8b7920051704b6789caa713e738bd9d; no voters: 0c7c55b6e5de4652970c2f9776857e5d
I20260811 08:13:59.196702 32756 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 3 FOLLOWER]: Leader election won for term 3
I20260811 08:13:59.196841 32756 raft_consensus.cc:686] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [term 3 LEADER]: Becoming Leader. State: Replica: a8b7920051704b6789caa713e738bd9d, State: Running, Role: LEADER
I20260811 08:13:59.196933 32756 consensus_queue.cc:237] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: false } }
I20260811 08:13:59.197353 32760 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8b7920051704b6789caa713e738bd9d. Latest consensus state: current_term: 3 leader_uuid: "a8b7920051704b6789caa713e738bd9d" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: false } } }
I20260811 08:13:59.197458 32760 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:59.197683 32762 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:13:59.198185 32762 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:13:59.198299 32762 catalog_manager.cc:1259] Loaded cluster ID: 4f01a006eb6d4cb98524ade29d05c262
I20260811 08:13:59.198338 32762 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:13:59.198549 32762 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:13:59.198648 32762 catalog_manager.cc:5879] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d: Loaded TSK: 0
I20260811 08:13:59.198815 32762 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:13:59.212879 31589 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46494:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:13:59.214570 31589 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:13:59.215639 32757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.215506 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.0.0.1:56722)
0811 08:13:59.215570 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:59.215609 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 08:13:59.215636 31902 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [term 3 FOLLOWER]: Refusing update from remote peer a8b7920051704b6789caa713e738bd9d: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260811 08:13:59.215902 32760 consensus_queue.cc:1035] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260811 08:13:59.215994 32757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.215915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.0.0.1:56726)
0811 08:13:59.215944 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:59.215972 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":16}
W20260811 08:13:59.216084 31555 consensus_peers.cc:487] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d -> Peer 0c7c55b6e5de4652970c2f9776857e5d (127.20.158.190:42743): Couldn't send request to peer 0c7c55b6e5de4652970c2f9776857e5d. Status: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260811 08:13:59.216536 300 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8b7920051704b6789caa713e738bd9d. Latest consensus state: current_term: 3 leader_uuid: "a8b7920051704b6789caa713e738bd9d" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: false } } }
I20260811 08:13:59.216658 300 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:13:59.217136 32756 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "a8b7920051704b6789caa713e738bd9d" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: false } } }
I20260811 08:13:59.217252 32756 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d [sys.catalog]: This master's current role is: LEADER
I20260811 08:13:59.217288 300 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "a8b7920051704b6789caa713e738bd9d" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "0c7c55b6e5de4652970c2f9776857e5d" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42743 } } peers { permanent_uuid: "a8b7920051704b6789caa713e738bd9d" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37887 } attrs { promote: false } } peers { permanent_uuid: "4a4168ab51744a179ae43449d338fa23" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 36775 } attrs { promote: false } } }
I20260811 08:13:59.217931 300 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a4168ab51744a179ae43449d338fa23 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:13:59.222376 32757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.218867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:36963 (local address 127.0.0.1:46900)
0811 08:13:59.218960 (+ 93us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:59.218971 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:59.219022 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:59.219533 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:59.219534 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:59.219536 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:59.219586 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:59.219588 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:59.220302 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:59.220303 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:59.221177 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:59.221180 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:59.222137 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:59.222138 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:59.222205 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:59.222210 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:13:59.222241 (+ 31us) client_negotiation.cc:240] Negotiation successful
0811 08:13:59.222282 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":79}
I20260811 08:13:59.222481 312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.218955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:35183 (local address 127.0.0.1:40440)
0811 08:13:59.219162 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:59.219174 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:59.219224 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:59.219442 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:59.219443 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:59.219445 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:59.219518 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:59.219520 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:59.220167 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:59.220168 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:59.221285 (+ 1117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:59.221288 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:59.222211 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:59.222212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:59.222289 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:59.222295 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 08:13:59.222352 (+ 57us) client_negotiation.cc:240] Negotiation successful
0811 08:13:59.222395 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"mutex_wait_us":1,"thread_start_us":96,"threads_started":1}
I20260811 08:13:59.222635 313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.218973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46900 (local address 127.20.158.131:36963)
0811 08:13:59.219319 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:59.219321 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:59.219329 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:13:59.219385 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:59.219386 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:59.219399 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:59.219653 (+ 254us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:59.219701 (+ 48us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:59.220201 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:59.221274 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:59.222035 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:59.222498 (+ 463us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:59.222507 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:59.222527 (+ 20us) server_negotiation.cc:299] Negotiation successful
0811 08:13:59.222566 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":324,"thread_start_us":83,"threads_started":1}
I20260811 08:13:59.222927 32497 tablet_service.cc:1467] Processing CreateTablet for tablet d950a9c240b14f658b8ad4ec3ce56ab8 (DEFAULT_TABLE table=test-table [id=dc514a6d75234c679acbd5c2805914f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:59.223109 32497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d950a9c240b14f658b8ad4ec3ce56ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:59.223209 314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.219146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40440 (local address 127.20.158.130:35183)
0811 08:13:59.219288 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:59.219290 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:59.219297 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:13:59.219324 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:59.219325 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:59.219339 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:59.219437 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:59.219580 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:59.220079 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:59.221491 (+ 1412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:59.222120 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:59.222193 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:59.222204 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:59.223076 (+ 872us) server_negotiation.cc:299] Negotiation successful
0811 08:13:59.223135 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":95,"threads_started":1}
I20260811 08:13:59.223280 317 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.219155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59112 (local address 127.20.158.129:45099)
0811 08:13:59.219525 (+ 370us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:59.219527 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:59.220455 (+ 928us) server_negotiation.cc:407] Connection header received
0811 08:13:59.220486 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:59.220487 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:59.220498 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:59.220559 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:13:59.220656 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:59.221351 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:59.222380 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:59.222938 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:59.223001 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:59.223008 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:59.223167 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 08:13:59.223204 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348,"thread_start_us":92,"threads_started":1}
I20260811 08:13:59.223286 310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.218962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:45099 (local address 127.0.0.1:59112)
0811 08:13:59.220350 (+ 1388us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:59.220361 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:13:59.220414 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:13:59.220559 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:13:59.220560 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:13:59.220562 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:13:59.220602 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:59.220603 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:59.221410 (+ 807us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:59.221411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:59.222282 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:13:59.222284 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:13:59.223025 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:13:59.223026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:13:59.223094 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:59.223098 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:13:59.223163 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 08:13:59.223203 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1361,"thread_start_us":87,"threads_started":1}
I20260811 08:13:59.223510 32074 tablet_service.cc:1467] Processing CreateTablet for tablet d950a9c240b14f658b8ad4ec3ce56ab8 (DEFAULT_TABLE table=test-table [id=dc514a6d75234c679acbd5c2805914f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:59.223614 32074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d950a9c240b14f658b8ad4ec3ce56ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:59.224519 318 tablet_bootstrap.cc:492] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4: Bootstrap starting.
I20260811 08:13:59.224649 32280 tablet_service.cc:1467] Processing CreateTablet for tablet d950a9c240b14f658b8ad4ec3ce56ab8 (DEFAULT_TABLE table=test-table [id=dc514a6d75234c679acbd5c2805914f7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:13:59.224761 32280 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d950a9c240b14f658b8ad4ec3ce56ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:13:59.224905 318 tablet_bootstrap.cc:654] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:59.225090 319 tablet_bootstrap.cc:492] T d950a9c240b14f658b8ad4ec3ce56ab8 P 695df11ce5ca41f891ded65eb66c8037: Bootstrap starting.
I20260811 08:13:59.225461 319 tablet_bootstrap.cc:654] T d950a9c240b14f658b8ad4ec3ce56ab8 P 695df11ce5ca41f891ded65eb66c8037: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:59.225600 318 tablet_bootstrap.cc:492] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4: No bootstrap required, opened a new log
I20260811 08:13:59.225651 318 ts_tablet_manager.cc:1397] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:59.225812 318 raft_consensus.cc:348] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc0425573d80435b8fd3087778815fb4" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36963 } } peers { permanent_uuid: "051b4710423449f3aa3321f20aeabed1" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35183 } } peers { permanent_uuid: "695df11ce5ca41f891ded65eb66c8037" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45099 } }
I20260811 08:13:59.225888 318 raft_consensus.cc:374] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:59.225921 318 raft_consensus.cc:729] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bc0425573d80435b8fd3087778815fb4, State: Initialized, Role: FOLLOWER
I20260811 08:13:59.225971 318 consensus_queue.cc:260] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc0425573d80435b8fd3087778815fb4" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36963 } } peers { permanent_uuid: "051b4710423449f3aa3321f20aeabed1" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35183 } } peers { permanent_uuid: "695df11ce5ca41f891ded65eb66c8037" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45099 } }
I20260811 08:13:59.226166 318 ts_tablet_manager.cc:1428] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 08:13:59.226197 319 tablet_bootstrap.cc:492] T d950a9c240b14f658b8ad4ec3ce56ab8 P 695df11ce5ca41f891ded65eb66c8037: No bootstrap required, opened a new log
I20260811 08:13:59.226243 319 ts_tablet_manager.cc:1397] T d950a9c240b14f658b8ad4ec3ce56ab8 P 695df11ce5ca41f891ded65eb66c8037: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 08:13:59.226408 319 raft_consensus.cc:348] T d950a9c240b14f658b8ad4ec3ce56ab8 P 695df11ce5ca41f891ded65eb66c8037 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc0425573d80435b8fd3087778815fb4" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36963 } } peers { permanent_uuid: "051b4710423449f3aa3321f20aeabed1" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35183 } } peers { permanent_uuid: "695df11ce5ca41f891ded65eb66c8037" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45099 } }
I20260811 08:13:59.226476 319 raft_consensus.cc:374] T d950a9c240b14f658b8ad4ec3ce56ab8 P 695df11ce5ca41f891ded65eb66c8037 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:59.226496 319 raft_consensus.cc:729] T d950a9c240b14f658b8ad4ec3ce56ab8 P 695df11ce5ca41f891ded65eb66c8037 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 695df11ce5ca41f891ded65eb66c8037, State: Initialized, Role: FOLLOWER
I20260811 08:13:59.226548 32753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.226378 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.20.158.131:37257)
0811 08:13:59.226484 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:59.226517 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260811 08:13:59.226749 319 consensus_queue.cc:260] T d950a9c240b14f658b8ad4ec3ce56ab8 P 695df11ce5ca41f891ded65eb66c8037 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc0425573d80435b8fd3087778815fb4" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36963 } } peers { permanent_uuid: "051b4710423449f3aa3321f20aeabed1" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35183 } } peers { permanent_uuid: "695df11ce5ca41f891ded65eb66c8037" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45099 } }
I20260811 08:13:59.226972 319 ts_tablet_manager.cc:1428] T d950a9c240b14f658b8ad4ec3ce56ab8 P 695df11ce5ca41f891ded65eb66c8037: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260811 08:13:59.227322 32752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.227227 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.20.158.129:43231)
0811 08:13:59.227267 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:59.227292 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260811 08:13:59.227605 32617 heartbeater.cc:503] Master 127.20.158.189:37887 was elected leader, sending a full tablet report...
I20260811 08:13:59.227705 32753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.227523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.20.158.131:59989)
0811 08:13:59.227643 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:59.227675 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":99}
I20260811 08:13:59.227772 32752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.227694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.20.158.129:54629)
0811 08:13:59.227728 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:59.227748 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260811 08:13:59.228108 32174 heartbeater.cc:503] Master 127.20.158.189:37887 was elected leader, sending a full tablet report...
I20260811 08:13:59.228036 325 tablet_bootstrap.cc:492] T d950a9c240b14f658b8ad4ec3ce56ab8 P 051b4710423449f3aa3321f20aeabed1: Bootstrap starting.
I20260811 08:13:59.228629 325 tablet_bootstrap.cc:654] T d950a9c240b14f658b8ad4ec3ce56ab8 P 051b4710423449f3aa3321f20aeabed1: Neither blocks nor log segments found. Creating new log.
I20260811 08:13:59.229246 325 tablet_bootstrap.cc:492] T d950a9c240b14f658b8ad4ec3ce56ab8 P 051b4710423449f3aa3321f20aeabed1: No bootstrap required, opened a new log
I20260811 08:13:59.229319 325 ts_tablet_manager.cc:1397] T d950a9c240b14f658b8ad4ec3ce56ab8 P 051b4710423449f3aa3321f20aeabed1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:13:59.229430 325 raft_consensus.cc:348] T d950a9c240b14f658b8ad4ec3ce56ab8 P 051b4710423449f3aa3321f20aeabed1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc0425573d80435b8fd3087778815fb4" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36963 } } peers { permanent_uuid: "051b4710423449f3aa3321f20aeabed1" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35183 } } peers { permanent_uuid: "695df11ce5ca41f891ded65eb66c8037" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45099 } }
I20260811 08:13:59.229509 325 raft_consensus.cc:374] T d950a9c240b14f658b8ad4ec3ce56ab8 P 051b4710423449f3aa3321f20aeabed1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:13:59.229534 325 raft_consensus.cc:729] T d950a9c240b14f658b8ad4ec3ce56ab8 P 051b4710423449f3aa3321f20aeabed1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 051b4710423449f3aa3321f20aeabed1, State: Initialized, Role: FOLLOWER
I20260811 08:13:59.229605 325 consensus_queue.cc:260] T d950a9c240b14f658b8ad4ec3ce56ab8 P 051b4710423449f3aa3321f20aeabed1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc0425573d80435b8fd3087778815fb4" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36963 } } peers { permanent_uuid: "051b4710423449f3aa3321f20aeabed1" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35183 } } peers { permanent_uuid: "695df11ce5ca41f891ded65eb66c8037" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45099 } }
I20260811 08:13:59.230083 32755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.229940 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.20.158.130:53375)
0811 08:13:59.229974 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:59.230001 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
I20260811 08:13:59.229779 325 ts_tablet_manager.cc:1428] T d950a9c240b14f658b8ad4ec3ce56ab8 P 051b4710423449f3aa3321f20aeabed1: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 08:13:59.230494 32385 heartbeater.cc:503] Master 127.20.158.189:37887 was elected leader, sending a full tablet report...
I20260811 08:13:59.230744 32755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.230614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.20.158.130:57013)
0811 08:13:59.230680 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:59.230712 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260811 08:13:59.505074 323 raft_consensus.cc:482] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:13:59.505174 323 raft_consensus.cc:504] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc0425573d80435b8fd3087778815fb4" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36963 } } peers { permanent_uuid: "051b4710423449f3aa3321f20aeabed1" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35183 } } peers { permanent_uuid: "695df11ce5ca41f891ded65eb66c8037" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45099 } }
I20260811 08:13:59.505366 323 leader_election.cc:288] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 051b4710423449f3aa3321f20aeabed1 (127.20.158.130:35183), 695df11ce5ca41f891ded65eb66c8037 (127.20.158.129:45099)
I20260811 08:13:59.505671 32309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d950a9c240b14f658b8ad4ec3ce56ab8" candidate_uuid: "bc0425573d80435b8fd3087778815fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051b4710423449f3aa3321f20aeabed1" is_pre_election: true
I20260811 08:13:59.505676 32102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d950a9c240b14f658b8ad4ec3ce56ab8" candidate_uuid: "bc0425573d80435b8fd3087778815fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "695df11ce5ca41f891ded65eb66c8037" is_pre_election: true
I20260811 08:13:59.505796 32102 raft_consensus.cc:2454] T d950a9c240b14f658b8ad4ec3ce56ab8 P 695df11ce5ca41f891ded65eb66c8037 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc0425573d80435b8fd3087778815fb4 in term 0.
I20260811 08:13:59.505812 32309 raft_consensus.cc:2454] T d950a9c240b14f658b8ad4ec3ce56ab8 P 051b4710423449f3aa3321f20aeabed1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bc0425573d80435b8fd3087778815fb4 in term 0.
I20260811 08:13:59.505987 32421 leader_election.cc:302] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 695df11ce5ca41f891ded65eb66c8037, bc0425573d80435b8fd3087778815fb4; no voters:
I20260811 08:13:59.506112 323 raft_consensus.cc:2781] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:13:59.506170 323 raft_consensus.cc:482] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:13:59.506193 323 raft_consensus.cc:3037] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:59.506911 323 raft_consensus.cc:504] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc0425573d80435b8fd3087778815fb4" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36963 } } peers { permanent_uuid: "051b4710423449f3aa3321f20aeabed1" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35183 } } peers { permanent_uuid: "695df11ce5ca41f891ded65eb66c8037" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45099 } }
I20260811 08:13:59.507079 323 leader_election.cc:288] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4 [CANDIDATE]: Term 1 election: Requested vote from peers 051b4710423449f3aa3321f20aeabed1 (127.20.158.130:35183), 695df11ce5ca41f891ded65eb66c8037 (127.20.158.129:45099)
I20260811 08:13:59.507216 32309 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d950a9c240b14f658b8ad4ec3ce56ab8" candidate_uuid: "bc0425573d80435b8fd3087778815fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "051b4710423449f3aa3321f20aeabed1"
I20260811 08:13:59.507325 32309 raft_consensus.cc:3037] T d950a9c240b14f658b8ad4ec3ce56ab8 P 051b4710423449f3aa3321f20aeabed1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:59.507290 32102 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d950a9c240b14f658b8ad4ec3ce56ab8" candidate_uuid: "bc0425573d80435b8fd3087778815fb4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "695df11ce5ca41f891ded65eb66c8037"
I20260811 08:13:59.507393 32102 raft_consensus.cc:3037] T d950a9c240b14f658b8ad4ec3ce56ab8 P 695df11ce5ca41f891ded65eb66c8037 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:13:59.508034 32309 raft_consensus.cc:2454] T d950a9c240b14f658b8ad4ec3ce56ab8 P 051b4710423449f3aa3321f20aeabed1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc0425573d80435b8fd3087778815fb4 in term 1.
I20260811 08:13:59.508177 32102 raft_consensus.cc:2454] T d950a9c240b14f658b8ad4ec3ce56ab8 P 695df11ce5ca41f891ded65eb66c8037 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bc0425573d80435b8fd3087778815fb4 in term 1.
I20260811 08:13:59.508220 32422 leader_election.cc:302] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 051b4710423449f3aa3321f20aeabed1, bc0425573d80435b8fd3087778815fb4; no voters:
I20260811 08:13:59.508311 323 raft_consensus.cc:2781] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:13:59.508491 323 raft_consensus.cc:686] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4 [term 1 LEADER]: Becoming Leader. State: Replica: bc0425573d80435b8fd3087778815fb4, State: Running, Role: LEADER
I20260811 08:13:59.508589 323 consensus_queue.cc:237] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc0425573d80435b8fd3087778815fb4" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36963 } } peers { permanent_uuid: "051b4710423449f3aa3321f20aeabed1" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35183 } } peers { permanent_uuid: "695df11ce5ca41f891ded65eb66c8037" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45099 } }
I20260811 08:13:59.509425 32753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.509309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.20.158.131:35249)
0811 08:13:59.509352 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:59.509387 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260811 08:13:59.509621 31588 catalog_manager.cc:5495] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4 reported cstate change: term changed from 0 to 1, leader changed from <none> to bc0425573d80435b8fd3087778815fb4 (127.20.158.131). New cstate: current_term: 1 leader_uuid: "bc0425573d80435b8fd3087778815fb4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bc0425573d80435b8fd3087778815fb4" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 36963 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "051b4710423449f3aa3321f20aeabed1" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35183 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "695df11ce5ca41f891ded65eb66c8037" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45099 } health_report { overall_health: UNKNOWN } } }
I20260811 08:13:59.576856 313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.574526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46910 (local address 127.20.158.131:36963)
0811 08:13:59.574599 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 08:13:59.574601 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:13:59.574610 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:13:59.574649 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:13:59.574650 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:13:59.574670 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:13:59.574739 (+ 69us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:13:59.574892 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:59.575388 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:59.576122 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:13:59.576327 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:13:59.576385 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:13:59.576539 (+ 154us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:13:59.576643 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:13:59.576699 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:13:59.576744 (+ 45us) server_negotiation.cc:299] Negotiation successful
0811 08:13:59.576763 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":49}
I20260811 08:13:59.578151 32102 raft_consensus.cc:1261] T d950a9c240b14f658b8ad4ec3ce56ab8 P 695df11ce5ca41f891ded65eb66c8037 [term 1 FOLLOWER]: Refusing update from remote peer bc0425573d80435b8fd3087778815fb4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:59.578227 32309 raft_consensus.cc:1261] T d950a9c240b14f658b8ad4ec3ce56ab8 P 051b4710423449f3aa3321f20aeabed1 [term 1 FOLLOWER]: Refusing update from remote peer bc0425573d80435b8fd3087778815fb4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:13:59.578434 323 consensus_queue.cc:1035] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "695df11ce5ca41f891ded65eb66c8037" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:13:59.578564 331 consensus_queue.cc:1035] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "051b4710423449f3aa3321f20aeabed1" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35183 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:13:59.579708 32752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.579531 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.20.158.129:52747)
0811 08:13:59.579637 (+ 106us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:59.579673 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260811 08:13:59.580493 32755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.580327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.20.158.130:39089)
0811 08:13:59.580416 (+ 89us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:59.580457 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260811 08:13:59.580904 32753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.580759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.20.158.131:41119)
0811 08:13:59.580835 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:59.580866 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260811 08:13:59.581931 32752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.581774 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.20.158.129:37573)
0811 08:13:59.581874 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:59.581902 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260811 08:13:59.582531 32755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.582396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42743 (local address 127.20.158.130:45969)
0811 08:13:59.582462 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:59.582496 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42743: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260811 08:13:59.583364 31589 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46494:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:13:59.583480 31589 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46494:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:13:59.584944 31589 catalog_manager.cc:5782] T 00000000000000000000000000000000 P a8b7920051704b6789caa713e738bd9d: Sending DeleteTablet for 3 replicas of tablet d950a9c240b14f658b8ad4ec3ce56ab8
I20260811 08:13:59.585246 32497 tablet_service.cc:1514] Processing DeleteTablet for tablet d950a9c240b14f658b8ad4ec3ce56ab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:59 UTC) from {username='oryx', principal='oryx/127.20.158.189@KRBTEST.COM'} at 127.0.0.1:46900
I20260811 08:13:59.585294 32074 tablet_service.cc:1514] Processing DeleteTablet for tablet d950a9c240b14f658b8ad4ec3ce56ab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:59 UTC) from {username='oryx', principal='oryx/127.20.158.189@KRBTEST.COM'} at 127.0.0.1:59112
I20260811 08:13:59.585321 32280 tablet_service.cc:1514] Processing DeleteTablet for tablet d950a9c240b14f658b8ad4ec3ce56ab8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:13:59 UTC) from {username='oryx', principal='oryx/127.20.158.189@KRBTEST.COM'} at 127.0.0.1:40440
I20260811 08:13:59.585503 352 tablet_replica.cc:330] T d950a9c240b14f658b8ad4ec3ce56ab8 P 051b4710423449f3aa3321f20aeabed1: stopping tablet replica
I20260811 08:13:59.585587 352 raft_consensus.cc:2229] T d950a9c240b14f658b8ad4ec3ce56ab8 P 051b4710423449f3aa3321f20aeabed1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:13:59.585633 352 raft_consensus.cc:2258] T d950a9c240b14f658b8ad4ec3ce56ab8 P 051b4710423449f3aa3321f20aeabed1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:59.585872 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 31834
I20260811 08:13:59.588744 352 ts_tablet_manager.cc:1905] T d950a9c240b14f658b8ad4ec3ce56ab8 P 051b4710423449f3aa3321f20aeabed1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:13:59.591171 352 ts_tablet_manager.cc:1918] T d950a9c240b14f658b8ad4ec3ce56ab8 P 051b4710423449f3aa3321f20aeabed1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:13:59.591253 352 log.cc:1196] T d950a9c240b14f658b8ad4ec3ce56ab8 P 051b4710423449f3aa3321f20aeabed1: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-1/wal/wals/d950a9c240b14f658b8ad4ec3ce56ab8
I20260811 08:13:59.591543 352 ts_tablet_manager.cc:1939] T d950a9c240b14f658b8ad4ec3ce56ab8 P 051b4710423449f3aa3321f20aeabed1: Deleting consensus metadata
I20260811 08:13:59.596187 351 tablet_replica.cc:330] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4: stopping tablet replica
I20260811 08:13:59.596387 351 raft_consensus.cc:2229] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:13:59.596498 351 raft_consensus.cc:2258] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:13:59.596913 351 ts_tablet_manager.cc:1905] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:13:59.597270 31558 catalog_manager.cc:4841] TS 051b4710423449f3aa3321f20aeabed1 (127.20.158.130:35183): tablet d950a9c240b14f658b8ad4ec3ce56ab8 (table test-table [id=dc514a6d75234c679acbd5c2805914f7]) successfully deleted
I20260811 08:13:59.598598 351 ts_tablet_manager.cc:1918] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:13:59.598667 351 log.cc:1196] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786436003833085-21114-0/minicluster-data/ts-2/wal/wals/d950a9c240b14f658b8ad4ec3ce56ab8
I20260811 08:13:59.598929 351 ts_tablet_manager.cc:1939] T d950a9c240b14f658b8ad4ec3ce56ab8 P bc0425573d80435b8fd3087778815fb4: Deleting consensus metadata
I20260811 08:13:59.599370 31562 catalog_manager.cc:4841] TS bc0425573d80435b8fd3087778815fb4 (127.20.158.131:36963): tablet d950a9c240b14f658b8ad4ec3ce56ab8 (table test-table [id=dc514a6d75234c679acbd5c2805914f7]) successfully deleted
I20260811 08:13:59.603972 310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:13:59.603812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:45099 (local address 127.0.0.1:59116)
0811 08:13:59.603884 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 08:13:59.603923 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.129:45099: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260811 08:13:59.604140 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 32186
W20260811 08:13:59.604157 31555 catalog_manager.cc:4584] TS 695df11ce5ca41f891ded65eb66c8037 (127.20.158.129:45099): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d950a9c240b14f658b8ad4ec3ce56ab8: Network error: Client connection negotiation failed: client connection to 127.20.158.129:45099: connect: Connection refused (error 111)
I20260811 08:13:59.615794 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 32391
I20260811 08:13:59.632153 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 31371
I20260811 08:13:59.645123 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 31671
2026-08-11T08:13:59Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (7223 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:13:59 dist-test-slave-gkw7 krb5kdc[358](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:13:59 dist-test-slave-gkw7 krb5kdc[358](info): set up 2 sockets
Aug 11 08:13:59 dist-test-slave-gkw7 krb5kdc[358](info): commencing operation
krb5kdc: starting...
W20260811 08:14:00.921500 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.248s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:14:01 dist-test-slave-gkw7 krb5kdc[358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436041, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:14:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:14:01Z Disabled control of system clock
WARNING: no policy specified for oryx/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.190.keytab.
Entry for principal oryx/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.190.keytab.
I20260811 08:14:01.056537 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:34327
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.190.keytab
--principal=oryx/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:44779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:34327
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:14:01.158986 378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:14:01.159211 378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:14:01.159233 378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:14:01.160321 378 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:14:01.160357 378 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260811 08:14:01.160370 378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:14:01.160383 378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:14:01.160395 378 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:14:01.160408 378 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:14:01.162006 378 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:44779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:34327
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.190.keytab
--principal=oryx/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:34327
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.378
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:14:01.162215 378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:14:01.162393 378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:14:01.167708 384 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:01.167704 389 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:01.167754 386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:01.168000 378 server_base.cc:1034] running on GCE node
I20260811 08:14:01.168387 378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:14:01.168751 378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:14:01.169935 378 hybrid_clock.cc:648] HybridClock initialized: now 1786436041169911 us; error 40 us; skew 500 ppm
Aug 11 08:14:01 dist-test-slave-gkw7 krb5kdc[358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436041, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:14:01.172561 378 init.cc:377] Logged in from keytab as oryx/127.20.158.190@KRBTEST.COM (short username oryx)
I20260811 08:14:01.173038 378 webserver.cc:460] Webserver started at http://127.20.158.190:37397/ using document root <none> and password file <none>
I20260811 08:14:01.173312 378 fs_manager.cc:359] Metadata directory not provided
I20260811 08:14:01.173393 378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:14:01.173614 378 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:14:01.174736 378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "6851153a462b4dacad9142bdd64c7c77"
format_stamp: "Formatted at 2026-08-11 08:14:01 on dist-test-slave-gkw7"
server_key: "50f8e08b8b6bc24f14bc04aba8cc7ffa"
server_key_iv: "28c592fbfbcf2f78648b07bae62332c0"
server_key_version: "encryptionkey@0"
I20260811 08:14:01.175156 378 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "6851153a462b4dacad9142bdd64c7c77"
format_stamp: "Formatted at 2026-08-11 08:14:01 on dist-test-slave-gkw7"
server_key: "50f8e08b8b6bc24f14bc04aba8cc7ffa"
server_key_iv: "28c592fbfbcf2f78648b07bae62332c0"
server_key_version: "encryptionkey@0"
I20260811 08:14:01.176556 378 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:14:01.177356 404 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:01.177665 378 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:14:01.177752 378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "6851153a462b4dacad9142bdd64c7c77"
format_stamp: "Formatted at 2026-08-11 08:14:01 on dist-test-slave-gkw7"
server_key: "50f8e08b8b6bc24f14bc04aba8cc7ffa"
server_key_iv: "28c592fbfbcf2f78648b07bae62332c0"
server_key_version: "encryptionkey@0"
I20260811 08:14:01.177856 378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:14:01.188751 378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:14:01.190994 378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:14:01.191229 378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:14:01.195994 378 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:34327
I20260811 08:14:01.196079 502 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:34327 every 8 connection(s)
I20260811 08:14:01.196424 378 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:14:01.197206 503 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:14:01.197757 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 378
I20260811 08:14:01.197846 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:14:01.198076 21114 external_mini_cluster.cc:1428] Setting key 7ad2caa1a141e8653e962e8182e655d0
I20260811 08:14:01.200495 503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77: Bootstrap starting.
I20260811 08:14:01.201247 503 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77: Neither blocks nor log segments found. Creating new log.
I20260811 08:14:01.201596 503 log.cc:824] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77: Log is configured to *not* fsync() on all Append() calls
I20260811 08:14:01.202391 503 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77: No bootstrap required, opened a new log
I20260811 08:14:01.204756 503 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6851153a462b4dacad9142bdd64c7c77" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34327 } }
I20260811 08:14:01.204895 503 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:14:01.204918 503 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6851153a462b4dacad9142bdd64c7c77, State: Initialized, Role: FOLLOWER
I20260811 08:14:01.205067 503 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6851153a462b4dacad9142bdd64c7c77" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34327 } }
I20260811 08:14:01.205158 503 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:14:01.205207 503 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:14:01.205259 503 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77 [term 0 FOLLOWER]: Advancing to term 1
Aug 11 08:14:01 dist-test-slave-gkw7 krb5kdc[358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436041, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM
I20260811 08:14:01.205972 503 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6851153a462b4dacad9142bdd64c7c77" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34327 } }
I20260811 08:14:01.206065 503 leader_election.cc:302] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6851153a462b4dacad9142bdd64c7c77; no voters:
I20260811 08:14:01.206264 503 leader_election.cc:288] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:14:01.206298 511 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:14:01.206518 511 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77 [term 1 LEADER]: Becoming Leader. State: Replica: 6851153a462b4dacad9142bdd64c7c77, State: Running, Role: LEADER
I20260811 08:14:01.206569 503 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:14:01.207294 511 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6851153a462b4dacad9142bdd64c7c77" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34327 } }
I20260811 08:14:01.208062 514 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6851153a462b4dacad9142bdd64c7c77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6851153a462b4dacad9142bdd64c7c77" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34327 } } }
I20260811 08:14:01.208290 514 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77 [sys.catalog]: This master's current role is: LEADER
W20260811 08:14:01.208555 536 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:14:01.208634 536 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:14:01.208706 538 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:14:01.208887 538 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:14:01.209111 513 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6851153a462b4dacad9142bdd64c7c77. Latest consensus state: current_term: 1 leader_uuid: "6851153a462b4dacad9142bdd64c7c77" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6851153a462b4dacad9142bdd64c7c77" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34327 } } }
I20260811 08:14:01.209183 513 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77 [sys.catalog]: This master's current role is: LEADER
I20260811 08:14:01.210426 539 mvcc.cc:205] Tried to move back new op lower bound from 7317242024796098560 to 7317242024785801216. Current Snapshot: MvccSnapshot[applied={T|T < 7317242024796098560}]
I20260811 08:14:01.210602 506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:01.198682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41156 (local address 127.20.158.190:34327)
0811 08:14:01.198906 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:01.198917 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:01.198952 (+ 35us) server_negotiation.cc:407] Connection header received
0811 08:14:01.199493 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:01.199502 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:01.199563 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:01.199721 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:01.200389 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.201880 (+ 1491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.202785 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.203494 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.203633 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:01.206251 (+ 2618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:01.206255 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:01.206256 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:14:01.206268 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:01.208575 (+ 2307us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:01.209076 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:01.209079 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:01.209080 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:01.209184 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:01.209551 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:01.209552 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:01.209553 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:01.209896 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:01.210104 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:01.210190 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 08:14:01.210328 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":109,"threads_started":1}
I20260811 08:14:01.210961 538 catalog_manager.cc:1347] Generated new cluster ID: be4a930a0644480d95c8ea08786917dd
I20260811 08:14:01.211031 538 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:14:01.226318 538 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:14:01.226943 538 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:14:01.232161 538 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77: Generated new TSK 0
I20260811 08:14:01.232379 538 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.20.158.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.158.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.158.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.129.keytab.
Entry for principal oryx/127.20.158.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.129.keytab.
I20260811 08:14:01.265790 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:0
--local_ip_for_outbound_sockets=127.20.158.129
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:34327
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.129.keytab
--principal=oryx/127.20.158.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:44779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:14:01.357950 543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:14:01.358163 543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:14:01.358187 543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:14:01.359355 543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:14:01.359400 543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:14:01.359421 543 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 08:14:01.359438 543 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:14:01.361002 543 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:44779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.129.keytab
--principal=oryx/127.20.158.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.158.190:34327
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.543
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:14:01.361235 543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:14:01.361496 543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:14:01.367035 557 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:01.367105 552 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:01.367066 543 server_base.cc:1034] running on GCE node
W20260811 08:14:01.367035 551 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:01.367508 543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:14:01.367707 543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:14:01.368865 543 hybrid_clock.cc:648] HybridClock initialized: now 1786436041368851 us; error 30 us; skew 500 ppm
Aug 11 08:14:01 dist-test-slave-gkw7 krb5kdc[358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436041, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:14:01.371464 543 init.cc:377] Logged in from keytab as oryx/127.20.158.129@KRBTEST.COM (short username oryx)
I20260811 08:14:01.371912 543 webserver.cc:460] Webserver started at http://127.20.158.129:35985/ using document root <none> and password file <none>
I20260811 08:14:01.372153 543 fs_manager.cc:359] Metadata directory not provided
I20260811 08:14:01.372200 543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:14:01.372351 543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:14:01.373466 543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-0/data/instance:
uuid: "e9e2179c98f9446286dc5759ed8da7cb"
format_stamp: "Formatted at 2026-08-11 08:14:01 on dist-test-slave-gkw7"
server_key: "f307457abb40f5c7d2ee227e2904aef8"
server_key_iv: "85d7050b77360b98625e8d2dd80bdf38"
server_key_version: "encryptionkey@0"
I20260811 08:14:01.373907 543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance:
uuid: "e9e2179c98f9446286dc5759ed8da7cb"
format_stamp: "Formatted at 2026-08-11 08:14:01 on dist-test-slave-gkw7"
server_key: "f307457abb40f5c7d2ee227e2904aef8"
server_key_iv: "85d7050b77360b98625e8d2dd80bdf38"
server_key_version: "encryptionkey@0"
I20260811 08:14:01.375294 543 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:14:01.376060 568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:01.376258 543 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:14:01.376359 543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "e9e2179c98f9446286dc5759ed8da7cb"
format_stamp: "Formatted at 2026-08-11 08:14:01 on dist-test-slave-gkw7"
server_key: "f307457abb40f5c7d2ee227e2904aef8"
server_key_iv: "85d7050b77360b98625e8d2dd80bdf38"
server_key_version: "encryptionkey@0"
I20260811 08:14:01.376435 543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:14:01.391350 543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:14:01.393919 543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:14:01.394061 543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:14:01.394568 543 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:14:01.394624 543 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:01.394647 543 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:14:01.394663 543 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 08:14:01 dist-test-slave-gkw7 krb5kdc[358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436041, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM
I20260811 08:14:01.402788 543 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:42335
I20260811 08:14:01.402872 746 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:42335 every 8 connection(s)
I20260811 08:14:01.403318 543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:14:01.405766 506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:01.395253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:35675 (local address 127.20.158.190:34327)
0811 08:14:01.395321 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:01.395323 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:01.395533 (+ 210us) server_negotiation.cc:407] Connection header received
0811 08:14:01.396171 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:01.396173 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:01.396186 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:01.396244 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:01.397144 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.398047 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.399324 (+ 1277us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.399554 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.399655 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:01.402541 (+ 2886us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:01.402543 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:01.402543 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:14:01.402552 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:01.404215 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:01.404689 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:01.404690 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:01.404690 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:01.404765 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:01.405034 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:01.405035 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:01.405035 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:01.405167 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:01.405252 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:01.405564 (+ 312us) server_negotiation.cc:299] Negotiation successful
0811 08:14:01.405659 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 08:14:01.405970 580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:01.395232 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:34327 (local address 127.20.158.129:35675)
0811 08:14:01.395404 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:01.395441 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:01.396053 (+ 612us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:01.396330 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:01.396334 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:01.396700 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:01.397012 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:01.397020 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.398177 (+ 1157us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.398178 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:01.399188 (+ 1010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:01.399191 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.399691 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.399692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:01.399835 (+ 143us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:01.400419 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:01.400430 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:01.402426 (+ 1996us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:14:01.404328 (+ 1902us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:14:01.404337 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:14:01.404339 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:14:01.404596 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:14:01.404841 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:14:01.404842 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:14:01.404842 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:14:01.404955 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:14:01.405245 (+ 290us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:14:01.405253 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:14:01.405395 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 08:14:01.405516 (+ 121us) client_negotiation.cc:240] Negotiation successful
0811 08:14:01.405698 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":85,"threads_started":1}
I20260811 08:14:01.406585 747 heartbeater.cc:347] Connected to a master server at 127.20.158.190:34327
I20260811 08:14:01.406704 747 heartbeater.cc:464] Registering TS with master...
I20260811 08:14:01.406939 747 heartbeater.cc:511] Master 127.20.158.190:34327 requested a full tablet report, sending...
I20260811 08:14:01.407569 430 ts_manager.cc:194] Registered new tserver with Master: e9e2179c98f9446286dc5759ed8da7cb (127.20.158.129:42335)
I20260811 08:14:01.408548 430 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.158.129@KRBTEST.COM'} at 127.20.158.129:35675
I20260811 08:14:01.412228 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 543
I20260811 08:14:01.412395 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance
I20260811 08:14:01.412617 21114 external_mini_cluster.cc:1428] Setting key d92d6f50916adfedf8c40854032e84d2
I20260811 08:14:01.413570 506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:01.407801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:38689 (local address 127.20.158.190:34327)
0811 08:14:01.407846 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:01.407849 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:01.407995 (+ 146us) server_negotiation.cc:407] Connection header received
0811 08:14:01.408037 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:01.408038 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:01.408046 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:01.408088 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:01.408457 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.409015 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.409862 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.410037 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.410129 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:01.411005 (+ 876us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:01.411006 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:01.411007 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:14:01.411014 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:01.412227 (+ 1213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:01.412615 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:01.412617 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:01.412617 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:01.412676 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:01.412984 (+ 308us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:01.412985 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:01.412985 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:01.413110 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:01.413178 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:01.413393 (+ 215us) server_negotiation.cc:299] Negotiation successful
0811 08:14:01.413475 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:14:01.413645 753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:01.407744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:34327 (local address 127.20.158.129:38689)
0811 08:14:01.407903 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:01.407914 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:01.407988 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:01.408101 (+ 113us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:01.408102 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:01.408294 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:01.408390 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:01.408391 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.409115 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.409116 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:01.409730 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:01.409732 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.410131 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.410132 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:01.410205 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:01.410610 (+ 405us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:01.410614 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:01.410908 (+ 294us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:14:01.412319 (+ 1411us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:14:01.412320 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:14:01.412320 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:14:01.412556 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:14:01.412768 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:14:01.412769 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:14:01.412770 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:14:01.412850 (+ 80us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:14:01.413167 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:14:01.413168 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:14:01.413259 (+ 91us) client_negotiation.cc:769] Sending connection context
0811 08:14:01.413333 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 08:14:01.413461 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":100,"threads_started":1}
WARNING: no policy specified for oryx/127.20.158.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.158.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.158.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.130.keytab.
Entry for principal oryx/127.20.158.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.130.keytab.
I20260811 08:14:01.441011 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:0
--local_ip_for_outbound_sockets=127.20.158.130
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:34327
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.130.keytab
--principal=oryx/127.20.158.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:44779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:14:01.525454 759 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:14:01.525720 759 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:14:01.525758 759 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:14:01.526903 759 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:14:01.526983 759 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:14:01.527019 759 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 08:14:01.527056 759 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:14:01.528573 759 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:44779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.130.keytab
--principal=oryx/127.20.158.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.158.190:34327
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.759
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:14:01.528846 759 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:14:01.529076 759 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:14:01.534524 768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:01.534535 766 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:01.534543 765 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:01.534755 759 server_base.cc:1034] running on GCE node
I20260811 08:14:01.534955 759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:14:01.535198 759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:14:01.536379 759 hybrid_clock.cc:648] HybridClock initialized: now 1786436041536369 us; error 54 us; skew 500 ppm
Aug 11 08:14:01 dist-test-slave-gkw7 krb5kdc[358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436041, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:14:01.538980 759 init.cc:377] Logged in from keytab as oryx/127.20.158.130@KRBTEST.COM (short username oryx)
I20260811 08:14:01.539454 759 webserver.cc:460] Webserver started at http://127.20.158.130:46835/ using document root <none> and password file <none>
I20260811 08:14:01.539642 759 fs_manager.cc:359] Metadata directory not provided
I20260811 08:14:01.539683 759 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:14:01.539776 759 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:14:01.540755 759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-1/data/instance:
uuid: "77f76f68575d4c08a7bf3d1dec1f38a7"
format_stamp: "Formatted at 2026-08-11 08:14:01 on dist-test-slave-gkw7"
server_key: "240944b3c06f500bfed066de1ab7e52e"
server_key_iv: "7837effc73de7367fa51cfba5b33e185"
server_key_version: "encryptionkey@0"
I20260811 08:14:01.541054 759 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance:
uuid: "77f76f68575d4c08a7bf3d1dec1f38a7"
format_stamp: "Formatted at 2026-08-11 08:14:01 on dist-test-slave-gkw7"
server_key: "240944b3c06f500bfed066de1ab7e52e"
server_key_iv: "7837effc73de7367fa51cfba5b33e185"
server_key_version: "encryptionkey@0"
I20260811 08:14:01.542477 759 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:14:01.543176 780 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:01.543376 759 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:14:01.543466 759 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "77f76f68575d4c08a7bf3d1dec1f38a7"
format_stamp: "Formatted at 2026-08-11 08:14:01 on dist-test-slave-gkw7"
server_key: "240944b3c06f500bfed066de1ab7e52e"
server_key_iv: "7837effc73de7367fa51cfba5b33e185"
server_key_version: "encryptionkey@0"
I20260811 08:14:01.543519 759 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:14:01.554855 759 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:14:01.556603 759 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:14:01.556723 759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:14:01.557235 759 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:14:01.557276 759 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:01.557300 759 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:14:01.557313 759 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:01.564638 759 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:41529
Aug 11 08:14:01 dist-test-slave-gkw7 krb5kdc[358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436041, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM
I20260811 08:14:01.564677 951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:41529 every 8 connection(s)
I20260811 08:14:01.565018 759 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
I20260811 08:14:01.567356 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 759
I20260811 08:14:01.567503 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance
I20260811 08:14:01.567817 21114 external_mini_cluster.cc:1428] Setting key 0e236e99ea457a21d4fa4cf4309dcf04
I20260811 08:14:01.569016 506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:01.557821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:55737 (local address 127.20.158.190:34327)
0811 08:14:01.557867 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:01.557869 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:01.558117 (+ 248us) server_negotiation.cc:407] Connection header received
0811 08:14:01.558658 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:01.558659 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:01.558673 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:01.558753 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:01.559710 (+ 957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.560528 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.562312 (+ 1784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.562672 (+ 360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.562760 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:01.565428 (+ 2668us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:01.565430 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:01.565431 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:14:01.565440 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:01.567072 (+ 1632us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:01.567714 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:01.567716 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:01.567716 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:01.567804 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:01.568122 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:01.568124 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:01.568124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:01.568298 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:01.568371 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:01.568796 (+ 425us) server_negotiation.cc:299] Negotiation successful
0811 08:14:01.568898 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:14:01.569257 792 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:01.557790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:34327 (local address 127.20.158.130:55737)
0811 08:14:01.557982 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:01.558017 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:01.558542 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:01.558864 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:01.558870 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:01.559283 (+ 413us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:01.559590 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:01.559597 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.560639 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.560640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:01.562177 (+ 1537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:01.562182 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.562785 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.562786 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:01.562895 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:01.563406 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:01.563415 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:01.565193 (+ 1778us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:14:01.567196 (+ 2003us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:14:01.567203 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:14:01.567207 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:14:01.567614 (+ 407us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:14:01.567911 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:14:01.567912 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:14:01.567912 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:14:01.568040 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:14:01.568387 (+ 347us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:14:01.568395 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:14:01.568585 (+ 190us) client_negotiation.cc:769] Sending connection context
0811 08:14:01.568764 (+ 179us) client_negotiation.cc:240] Negotiation successful
0811 08:14:01.568952 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":97,"threads_started":1}
I20260811 08:14:01.569962 952 heartbeater.cc:347] Connected to a master server at 127.20.158.190:34327
I20260811 08:14:01.570060 952 heartbeater.cc:464] Registering TS with master...
I20260811 08:14:01.570243 952 heartbeater.cc:511] Master 127.20.158.190:34327 requested a full tablet report, sending...
I20260811 08:14:01.571151 430 ts_manager.cc:194] Registered new tserver with Master: 77f76f68575d4c08a7bf3d1dec1f38a7 (127.20.158.130:41529)
I20260811 08:14:01.571751 430 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.158.130@KRBTEST.COM'} at 127.20.158.130:55737
WARNING: no policy specified for oryx/127.20.158.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.158.131@KRBTEST.COM" created.
I20260811 08:14:01.584753 506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:01.571270 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:56459 (local address 127.20.158.190:34327)
0811 08:14:01.571308 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:01.571310 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:01.577837 (+ 6527us) server_negotiation.cc:407] Connection header received
0811 08:14:01.577901 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:01.577902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:01.577913 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:01.577964 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:01.578428 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.578894 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.579923 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.580159 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.580281 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:01.581775 (+ 1494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:01.581776 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:01.581776 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:14:01.581784 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:01.583501 (+ 1717us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:01.583965 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:01.583965 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:01.583966 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:01.584018 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:01.584229 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:01.584230 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:01.584230 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:01.584365 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:01.584418 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:01.584612 (+ 194us) server_negotiation.cc:299] Negotiation successful
0811 08:14:01.584679 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:14:01.584928 964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:01.571204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:34327 (local address 127.20.158.130:56459)
0811 08:14:01.577734 (+ 6530us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:01.577748 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:01.577834 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:01.577976 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:01.577977 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:01.578238 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:01.578332 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:01.578334 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.579020 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.579021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:01.579825 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:01.579828 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.580281 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.580282 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:01.580374 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:01.580870 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:01.580877 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:01.581632 (+ 755us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:14:01.583604 (+ 1972us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:14:01.583605 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:14:01.583606 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:14:01.583880 (+ 274us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:14:01.584089 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:14:01.584090 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:14:01.584091 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:14:01.584160 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:14:01.584440 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:14:01.584441 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:14:01.584492 (+ 51us) client_negotiation.cc:769] Sending connection context
0811 08:14:01.584575 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 08:14:01.584706 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6491,"thread_start_us":70,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.158.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.131.keytab.
Entry for principal oryx/127.20.158.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.131.keytab.
I20260811 08:14:01.600672 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:0
--local_ip_for_outbound_sockets=127.20.158.131
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:34327
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.131.keytab
--principal=oryx/127.20.158.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:44779
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:14:01.688606 966 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:14:01.688840 966 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:14:01.688867 966 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:14:01.690171 966 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:14:01.690222 966 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:14:01.690246 966 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260811 08:14:01.690268 966 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:14:01.691916 966 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:44779
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.131.keytab
--principal=oryx/127.20.158.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.20.158.190:34327
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.966
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:14:01.692201 966 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:14:01.692464 966 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:14:01.698086 978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:01.698148 973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:01.698086 975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:01.698277 966 server_base.cc:1034] running on GCE node
I20260811 08:14:01.698634 966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:14:01.698915 966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:14:01.700105 966 hybrid_clock.cc:648] HybridClock initialized: now 1786436041700089 us; error 67 us; skew 500 ppm
Aug 11 08:14:01 dist-test-slave-gkw7 krb5kdc[358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436041, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:14:01.702983 966 init.cc:377] Logged in from keytab as oryx/127.20.158.131@KRBTEST.COM (short username oryx)
I20260811 08:14:01.703406 966 webserver.cc:460] Webserver started at http://127.20.158.131:44057/ using document root <none> and password file <none>
I20260811 08:14:01.703702 966 fs_manager.cc:359] Metadata directory not provided
I20260811 08:14:01.703752 966 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:14:01.703904 966 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:14:01.705022 966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-2/data/instance:
uuid: "77bf1e0e6a384d3ba35ded06b93e67d1"
format_stamp: "Formatted at 2026-08-11 08:14:01 on dist-test-slave-gkw7"
server_key: "e8c7cb1dab165b62a177beb0617e8447"
server_key_iv: "28bd393b313117d5a273b0eab99c9304"
server_key_version: "encryptionkey@0"
I20260811 08:14:01.705498 966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance:
uuid: "77bf1e0e6a384d3ba35ded06b93e67d1"
format_stamp: "Formatted at 2026-08-11 08:14:01 on dist-test-slave-gkw7"
server_key: "e8c7cb1dab165b62a177beb0617e8447"
server_key_iv: "28bd393b313117d5a273b0eab99c9304"
server_key_version: "encryptionkey@0"
I20260811 08:14:01.707208 966 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:14:01.708231 992 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:01.708441 966 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:14:01.708552 966 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "77bf1e0e6a384d3ba35ded06b93e67d1"
format_stamp: "Formatted at 2026-08-11 08:14:01 on dist-test-slave-gkw7"
server_key: "e8c7cb1dab165b62a177beb0617e8447"
server_key_iv: "28bd393b313117d5a273b0eab99c9304"
server_key_version: "encryptionkey@0"
I20260811 08:14:01.708650 966 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:14:01.721474 966 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:14:01.723470 966 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:14:01.723654 966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:14:01.724193 966 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:14:01.724268 966 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:01.724320 966 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:14:01.724341 966 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 11 08:14:01 dist-test-slave-gkw7 krb5kdc[358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436041, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM
I20260811 08:14:01.731951 966 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:37851
I20260811 08:14:01.732416 966 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
I20260811 08:14:01.732535 1197 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:37851 every 8 connection(s)
I20260811 08:14:01.735580 506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:01.724774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:33373 (local address 127.20.158.190:34327)
0811 08:14:01.724860 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:01.724863 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:01.725088 (+ 225us) server_negotiation.cc:407] Connection header received
0811 08:14:01.725665 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:01.725666 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:01.725681 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:01.725732 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:01.726607 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.727479 (+ 872us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.729222 (+ 1743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.729630 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.729721 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:01.732444 (+ 2723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:01.732446 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:01.732446 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:14:01.732454 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:01.734276 (+ 1822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:01.734661 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:01.734662 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:01.734662 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:01.734717 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:01.734969 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:01.734969 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:01.734970 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:01.735091 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:01.735144 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:01.735441 (+ 297us) server_negotiation.cc:299] Negotiation successful
0811 08:14:01.735516 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 08:14:01.735708 1005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:01.724740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:34327 (local address 127.20.158.131:33373)
0811 08:14:01.724940 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:01.724981 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:01.725522 (+ 541us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:01.725809 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:01.725813 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:01.726179 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:01.726481 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:01.726488 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.727607 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.727608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:01.728998 (+ 1390us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:01.729002 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.729741 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.729742 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:01.729848 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:01.730463 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:01.730471 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:01.732364 (+ 1893us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:14:01.734357 (+ 1993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:14:01.734363 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:14:01.734365 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:14:01.734584 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:14:01.734782 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:14:01.734782 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:14:01.734783 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:14:01.734882 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:14:01.735157 (+ 275us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:14:01.735162 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:14:01.735284 (+ 122us) client_negotiation.cc:769] Sending connection context
0811 08:14:01.735374 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 08:14:01.735496 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":103,"threads_started":1}
I20260811 08:14:01.736187 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 966
I20260811 08:14:01.736269 1199 heartbeater.cc:347] Connected to a master server at 127.20.158.190:34327
I20260811 08:14:01.736337 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance
I20260811 08:14:01.736363 1199 heartbeater.cc:464] Registering TS with master...
I20260811 08:14:01.736553 1199 heartbeater.cc:511] Master 127.20.158.190:34327 requested a full tablet report, sending...
I20260811 08:14:01.736572 21114 external_mini_cluster.cc:1428] Setting key c2ede137813c71488b5d949a4b54ae6d
I20260811 08:14:01.736966 426 ts_manager.cc:194] Registered new tserver with Master: 77bf1e0e6a384d3ba35ded06b93e67d1 (127.20.158.131:37851)
I20260811 08:14:01.737481 426 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.20.158.131@KRBTEST.COM'} at 127.20.158.131:33373
I20260811 08:14:01.737591 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:14:01.743870 1208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:01.737428 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:34327 (local address 127.20.158.131:52179)
0811 08:14:01.737598 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:01.737609 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:01.737689 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:01.737834 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:01.737835 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:01.738019 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:01.738071 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:01.738073 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.738750 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.738751 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:01.739265 (+ 514us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:01.739267 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.739704 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.739706 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:01.739789 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:01.740272 (+ 483us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:01.740277 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:01.740551 (+ 274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:14:01.742622 (+ 2071us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:14:01.742623 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:14:01.742624 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:14:01.742798 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:14:01.743110 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:14:01.743111 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:14:01.743112 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:14:01.743223 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:14:01.743583 (+ 360us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:14:01.743584 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:14:01.743630 (+ 46us) client_negotiation.cc:769] Sending connection context
0811 08:14:01.743709 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 08:14:01.743795 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":69,"threads_started":1}
I20260811 08:14:01.744081 506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:01.737474 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:52179 (local address 127.20.158.190:34327)
0811 08:14:01.737511 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:01.737513 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:01.737663 (+ 150us) server_negotiation.cc:407] Connection header received
0811 08:14:01.737766 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:01.737767 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:01.737777 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:01.737820 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:01.738160 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.738637 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.739364 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.739575 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.739666 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:01.740652 (+ 986us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:01.740653 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:01.740654 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:14:01.740662 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:01.742493 (+ 1831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:01.742887 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:01.742889 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:01.742889 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:01.742955 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:01.743320 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:01.743322 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:01.743322 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:01.743474 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:01.743554 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:01.743885 (+ 331us) server_negotiation.cc:299] Negotiation successful
0811 08:14:01.743975 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
Aug 11 08:14:01 dist-test-slave-gkw7 krb5kdc[358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436041, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 11 08:14:01 dist-test-slave-gkw7 krb5kdc[358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:01 dist-test-slave-gkw7 krb5kdc[358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
W20260811 08:14:01.763280 506 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:01.757431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41172 (local address 127.20.158.190:34327)
0811 08:14:01.757506 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:01.757508 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:01.757517 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:14:01.757663 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:01.757664 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:01.757674 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:01.757717 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:01.758379 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.758867 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.759647 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.759843 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.759902 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:01.763161 (+ 3259us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41172: BlockingRecv error: recv got EOF from 127.0.0.1:41172 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 11 08:14:01 dist-test-slave-gkw7 krb5kdc[358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436041, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM
I20260811 08:14:01.771544 506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:01.764300 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41176 (local address 127.20.158.190:34327)
0811 08:14:01.764387 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:01.764389 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:01.764482 (+ 93us) server_negotiation.cc:407] Connection header received
0811 08:14:01.764571 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:01.764572 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:01.764583 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:01.764634 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:01.765098 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.765651 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.766438 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.766637 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.766727 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:01.769171 (+ 2444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:01.769172 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:01.769173 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:14:01.769179 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:01.770591 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:01.770904 (+ 313us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:01.770905 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:01.770905 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:01.770959 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:01.771129 (+ 170us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:01.771130 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:01.771130 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:01.771240 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:01.771317 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:01.771420 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 08:14:01.771479 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 08:14:01.773353 426 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41176:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:14:01.775065 426 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:14:01.782496 1236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:01.778028 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53364 (local address 127.20.158.129:42335)
0811 08:14:01.778441 (+ 413us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:01.778445 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:01.778455 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:14:01.778769 (+ 314us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:01.778772 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:01.778789 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:01.778866 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:14:01.779007 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.779776 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.781351 (+ 1575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.782036 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.782170 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:01.782231 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:01.782345 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 08:14:01.782383 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":375,"thread_start_us":99,"threads_started":1}
I20260811 08:14:01.782502 1232 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:01.777916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:42335 (local address 127.0.0.1:53364)
0811 08:14:01.778112 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:01.778156 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:01.778665 (+ 509us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:01.778891 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:01.778892 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:01.778894 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:14:01.778948 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:01.778950 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.779868 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.779869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:01.781251 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:01.781254 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.782147 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.782148 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:01.782232 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:01.782247 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 08:14:01.782325 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 08:14:01.782384 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":50,"threads_started":1}
I20260811 08:14:01.782800 1233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:01.777943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:37851 (local address 127.0.0.1:33780)
0811 08:14:01.778555 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:01.778566 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:01.778613 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:01.779079 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:01.779080 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:01.779082 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:14:01.779124 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:01.779125 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.780331 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.780332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:01.781459 (+ 1127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:01.781461 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.782546 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.782547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:01.782614 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:01.782619 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:14:01.782677 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 08:14:01.782720 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"mutex_wait_us":13,"thread_start_us":102,"threads_started":1}
I20260811 08:14:01.782958 1237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:01.778207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52198 (local address 127.20.158.130:41529)
0811 08:14:01.778388 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:01.778393 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:01.778406 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:14:01.778451 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:01.778454 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:01.778471 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:01.778563 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:14:01.778797 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.780071 (+ 1274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.781288 (+ 1217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.782062 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.782154 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:01.782212 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:01.782549 (+ 337us) server_negotiation.cc:299] Negotiation successful
0811 08:14:01.782859 (+ 310us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":109,"threads_started":1}
I20260811 08:14:01.783059 1242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:01.778276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33780 (local address 127.20.158.131:37851)
0811 08:14:01.778893 (+ 617us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:01.778898 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:01.778908 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:14:01.778989 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:01.778992 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:01.779007 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:01.779085 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:14:01.779190 (+ 105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.780251 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.781598 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.782379 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.782460 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:01.782511 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:01.782903 (+ 392us) server_negotiation.cc:299] Negotiation successful
0811 08:14:01.782943 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":579,"thread_start_us":122,"threads_started":1}
I20260811 08:14:01.783279 641 tablet_service.cc:1467] Processing CreateTablet for tablet 15864147c8f543d5a22d0ebb27b71ec4 (DEFAULT_TABLE table=test-table [id=1929380a640e43829bbb2f57b039e047]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:14:01.783617 641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15864147c8f543d5a22d0ebb27b71ec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:14:01.785897 1231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:01.777943 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:41529 (local address 127.0.0.1:52198)
0811 08:14:01.778243 (+ 300us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:01.778254 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:01.778320 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:01.778596 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:01.778599 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:01.778602 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:14:01.778685 (+ 83us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:01.778687 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.780163 (+ 1476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.780164 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:01.781146 (+ 982us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:01.781149 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.782253 (+ 1104us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.782254 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:01.782317 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:01.782321 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:14:01.782383 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 08:14:01.782434 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":285,"thread_start_us":112,"threads_started":1}
I20260811 08:14:01.786413 1078 tablet_service.cc:1467] Processing CreateTablet for tablet 15864147c8f543d5a22d0ebb27b71ec4 (DEFAULT_TABLE table=test-table [id=1929380a640e43829bbb2f57b039e047]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:14:01.786530 851 tablet_service.cc:1467] Processing CreateTablet for tablet 15864147c8f543d5a22d0ebb27b71ec4 (DEFAULT_TABLE table=test-table [id=1929380a640e43829bbb2f57b039e047]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:14:01.786801 1078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15864147c8f543d5a22d0ebb27b71ec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:14:01.786959 851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 15864147c8f543d5a22d0ebb27b71ec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:14:01.789978 1245 tablet_bootstrap.cc:492] T 15864147c8f543d5a22d0ebb27b71ec4 P 77bf1e0e6a384d3ba35ded06b93e67d1: Bootstrap starting.
I20260811 08:14:01.790334 1243 tablet_bootstrap.cc:492] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb: Bootstrap starting.
I20260811 08:14:01.790720 1245 tablet_bootstrap.cc:654] T 15864147c8f543d5a22d0ebb27b71ec4 P 77bf1e0e6a384d3ba35ded06b93e67d1: Neither blocks nor log segments found. Creating new log.
I20260811 08:14:01.790964 1243 tablet_bootstrap.cc:654] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb: Neither blocks nor log segments found. Creating new log.
I20260811 08:14:01.791076 1245 log.cc:824] T 15864147c8f543d5a22d0ebb27b71ec4 P 77bf1e0e6a384d3ba35ded06b93e67d1: Log is configured to *not* fsync() on all Append() calls
I20260811 08:14:01.791314 1243 log.cc:824] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb: Log is configured to *not* fsync() on all Append() calls
I20260811 08:14:01.791471 1246 tablet_bootstrap.cc:492] T 15864147c8f543d5a22d0ebb27b71ec4 P 77f76f68575d4c08a7bf3d1dec1f38a7: Bootstrap starting.
I20260811 08:14:01.792037 1245 tablet_bootstrap.cc:492] T 15864147c8f543d5a22d0ebb27b71ec4 P 77bf1e0e6a384d3ba35ded06b93e67d1: No bootstrap required, opened a new log
I20260811 08:14:01.792052 1246 tablet_bootstrap.cc:654] T 15864147c8f543d5a22d0ebb27b71ec4 P 77f76f68575d4c08a7bf3d1dec1f38a7: Neither blocks nor log segments found. Creating new log.
I20260811 08:14:01.792106 1245 ts_tablet_manager.cc:1397] T 15864147c8f543d5a22d0ebb27b71ec4 P 77bf1e0e6a384d3ba35ded06b93e67d1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:14:01.792392 1246 log.cc:824] T 15864147c8f543d5a22d0ebb27b71ec4 P 77f76f68575d4c08a7bf3d1dec1f38a7: Log is configured to *not* fsync() on all Append() calls
I20260811 08:14:01.793149 1246 tablet_bootstrap.cc:492] T 15864147c8f543d5a22d0ebb27b71ec4 P 77f76f68575d4c08a7bf3d1dec1f38a7: No bootstrap required, opened a new log
I20260811 08:14:01.793274 1246 ts_tablet_manager.cc:1397] T 15864147c8f543d5a22d0ebb27b71ec4 P 77f76f68575d4c08a7bf3d1dec1f38a7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:14:01.793874 1245 raft_consensus.cc:348] T 15864147c8f543d5a22d0ebb27b71ec4 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } }
I20260811 08:14:01.794010 1245 raft_consensus.cc:374] T 15864147c8f543d5a22d0ebb27b71ec4 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:14:01.794034 1245 raft_consensus.cc:729] T 15864147c8f543d5a22d0ebb27b71ec4 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77bf1e0e6a384d3ba35ded06b93e67d1, State: Initialized, Role: FOLLOWER
I20260811 08:14:01.794164 1245 consensus_queue.cc:260] T 15864147c8f543d5a22d0ebb27b71ec4 P 77bf1e0e6a384d3ba35ded06b93e67d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } }
I20260811 08:14:01.794456 1245 ts_tablet_manager.cc:1428] T 15864147c8f543d5a22d0ebb27b71ec4 P 77bf1e0e6a384d3ba35ded06b93e67d1: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 08:14:01.794504 1199 heartbeater.cc:503] Master 127.20.158.190:34327 was elected leader, sending a full tablet report...
I20260811 08:14:01.794812 1243 tablet_bootstrap.cc:492] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb: No bootstrap required, opened a new log
I20260811 08:14:01.794891 1243 ts_tablet_manager.cc:1397] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260811 08:14:01.795226 1246 raft_consensus.cc:348] T 15864147c8f543d5a22d0ebb27b71ec4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } }
I20260811 08:14:01.795406 1246 raft_consensus.cc:374] T 15864147c8f543d5a22d0ebb27b71ec4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:14:01.795450 1246 raft_consensus.cc:729] T 15864147c8f543d5a22d0ebb27b71ec4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77f76f68575d4c08a7bf3d1dec1f38a7, State: Initialized, Role: FOLLOWER
I20260811 08:14:01.795568 1246 consensus_queue.cc:260] T 15864147c8f543d5a22d0ebb27b71ec4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } }
I20260811 08:14:01.795855 1246 ts_tablet_manager.cc:1428] T 15864147c8f543d5a22d0ebb27b71ec4 P 77f76f68575d4c08a7bf3d1dec1f38a7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:14:01.796015 952 heartbeater.cc:503] Master 127.20.158.190:34327 was elected leader, sending a full tablet report...
I20260811 08:14:01.796936 1243 raft_consensus.cc:348] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } }
I20260811 08:14:01.797102 1243 raft_consensus.cc:374] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:14:01.797140 1243 raft_consensus.cc:729] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9e2179c98f9446286dc5759ed8da7cb, State: Initialized, Role: FOLLOWER
I20260811 08:14:01.797219 1243 consensus_queue.cc:260] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } }
I20260811 08:14:01.797408 1243 ts_tablet_manager.cc:1428] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 08:14:01.797487 747 heartbeater.cc:503] Master 127.20.158.190:34327 was elected leader, sending a full tablet report...
W20260811 08:14:01.815840 954 tablet.cc:2369] T 15864147c8f543d5a22d0ebb27b71ec4 P 77f76f68575d4c08a7bf3d1dec1f38a7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:14:01.880587 1257 raft_consensus.cc:482] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:14:01.880717 1257 raft_consensus.cc:504] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } }
I20260811 08:14:01.881135 1257 leader_election.cc:288] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77bf1e0e6a384d3ba35ded06b93e67d1 (127.20.158.131:37851), 77f76f68575d4c08a7bf3d1dec1f38a7 (127.20.158.130:41529)
I20260811 08:14:01.885216 1237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:01.881428 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:54853 (local address 127.20.158.130:41529)
0811 08:14:01.881476 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:01.881479 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:01.881489 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:14:01.881520 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:01.881521 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:01.881553 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:01.881671 (+ 118us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:14:01.881935 (+ 264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.882706 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.884262 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.884815 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.884896 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:01.884904 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:01.885107 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 08:14:01.885152 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:14:01.885217 1242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:01.881390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:58167 (local address 127.20.158.131:37851)
0811 08:14:01.881495 (+ 105us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:01.881497 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:01.881655 (+ 158us) server_negotiation.cc:407] Connection header received
0811 08:14:01.881690 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:01.881691 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:01.881702 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:01.881761 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:14:01.881955 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.882712 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.884261 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.884819 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.884896 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:01.884904 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:01.885107 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 08:14:01.885146 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 08:14:01.885242 1258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:01.881326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:37851 (local address 127.20.158.129:58167)
0811 08:14:01.881512 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:01.881574 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:01.881628 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:01.881787 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:01.881787 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:01.881810 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:14:01.881877 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:01.881879 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.882802 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.882803 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:01.884158 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:01.884162 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.884915 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.884915 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:01.885013 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:01.885018 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:14:01.885078 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 08:14:01.885127 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":175,"mutex_wait_us":125,"thread_start_us":69,"threads_started":1}
I20260811 08:14:01.885253 580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:01.881326 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:41529 (local address 127.20.158.129:54853)
0811 08:14:01.881369 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:01.881382 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:01.881429 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:01.881687 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:01.881688 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:01.881691 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:14:01.881818 (+ 127us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:01.881820 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.882803 (+ 983us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.882803 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:01.884158 (+ 1355us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:01.884162 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.884914 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.884915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:01.885013 (+ 98us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:01.885018 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:14:01.885078 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 08:14:01.885127 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22,"mutex_wait_us":75}
I20260811 08:14:01.885646 1109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15864147c8f543d5a22d0ebb27b71ec4" candidate_uuid: "e9e2179c98f9446286dc5759ed8da7cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" is_pre_election: true
I20260811 08:14:01.885771 1109 raft_consensus.cc:2454] T 15864147c8f543d5a22d0ebb27b71ec4 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9e2179c98f9446286dc5759ed8da7cb in term 0.
I20260811 08:14:01.885787 883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15864147c8f543d5a22d0ebb27b71ec4" candidate_uuid: "e9e2179c98f9446286dc5759ed8da7cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" is_pre_election: true
I20260811 08:14:01.885898 883 raft_consensus.cc:2454] T 15864147c8f543d5a22d0ebb27b71ec4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9e2179c98f9446286dc5759ed8da7cb in term 0.
I20260811 08:14:01.886042 571 leader_election.cc:302] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77bf1e0e6a384d3ba35ded06b93e67d1, e9e2179c98f9446286dc5759ed8da7cb; no voters:
I20260811 08:14:01.886179 1257 raft_consensus.cc:2781] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:14:01.886246 1257 raft_consensus.cc:482] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:14:01.886264 1257 raft_consensus.cc:3037] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:14:01.887164 1257 raft_consensus.cc:504] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } }
I20260811 08:14:01.887339 1257 leader_election.cc:288] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb [CANDIDATE]: Term 1 election: Requested vote from peers 77bf1e0e6a384d3ba35ded06b93e67d1 (127.20.158.131:37851), 77f76f68575d4c08a7bf3d1dec1f38a7 (127.20.158.130:41529)
I20260811 08:14:01.887506 883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15864147c8f543d5a22d0ebb27b71ec4" candidate_uuid: "e9e2179c98f9446286dc5759ed8da7cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7"
I20260811 08:14:01.887498 1109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "15864147c8f543d5a22d0ebb27b71ec4" candidate_uuid: "e9e2179c98f9446286dc5759ed8da7cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1"
I20260811 08:14:01.887586 883 raft_consensus.cc:3037] T 15864147c8f543d5a22d0ebb27b71ec4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:14:01.887612 1109 raft_consensus.cc:3037] T 15864147c8f543d5a22d0ebb27b71ec4 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:14:01.888375 1109 raft_consensus.cc:2454] T 15864147c8f543d5a22d0ebb27b71ec4 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9e2179c98f9446286dc5759ed8da7cb in term 1.
I20260811 08:14:01.888383 883 raft_consensus.cc:2454] T 15864147c8f543d5a22d0ebb27b71ec4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9e2179c98f9446286dc5759ed8da7cb in term 1.
I20260811 08:14:01.888602 569 leader_election.cc:302] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77f76f68575d4c08a7bf3d1dec1f38a7, e9e2179c98f9446286dc5759ed8da7cb; no voters:
I20260811 08:14:01.888693 1257 raft_consensus.cc:2781] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:14:01.888849 1257 raft_consensus.cc:686] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb [term 1 LEADER]: Becoming Leader. State: Replica: e9e2179c98f9446286dc5759ed8da7cb, State: Running, Role: LEADER
I20260811 08:14:01.888958 1257 consensus_queue.cc:237] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } }
I20260811 08:14:01.889919 426 catalog_manager.cc:5495] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb reported cstate change: term changed from 0 to 1, leader changed from <none> to e9e2179c98f9446286dc5759ed8da7cb (127.20.158.129). New cstate: current_term: 1 leader_uuid: "e9e2179c98f9446286dc5759ed8da7cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } health_report { overall_health: UNKNOWN } } }
I20260811 08:14:01.901119 1236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:01.898756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53372 (local address 127.20.158.129:42335)
0811 08:14:01.898828 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:01.898830 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:01.898838 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:14:01.898890 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:01.898891 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:01.898908 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:01.898971 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:14:01.899166 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.899632 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.900395 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:01.900577 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:01.900628 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:01.900787 (+ 159us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:14:01.900887 (+ 100us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:14:01.900948 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:01.900989 (+ 41us) server_negotiation.cc:299] Negotiation successful
0811 08:14:01.901006 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 08:14:01.903258 1109 raft_consensus.cc:1261] T 15864147c8f543d5a22d0ebb27b71ec4 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 1 FOLLOWER]: Refusing update from remote peer e9e2179c98f9446286dc5759ed8da7cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:14:01.903277 883 raft_consensus.cc:1261] T 15864147c8f543d5a22d0ebb27b71ec4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 1 FOLLOWER]: Refusing update from remote peer e9e2179c98f9446286dc5759ed8da7cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:14:01.903702 1257 consensus_queue.cc:1035] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:14:01.903864 1260 consensus_queue.cc:1035] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260811 08:14:01.904084 748 tablet.cc:2369] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:14:01.906793 1272 mvcc.cc:205] Tried to move back new op lower bound from 7317242027632549888 to 7317242027578028032. Current Snapshot: MvccSnapshot[applied={T|T < 7317242027632549888}]
I20260811 08:14:01.907171 1273 mvcc.cc:205] Tried to move back new op lower bound from 7317242027632549888 to 7317242027578028032. Current Snapshot: MvccSnapshot[applied={T|T < 7317242027632549888}]
I20260811 08:14:01.908857 430 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:14:01.908951 430 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:14:01.909741 430 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77: Sending DeleteTablet for 3 replicas of tablet 15864147c8f543d5a22d0ebb27b71ec4
I20260811 08:14:01.910054 641 tablet_service.cc:1514] Processing DeleteTablet for tablet 15864147c8f543d5a22d0ebb27b71ec4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:14:01 UTC) from {username='oryx', principal='oryx/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:53364
I20260811 08:14:01.910112 851 tablet_service.cc:1514] Processing DeleteTablet for tablet 15864147c8f543d5a22d0ebb27b71ec4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:14:01 UTC) from {username='oryx', principal='oryx/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:52198
I20260811 08:14:01.910226 1078 tablet_service.cc:1514] Processing DeleteTablet for tablet 15864147c8f543d5a22d0ebb27b71ec4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:14:01 UTC) from {username='oryx', principal='oryx/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:33780
I20260811 08:14:01.910357 1283 tablet_replica.cc:330] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb: stopping tablet replica
I20260811 08:14:01.910466 1283 raft_consensus.cc:2229] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:14:01.910487 1288 tablet_replica.cc:330] T 15864147c8f543d5a22d0ebb27b71ec4 P 77bf1e0e6a384d3ba35ded06b93e67d1: stopping tablet replica
I20260811 08:14:01.910583 1283 raft_consensus.cc:2258] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:14:01.910720 1288 raft_consensus.cc:2229] T 15864147c8f543d5a22d0ebb27b71ec4 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:14:01.910665 430 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41176:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:14:01.910816 430 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:14:01.911083 1283 ts_tablet_manager.cc:1905] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:14:01.911356 1288 raft_consensus.cc:2258] T 15864147c8f543d5a22d0ebb27b71ec4 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:14:01.911886 1288 ts_tablet_manager.cc:1905] T 15864147c8f543d5a22d0ebb27b71ec4 P 77bf1e0e6a384d3ba35ded06b93e67d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:14:01.912173 641 tablet_service.cc:1467] Processing CreateTablet for tablet 9a3fa6a8dfe542b6a9e3dfc42513a7e5 (DEFAULT_TABLE table=test-table [id=6dc8a0a9382e4317b68d2c02495b4324]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:14:01.912318 641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a3fa6a8dfe542b6a9e3dfc42513a7e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:14:01.912895 1283 ts_tablet_manager.cc:1918] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:14:01.912976 1283 log.cc:1196] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-0/wal/wals/15864147c8f543d5a22d0ebb27b71ec4
I20260811 08:14:01.913249 1283 ts_tablet_manager.cc:1939] T 15864147c8f543d5a22d0ebb27b71ec4 P e9e2179c98f9446286dc5759ed8da7cb: Deleting consensus metadata
I20260811 08:14:01.913600 1243 tablet_bootstrap.cc:492] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P e9e2179c98f9446286dc5759ed8da7cb: Bootstrap starting.
I20260811 08:14:01.914075 1243 tablet_bootstrap.cc:654] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P e9e2179c98f9446286dc5759ed8da7cb: Neither blocks nor log segments found. Creating new log.
I20260811 08:14:01.914119 1288 ts_tablet_manager.cc:1918] T 15864147c8f543d5a22d0ebb27b71ec4 P 77bf1e0e6a384d3ba35ded06b93e67d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:14:01.914201 851 tablet_service.cc:1467] Processing CreateTablet for tablet 9a3fa6a8dfe542b6a9e3dfc42513a7e5 (DEFAULT_TABLE table=test-table [id=6dc8a0a9382e4317b68d2c02495b4324]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:14:01.914340 851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a3fa6a8dfe542b6a9e3dfc42513a7e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:14:01.914343 1288 log.cc:1196] T 15864147c8f543d5a22d0ebb27b71ec4 P 77bf1e0e6a384d3ba35ded06b93e67d1: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-2/wal/wals/15864147c8f543d5a22d0ebb27b71ec4
I20260811 08:14:01.914719 1288 ts_tablet_manager.cc:1939] T 15864147c8f543d5a22d0ebb27b71ec4 P 77bf1e0e6a384d3ba35ded06b93e67d1: Deleting consensus metadata
I20260811 08:14:01.914834 1243 tablet_bootstrap.cc:492] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P e9e2179c98f9446286dc5759ed8da7cb: No bootstrap required, opened a new log
I20260811 08:14:01.914884 1243 ts_tablet_manager.cc:1397] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P e9e2179c98f9446286dc5759ed8da7cb: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:14:01.915028 1243 raft_consensus.cc:348] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:01.915112 1243 raft_consensus.cc:374] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:14:01.915139 1243 raft_consensus.cc:729] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9e2179c98f9446286dc5759ed8da7cb, State: Initialized, Role: FOLLOWER
I20260811 08:14:01.915184 1243 consensus_queue.cc:260] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P e9e2179c98f9446286dc5759ed8da7cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:01.915289 1243 ts_tablet_manager.cc:1428] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P e9e2179c98f9446286dc5759ed8da7cb: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 08:14:01.915766 1246 tablet_bootstrap.cc:492] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77f76f68575d4c08a7bf3d1dec1f38a7: Bootstrap starting.
I20260811 08:14:01.915836 407 catalog_manager.cc:4841] TS e9e2179c98f9446286dc5759ed8da7cb (127.20.158.129:42335): tablet 15864147c8f543d5a22d0ebb27b71ec4 (table test-table [id=1929380a640e43829bbb2f57b039e047]) successfully deleted
I20260811 08:14:01.916182 408 catalog_manager.cc:4841] TS 77bf1e0e6a384d3ba35ded06b93e67d1 (127.20.158.131:37851): tablet 15864147c8f543d5a22d0ebb27b71ec4 (table test-table [id=1929380a640e43829bbb2f57b039e047]) successfully deleted
I20260811 08:14:01.916251 1078 tablet_service.cc:1467] Processing CreateTablet for tablet 9a3fa6a8dfe542b6a9e3dfc42513a7e5 (DEFAULT_TABLE table=test-table [id=6dc8a0a9382e4317b68d2c02495b4324]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:14:01.916318 1246 tablet_bootstrap.cc:654] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77f76f68575d4c08a7bf3d1dec1f38a7: Neither blocks nor log segments found. Creating new log.
I20260811 08:14:01.916356 1078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a3fa6a8dfe542b6a9e3dfc42513a7e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:14:01.916518 1286 tablet_replica.cc:330] T 15864147c8f543d5a22d0ebb27b71ec4 P 77f76f68575d4c08a7bf3d1dec1f38a7: stopping tablet replica
I20260811 08:14:01.916610 1286 raft_consensus.cc:2229] T 15864147c8f543d5a22d0ebb27b71ec4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:14:01.916706 1286 raft_consensus.cc:2258] T 15864147c8f543d5a22d0ebb27b71ec4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:14:01.917119 1246 tablet_bootstrap.cc:492] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77f76f68575d4c08a7bf3d1dec1f38a7: No bootstrap required, opened a new log
I20260811 08:14:01.917168 1246 ts_tablet_manager.cc:1397] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77f76f68575d4c08a7bf3d1dec1f38a7: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:14:01.917186 1286 ts_tablet_manager.cc:1905] T 15864147c8f543d5a22d0ebb27b71ec4 P 77f76f68575d4c08a7bf3d1dec1f38a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:14:01.917325 1246 raft_consensus.cc:348] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:01.917390 1246 raft_consensus.cc:374] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:14:01.917410 1246 raft_consensus.cc:729] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77f76f68575d4c08a7bf3d1dec1f38a7, State: Initialized, Role: FOLLOWER
I20260811 08:14:01.917455 1246 consensus_queue.cc:260] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77f76f68575d4c08a7bf3d1dec1f38a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:01.917567 1246 ts_tablet_manager.cc:1428] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77f76f68575d4c08a7bf3d1dec1f38a7: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:01.917692 1245 tablet_bootstrap.cc:492] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1: Bootstrap starting.
I20260811 08:14:01.918149 1245 tablet_bootstrap.cc:654] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1: Neither blocks nor log segments found. Creating new log.
I20260811 08:14:01.918948 1245 tablet_bootstrap.cc:492] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1: No bootstrap required, opened a new log
I20260811 08:14:01.918998 1245 ts_tablet_manager.cc:1397] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:14:01.919148 1245 raft_consensus.cc:348] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:01.919241 1245 raft_consensus.cc:374] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:14:01.919268 1245 raft_consensus.cc:729] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77bf1e0e6a384d3ba35ded06b93e67d1, State: Initialized, Role: FOLLOWER
I20260811 08:14:01.919323 1245 consensus_queue.cc:260] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:01.919337 1286 ts_tablet_manager.cc:1918] T 15864147c8f543d5a22d0ebb27b71ec4 P 77f76f68575d4c08a7bf3d1dec1f38a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:14:01.919407 1286 log.cc:1196] T 15864147c8f543d5a22d0ebb27b71ec4 P 77f76f68575d4c08a7bf3d1dec1f38a7: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-1/wal/wals/15864147c8f543d5a22d0ebb27b71ec4
I20260811 08:14:01.919421 1245 ts_tablet_manager.cc:1428] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 08:14:01.919746 1286 ts_tablet_manager.cc:1939] T 15864147c8f543d5a22d0ebb27b71ec4 P 77f76f68575d4c08a7bf3d1dec1f38a7: Deleting consensus metadata
I20260811 08:14:01.920185 406 catalog_manager.cc:4841] TS 77f76f68575d4c08a7bf3d1dec1f38a7 (127.20.158.130:41529): tablet 15864147c8f543d5a22d0ebb27b71ec4 (table test-table [id=1929380a640e43829bbb2f57b039e047]) successfully deleted
W20260811 08:14:01.983180 1200 tablet.cc:2369] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:14:02.005921 1254 raft_consensus.cc:482] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:14:02.006055 1254 raft_consensus.cc:504] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.006420 1254 leader_election.cc:288] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9e2179c98f9446286dc5759ed8da7cb (127.20.158.129:42335), 77f76f68575d4c08a7bf3d1dec1f38a7 (127.20.158.130:41529)
I20260811 08:14:02.010305 1005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:02.006660 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:42335 (local address 127.20.158.131:37089)
0811 08:14:02.006784 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:02.006797 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:02.006867 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:02.007096 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:02.007097 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:02.007099 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:14:02.007185 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:02.007187 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.008168 (+ 981us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.008170 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:02.009240 (+ 1070us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:02.009242 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.010019 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.010020 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:02.010111 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:02.010115 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:14:02.010178 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 08:14:02.010224 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96,"mutex_wait_us":31}
I20260811 08:14:02.010478 1237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:02.006754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:56831 (local address 127.20.158.130:41529)
0811 08:14:02.006806 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:02.006809 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:02.007030 (+ 221us) server_negotiation.cc:407] Connection header received
0811 08:14:02.007135 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:02.007137 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:02.007149 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:02.007180 (+ 31us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:14:02.007399 (+ 219us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.008203 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.009570 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.010094 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.010181 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:02.010189 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:02.010371 (+ 182us) server_negotiation.cc:299] Negotiation successful
0811 08:14:02.010412 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:14:02.010499 1293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:02.006662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:41529 (local address 127.20.158.131:56831)
0811 08:14:02.006961 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:02.006971 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:02.007042 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:02.007244 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:02.007245 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:02.007247 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:14:02.007344 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:02.007346 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.008304 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.008305 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:02.009436 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:02.009439 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.010216 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.010218 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:02.010294 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:02.010298 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:14:02.010364 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 08:14:02.010404 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":286,"mutex_wait_us":161,"thread_start_us":76,"threads_started":1}
I20260811 08:14:02.010632 1236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:02.006913 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:37089 (local address 127.20.158.129:42335)
0811 08:14:02.006977 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:02.006980 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:02.006989 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:14:02.007019 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:02.007021 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:02.007033 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:02.007087 (+ 54us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:14:02.007272 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.008084 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.009337 (+ 1253us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.009917 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.009994 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:02.010004 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:02.010522 (+ 518us) server_negotiation.cc:299] Negotiation successful
0811 08:14:02.010568 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 08:14:02.010875 670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a3fa6a8dfe542b6a9e3dfc42513a7e5" candidate_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9e2179c98f9446286dc5759ed8da7cb" is_pre_election: true
I20260811 08:14:02.011003 670 raft_consensus.cc:2454] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77bf1e0e6a384d3ba35ded06b93e67d1 in term 0.
I20260811 08:14:02.011005 883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a3fa6a8dfe542b6a9e3dfc42513a7e5" candidate_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" is_pre_election: true
I20260811 08:14:02.011112 883 raft_consensus.cc:2454] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77bf1e0e6a384d3ba35ded06b93e67d1 in term 0.
I20260811 08:14:02.011219 994 leader_election.cc:302] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77bf1e0e6a384d3ba35ded06b93e67d1, e9e2179c98f9446286dc5759ed8da7cb; no voters:
I20260811 08:14:02.011373 1254 raft_consensus.cc:2781] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:14:02.011412 1254 raft_consensus.cc:482] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:14:02.011442 1254 raft_consensus.cc:3037] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:14:02.012358 1254 raft_consensus.cc:504] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.012532 1254 leader_election.cc:288] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1 [CANDIDATE]: Term 1 election: Requested vote from peers e9e2179c98f9446286dc5759ed8da7cb (127.20.158.129:42335), 77f76f68575d4c08a7bf3d1dec1f38a7 (127.20.158.130:41529)
I20260811 08:14:02.012696 670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a3fa6a8dfe542b6a9e3dfc42513a7e5" candidate_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9e2179c98f9446286dc5759ed8da7cb"
I20260811 08:14:02.012779 670 raft_consensus.cc:3037] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:14:02.012753 883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a3fa6a8dfe542b6a9e3dfc42513a7e5" candidate_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7"
I20260811 08:14:02.012815 883 raft_consensus.cc:3037] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:14:02.013669 883 raft_consensus.cc:2454] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77bf1e0e6a384d3ba35ded06b93e67d1 in term 1.
I20260811 08:14:02.013872 993 leader_election.cc:302] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77bf1e0e6a384d3ba35ded06b93e67d1, 77f76f68575d4c08a7bf3d1dec1f38a7; no voters:
I20260811 08:14:02.013969 1254 raft_consensus.cc:2781] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:14:02.014101 670 raft_consensus.cc:2454] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P e9e2179c98f9446286dc5759ed8da7cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77bf1e0e6a384d3ba35ded06b93e67d1 in term 1.
I20260811 08:14:02.014120 1254 raft_consensus.cc:686] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 1 LEADER]: Becoming Leader. State: Replica: 77bf1e0e6a384d3ba35ded06b93e67d1, State: Running, Role: LEADER
I20260811 08:14:02.014213 1254 consensus_queue.cc:237] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.015033 430 catalog_manager.cc:5495] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77bf1e0e6a384d3ba35ded06b93e67d1 (127.20.158.131). New cstate: current_term: 1 leader_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } health_report { overall_health: HEALTHY } } }
Aug 11 08:14:02 dist-test-slave-gkw7 krb5kdc[358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436041, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.190@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM
I20260811 08:14:02.057205 1308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:02.050309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:34327 (local address 127.0.0.1:41192)
0811 08:14:02.050491 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:02.050507 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:02.050570 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:02.050709 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:02.050710 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:02.051017 (+ 307us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:02.051069 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:02.051071 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.051714 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.051715 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:02.052267 (+ 552us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:02.052269 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.052619 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.052621 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:02.052677 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:02.053253 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:02.053258 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:02.054785 (+ 1527us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:14:02.056241 (+ 1456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:14:02.056249 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:14:02.056251 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:14:02.056448 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:14:02.056626 (+ 178us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:14:02.056626 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:14:02.056626 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:14:02.056688 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:14:02.056898 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:14:02.056904 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:14:02.056946 (+ 42us) client_negotiation.cc:769] Sending connection context
0811 08:14:02.056997 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 08:14:02.057087 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":107,"threads_started":1}
I20260811 08:14:02.057207 506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:02.050359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41192 (local address 127.20.158.190:34327)
0811 08:14:02.050440 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:02.050442 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:02.050571 (+ 129us) server_negotiation.cc:407] Connection header received
0811 08:14:02.050633 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:02.050634 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:02.050644 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:02.050687 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:02.051136 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.051636 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.052341 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.052517 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.052571 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:02.054870 (+ 2299us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:02.054871 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:02.054872 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:14:02.054878 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:02.056161 (+ 1283us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:02.056513 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:02.056513 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:02.056514 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:02.056565 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:02.056742 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:02.056743 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:02.056743 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:02.056842 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:02.056894 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:02.057029 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 08:14:02.057135 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":40,"server-negotiator.queue_time_us":49}
I20260811 08:14:02.059228 430 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:41192:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260811 08:14:02.059459 430 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:14:02.061075 851 tablet_service.cc:1467] Processing CreateTablet for tablet 67baa74971d74080b157023e0fb343c4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fc55c275a6974542a54f28f249897a51]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 08:14:02.061048 641 tablet_service.cc:1467] Processing CreateTablet for tablet 67baa74971d74080b157023e0fb343c4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fc55c275a6974542a54f28f249897a51]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 08:14:02.061232 851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67baa74971d74080b157023e0fb343c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:14:02.061249 641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67baa74971d74080b157023e0fb343c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:14:02.061204 1078 tablet_service.cc:1467] Processing CreateTablet for tablet 67baa74971d74080b157023e0fb343c4 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=fc55c275a6974542a54f28f249897a51]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260811 08:14:02.061355 1078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 67baa74971d74080b157023e0fb343c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:14:02.062740 1245 tablet_bootstrap.cc:492] T 67baa74971d74080b157023e0fb343c4 P 77bf1e0e6a384d3ba35ded06b93e67d1: Bootstrap starting.
I20260811 08:14:02.062829 1243 tablet_bootstrap.cc:492] T 67baa74971d74080b157023e0fb343c4 P e9e2179c98f9446286dc5759ed8da7cb: Bootstrap starting.
I20260811 08:14:02.063169 1243 tablet_bootstrap.cc:654] T 67baa74971d74080b157023e0fb343c4 P e9e2179c98f9446286dc5759ed8da7cb: Neither blocks nor log segments found. Creating new log.
I20260811 08:14:02.063184 1245 tablet_bootstrap.cc:654] T 67baa74971d74080b157023e0fb343c4 P 77bf1e0e6a384d3ba35ded06b93e67d1: Neither blocks nor log segments found. Creating new log.
I20260811 08:14:02.063437 1246 tablet_bootstrap.cc:492] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7: Bootstrap starting.
I20260811 08:14:02.063825 1246 tablet_bootstrap.cc:654] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7: Neither blocks nor log segments found. Creating new log.
I20260811 08:14:02.064323 1243 tablet_bootstrap.cc:492] T 67baa74971d74080b157023e0fb343c4 P e9e2179c98f9446286dc5759ed8da7cb: No bootstrap required, opened a new log
I20260811 08:14:02.064396 1243 ts_tablet_manager.cc:1397] T 67baa74971d74080b157023e0fb343c4 P e9e2179c98f9446286dc5759ed8da7cb: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:14:02.064544 1246 tablet_bootstrap.cc:492] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7: No bootstrap required, opened a new log
I20260811 08:14:02.064589 1246 ts_tablet_manager.cc:1397] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:14:02.064530 1243 raft_consensus.cc:348] T 67baa74971d74080b157023e0fb343c4 P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.064612 1243 raft_consensus.cc:374] T 67baa74971d74080b157023e0fb343c4 P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:14:02.064648 1243 raft_consensus.cc:729] T 67baa74971d74080b157023e0fb343c4 P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9e2179c98f9446286dc5759ed8da7cb, State: Initialized, Role: FOLLOWER
I20260811 08:14:02.064703 1243 consensus_queue.cc:260] T 67baa74971d74080b157023e0fb343c4 P e9e2179c98f9446286dc5759ed8da7cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.064811 1243 ts_tablet_manager.cc:1428] T 67baa74971d74080b157023e0fb343c4 P e9e2179c98f9446286dc5759ed8da7cb: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 08:14:02.064764 1246 raft_consensus.cc:348] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.064847 1246 raft_consensus.cc:374] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:14:02.064885 1246 raft_consensus.cc:729] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77f76f68575d4c08a7bf3d1dec1f38a7, State: Initialized, Role: FOLLOWER
I20260811 08:14:02.064934 1246 consensus_queue.cc:260] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.064932 1257 tablet_replica.cc:439] T 67baa74971d74080b157023e0fb343c4 P e9e2179c98f9446286dc5759ed8da7cb: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } } }
I20260811 08:14:02.065009 1257 tablet_replica.cc:442] T 67baa74971d74080b157023e0fb343c4 P e9e2179c98f9446286dc5759ed8da7cb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:14:02.065033 1246 ts_tablet_manager.cc:1428] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 08:14:02.065178 1256 tablet_replica.cc:439] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } } }
I20260811 08:14:02.065239 1256 tablet_replica.cc:442] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:14:02.065464 1245 tablet_bootstrap.cc:492] T 67baa74971d74080b157023e0fb343c4 P 77bf1e0e6a384d3ba35ded06b93e67d1: No bootstrap required, opened a new log
I20260811 08:14:02.065515 1245 ts_tablet_manager.cc:1397] T 67baa74971d74080b157023e0fb343c4 P 77bf1e0e6a384d3ba35ded06b93e67d1: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 08:14:02.065845 1245 raft_consensus.cc:348] T 67baa74971d74080b157023e0fb343c4 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.065925 1245 raft_consensus.cc:374] T 67baa74971d74080b157023e0fb343c4 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:14:02.065948 1245 raft_consensus.cc:729] T 67baa74971d74080b157023e0fb343c4 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77bf1e0e6a384d3ba35ded06b93e67d1, State: Initialized, Role: FOLLOWER
I20260811 08:14:02.066018 1245 consensus_queue.cc:260] T 67baa74971d74080b157023e0fb343c4 P 77bf1e0e6a384d3ba35ded06b93e67d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.066135 1245 ts_tablet_manager.cc:1428] T 67baa74971d74080b157023e0fb343c4 P 77bf1e0e6a384d3ba35ded06b93e67d1: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 08:14:02.066146 1254 tablet_replica.cc:439] T 67baa74971d74080b157023e0fb343c4 P 77bf1e0e6a384d3ba35ded06b93e67d1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } } }
I20260811 08:14:02.066258 1254 tablet_replica.cc:442] T 67baa74971d74080b157023e0fb343c4 P 77bf1e0e6a384d3ba35ded06b93e67d1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:14:02.147311 1256 raft_consensus.cc:482] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:14:02.147415 1256 raft_consensus.cc:504] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.148025 1256 leader_election.cc:288] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9e2179c98f9446286dc5759ed8da7cb (127.20.158.129:42335), 77bf1e0e6a384d3ba35ded06b93e67d1 (127.20.158.131:37851)
I20260811 08:14:02.151167 1313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:02.148034 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:42335 (local address 127.20.158.130:34011)
0811 08:14:02.148194 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:02.148208 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:02.148313 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:02.148494 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:02.148495 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:02.148498 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:14:02.148564 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:02.148567 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.149237 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.149238 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:02.150169 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:02.150172 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.150870 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.150871 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:02.150948 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:02.150952 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:14:02.151008 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 08:14:02.151040 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":30,"thread_start_us":80,"threads_started":1}
I20260811 08:14:02.151173 1236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:02.148093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:34011 (local address 127.20.158.129:42335)
0811 08:14:02.148145 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:02.148147 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:02.148274 (+ 127us) server_negotiation.cc:407] Connection header received
0811 08:14:02.148405 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:02.148407 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:02.148417 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:02.148482 (+ 65us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:14:02.148640 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.149149 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.150369 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.150757 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.150829 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:02.150836 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:02.151046 (+ 210us) server_negotiation.cc:299] Negotiation successful
0811 08:14:02.151100 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:14:02.151298 1242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:02.148266 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:59349 (local address 127.20.158.131:37851)
0811 08:14:02.148330 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:02.148332 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:02.148342 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:14:02.148452 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:02.148453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:02.148464 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:02.148522 (+ 58us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:14:02.148715 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.149169 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.150245 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.150795 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.150907 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:02.150915 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:02.151169 (+ 254us) server_negotiation.cc:299] Negotiation successful
0811 08:14:02.151219 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 08:14:02.151193 1316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:02.148176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:37851 (local address 127.20.158.130:59349)
0811 08:14:02.148279 (+ 103us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:02.148290 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:02.148371 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:02.148542 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:02.148543 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:02.148545 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:14:02.148635 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:02.148637 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.149274 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.149275 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:02.150146 (+ 871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:02.150148 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.150926 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.150927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:02.150984 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:02.151019 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 08:14:02.151075 (+ 56us) client_negotiation.cc:240] Negotiation successful
0811 08:14:02.151113 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":86,"mutex_wait_us":30,"thread_start_us":62,"threads_started":1}
I20260811 08:14:02.151638 670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67baa74971d74080b157023e0fb343c4" candidate_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9e2179c98f9446286dc5759ed8da7cb" is_pre_election: true
I20260811 08:14:02.151739 670 raft_consensus.cc:2454] T 67baa74971d74080b157023e0fb343c4 P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77f76f68575d4c08a7bf3d1dec1f38a7 in term 0.
I20260811 08:14:02.151899 1109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67baa74971d74080b157023e0fb343c4" candidate_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" is_pre_election: true
I20260811 08:14:02.151933 783 leader_election.cc:302] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77f76f68575d4c08a7bf3d1dec1f38a7, e9e2179c98f9446286dc5759ed8da7cb; no voters:
I20260811 08:14:02.151997 1109 raft_consensus.cc:2454] T 67baa74971d74080b157023e0fb343c4 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77f76f68575d4c08a7bf3d1dec1f38a7 in term 0.
I20260811 08:14:02.152064 1256 raft_consensus.cc:2781] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:14:02.152109 1256 raft_consensus.cc:482] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:14:02.152135 1256 raft_consensus.cc:3037] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:14:02.152848 1256 raft_consensus.cc:504] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.152998 1256 leader_election.cc:288] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [CANDIDATE]: Term 1 election: Requested vote from peers e9e2179c98f9446286dc5759ed8da7cb (127.20.158.129:42335), 77bf1e0e6a384d3ba35ded06b93e67d1 (127.20.158.131:37851)
I20260811 08:14:02.153160 670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67baa74971d74080b157023e0fb343c4" candidate_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9e2179c98f9446286dc5759ed8da7cb"
I20260811 08:14:02.153225 1109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "67baa74971d74080b157023e0fb343c4" candidate_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1"
I20260811 08:14:02.153283 670 raft_consensus.cc:3037] T 67baa74971d74080b157023e0fb343c4 P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:14:02.153287 1109 raft_consensus.cc:3037] T 67baa74971d74080b157023e0fb343c4 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:14:02.154002 1109 raft_consensus.cc:2454] T 67baa74971d74080b157023e0fb343c4 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77f76f68575d4c08a7bf3d1dec1f38a7 in term 1.
I20260811 08:14:02.154026 670 raft_consensus.cc:2454] T 67baa74971d74080b157023e0fb343c4 P e9e2179c98f9446286dc5759ed8da7cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77f76f68575d4c08a7bf3d1dec1f38a7 in term 1.
I20260811 08:14:02.154208 784 leader_election.cc:302] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77bf1e0e6a384d3ba35ded06b93e67d1, 77f76f68575d4c08a7bf3d1dec1f38a7; no voters:
I20260811 08:14:02.154321 1256 raft_consensus.cc:2781] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:14:02.154461 1256 raft_consensus.cc:686] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 1 LEADER]: Becoming Leader. State: Replica: 77f76f68575d4c08a7bf3d1dec1f38a7, State: Running, Role: LEADER
I20260811 08:14:02.154539 1256 consensus_queue.cc:237] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.155000 1317 tablet_replica.cc:439] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7: TxnStatusTablet state changed. Reason: New leader 77f76f68575d4c08a7bf3d1dec1f38a7. Latest consensus state: current_term: 1 leader_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } } }
I20260811 08:14:02.155133 1317 tablet_replica.cc:442] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7: This TxnStatusTablet replica's current role is: LEADER
I20260811 08:14:02.155414 1319 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260811 08:14:02.155566 1319 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260811 08:14:02.155575 425 catalog_manager.cc:5495] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77f76f68575d4c08a7bf3d1dec1f38a7 (127.20.158.130). New cstate: current_term: 1 leader_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } health_report { overall_health: UNKNOWN } } }
I20260811 08:14:02.184510 1308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:02.181126 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:41529 (local address 127.0.0.1:52208)
0811 08:14:02.181291 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:02.181320 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:02.181410 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:02.181679 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:02.181681 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:02.181684 (+ 3us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:14:02.181736 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:02.181738 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.182783 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.182784 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:02.183398 (+ 614us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:02.183400 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.183933 (+ 533us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.183934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:02.183993 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:02.184008 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:14:02.184341 (+ 333us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:14:02.184353 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 08:14:02.184403 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 08:14:02.184447 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124}
I20260811 08:14:02.184551 1237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:02.181214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52208 (local address 127.20.158.130:41529)
0811 08:14:02.181271 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:02.181274 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:02.181372 (+ 98us) server_negotiation.cc:407] Connection header received
0811 08:14:02.181513 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:02.181514 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:02.181554 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:02.181646 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:14:02.181821 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.182682 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.183492 (+ 810us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.183845 (+ 353us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.183925 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:02.184115 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:14:02.184250 (+ 135us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:14:02.184337 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:02.184408 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 08:14:02.184430 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:14:02.185824 1109 raft_consensus.cc:1261] T 67baa74971d74080b157023e0fb343c4 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 1 FOLLOWER]: Refusing update from remote peer 77f76f68575d4c08a7bf3d1dec1f38a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:14:02.185876 670 raft_consensus.cc:1261] T 67baa74971d74080b157023e0fb343c4 P e9e2179c98f9446286dc5759ed8da7cb [term 1 FOLLOWER]: Refusing update from remote peer 77f76f68575d4c08a7bf3d1dec1f38a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:14:02.186232 1256 consensus_queue.cc:1035] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:14:02.186398 1317 consensus_queue.cc:1035] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:14:02.187088 1254 tablet_replica.cc:439] T 67baa74971d74080b157023e0fb343c4 P 77bf1e0e6a384d3ba35ded06b93e67d1: TxnStatusTablet state changed. Reason: New leader 77f76f68575d4c08a7bf3d1dec1f38a7. Latest consensus state: current_term: 1 leader_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } } }
I20260811 08:14:02.187186 1254 tablet_replica.cc:442] T 67baa74971d74080b157023e0fb343c4 P 77bf1e0e6a384d3ba35ded06b93e67d1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:14:02.187135 1257 tablet_replica.cc:439] T 67baa74971d74080b157023e0fb343c4 P e9e2179c98f9446286dc5759ed8da7cb: TxnStatusTablet state changed. Reason: New leader 77f76f68575d4c08a7bf3d1dec1f38a7. Latest consensus state: current_term: 1 leader_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } } }
I20260811 08:14:02.187234 1257 tablet_replica.cc:442] T 67baa74971d74080b157023e0fb343c4 P e9e2179c98f9446286dc5759ed8da7cb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:14:02.188097 1256 tablet_replica.cc:439] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } } }
I20260811 08:14:02.188186 1256 tablet_replica.cc:442] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7: This TxnStatusTablet replica's current role is: LEADER
I20260811 08:14:02.188151 1330 tablet_replica.cc:439] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } } }
I20260811 08:14:02.188231 1330 tablet_replica.cc:442] T 67baa74971d74080b157023e0fb343c4 P 77f76f68575d4c08a7bf3d1dec1f38a7: This TxnStatusTablet replica's current role is: LEADER
I20260811 08:14:02.188323 1257 tablet_replica.cc:439] T 67baa74971d74080b157023e0fb343c4 P e9e2179c98f9446286dc5759ed8da7cb: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } } }
I20260811 08:14:02.188393 1257 tablet_replica.cc:442] T 67baa74971d74080b157023e0fb343c4 P e9e2179c98f9446286dc5759ed8da7cb: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:14:02.188624 1271 mvcc.cc:205] Tried to move back new op lower bound from 7317242028790652928 to 7317242028665626624. Current Snapshot: MvccSnapshot[applied={T|T < 7317242028790652928 or (T in {7317242028790652928})}]
I20260811 08:14:02.189209 1254 tablet_replica.cc:439] T 67baa74971d74080b157023e0fb343c4 P 77bf1e0e6a384d3ba35ded06b93e67d1: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } } }
I20260811 08:14:02.189296 1254 tablet_replica.cc:442] T 67baa74971d74080b157023e0fb343c4 P 77bf1e0e6a384d3ba35ded06b93e67d1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260811 08:14:02.193032 1242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:02.190620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33788 (local address 127.20.158.131:37851)
0811 08:14:02.190689 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:02.190691 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:02.190717 (+ 26us) server_negotiation.cc:407] Connection header received
0811 08:14:02.190752 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:02.190752 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:02.190771 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:02.190848 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:14:02.190991 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.191457 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.192206 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.192418 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.192494 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:02.192661 (+ 167us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:14:02.192782 (+ 121us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:14:02.192873 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:02.192934 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 08:14:02.192954 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 08:14:02.198275 1237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:02.195866 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:53843 (local address 127.20.158.130:41529)
0811 08:14:02.195920 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:02.195922 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:02.195930 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:14:02.195965 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:02.195966 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:02.195976 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:02.196046 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:14:02.196189 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.196662 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.197412 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.197726 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.197810 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:02.198010 (+ 200us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:14:02.198042 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:14:02.198108 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:02.198182 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 08:14:02.198203 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:14:02.198285 1208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:02.195773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:41529 (local address 127.20.158.131:53843)
0811 08:14:02.195851 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:02.195863 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:02.195905 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:02.196050 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:02.196051 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:02.196052 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:14:02.196115 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:02.196117 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.196754 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.196755 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:02.197326 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:02.197328 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.197809 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.197810 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:02.197886 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:02.197904 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:14:02.198119 (+ 215us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:14:02.198122 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:14:02.198176 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 08:14:02.198220 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 08:14:02.200865 670 raft_consensus.cc:1261] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P e9e2179c98f9446286dc5759ed8da7cb [term 1 FOLLOWER]: Refusing update from remote peer 77bf1e0e6a384d3ba35ded06b93e67d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:14:02.200851 883 raft_consensus.cc:1261] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 1 FOLLOWER]: Refusing update from remote peer 77bf1e0e6a384d3ba35ded06b93e67d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:14:02.201081 1294 consensus_queue.cc:1035] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:14:02.201193 1254 consensus_queue.cc:1035] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:14:02.210021 1242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:02.207186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:48205 (local address 127.20.158.131:37851)
0811 08:14:02.207228 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:02.207229 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:02.207388 (+ 159us) server_negotiation.cc:407] Connection header received
0811 08:14:02.207479 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:02.207480 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:02.207493 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:02.207534 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:14:02.207685 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.208201 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.209350 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.209575 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.209646 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:02.209840 (+ 194us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:14:02.209867 (+ 27us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:14:02.209902 (+ 35us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:02.209956 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 08:14:02.209973 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:14:02.210271 1344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:02.207156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:37851 (local address 127.20.158.130:48205)
0811 08:14:02.207320 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:02.207332 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:02.207425 (+ 93us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:02.207546 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:02.207547 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:02.207549 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:14:02.207621 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:02.207623 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.208267 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.208268 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:02.209262 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:02.209265 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.209665 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.209666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:02.209734 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:02.209752 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:14:02.209903 (+ 151us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:14:02.209905 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:14:02.209954 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 08:14:02.209998 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":111,"threads_started":1}
I20260811 08:14:02.218966 430 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:14:02.219077 430 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41176:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:14:02.219776 430 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77: Sending DeleteTablet for 3 replicas of tablet 9a3fa6a8dfe542b6a9e3dfc42513a7e5
I20260811 08:14:02.220116 641 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a3fa6a8dfe542b6a9e3dfc42513a7e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:14:02 UTC) from {username='oryx', principal='oryx/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:53364
I20260811 08:14:02.220227 1283 tablet_replica.cc:330] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P e9e2179c98f9446286dc5759ed8da7cb: stopping tablet replica
I20260811 08:14:02.220292 1283 raft_consensus.cc:2229] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P e9e2179c98f9446286dc5759ed8da7cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:14:02.220342 1283 raft_consensus.cc:2258] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P e9e2179c98f9446286dc5759ed8da7cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:14:02.220402 1078 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a3fa6a8dfe542b6a9e3dfc42513a7e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:14:02 UTC) from {username='oryx', principal='oryx/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:33780
I20260811 08:14:02.220496 1288 tablet_replica.cc:330] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1: stopping tablet replica
I20260811 08:14:02.220561 1288 raft_consensus.cc:2229] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:14:02.220683 1288 raft_consensus.cc:2258] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:14:02.220734 1283 ts_tablet_manager.cc:1905] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P e9e2179c98f9446286dc5759ed8da7cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:14:02.220764 851 tablet_service.cc:1514] Processing DeleteTablet for tablet 9a3fa6a8dfe542b6a9e3dfc42513a7e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:14:02 UTC) from {username='oryx', principal='oryx/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:52198
I20260811 08:14:02.220841 1286 tablet_replica.cc:330] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77f76f68575d4c08a7bf3d1dec1f38a7: stopping tablet replica
I20260811 08:14:02.220884 1286 raft_consensus.cc:2229] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:14:02.220923 1286 raft_consensus.cc:2258] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:14:02.221764 1288 ts_tablet_manager.cc:1905] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:14:02.222535 1283 ts_tablet_manager.cc:1918] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P e9e2179c98f9446286dc5759ed8da7cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:14:02.222596 1283 log.cc:1196] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P e9e2179c98f9446286dc5759ed8da7cb: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-0/wal/wals/9a3fa6a8dfe542b6a9e3dfc42513a7e5
I20260811 08:14:02.222826 1283 ts_tablet_manager.cc:1939] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P e9e2179c98f9446286dc5759ed8da7cb: Deleting consensus metadata
I20260811 08:14:02.223155 407 catalog_manager.cc:4841] TS e9e2179c98f9446286dc5759ed8da7cb (127.20.158.129:42335): tablet 9a3fa6a8dfe542b6a9e3dfc42513a7e5 (table test-table [id=6dc8a0a9382e4317b68d2c02495b4324]) successfully deleted
I20260811 08:14:02.223429 1288 ts_tablet_manager.cc:1918] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:14:02.223495 1288 log.cc:1196] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-2/wal/wals/9a3fa6a8dfe542b6a9e3dfc42513a7e5
I20260811 08:14:02.223718 1288 ts_tablet_manager.cc:1939] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77bf1e0e6a384d3ba35ded06b93e67d1: Deleting consensus metadata
I20260811 08:14:02.225064 408 catalog_manager.cc:4841] TS 77bf1e0e6a384d3ba35ded06b93e67d1 (127.20.158.131:37851): tablet 9a3fa6a8dfe542b6a9e3dfc42513a7e5 (table test-table [id=6dc8a0a9382e4317b68d2c02495b4324]) successfully deleted
I20260811 08:14:02.225378 1286 ts_tablet_manager.cc:1905] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77f76f68575d4c08a7bf3d1dec1f38a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:14:02.226876 1286 ts_tablet_manager.cc:1918] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77f76f68575d4c08a7bf3d1dec1f38a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:14:02.226943 1286 log.cc:1196] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77f76f68575d4c08a7bf3d1dec1f38a7: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-1/wal/wals/9a3fa6a8dfe542b6a9e3dfc42513a7e5
I20260811 08:14:02.227169 1286 ts_tablet_manager.cc:1939] T 9a3fa6a8dfe542b6a9e3dfc42513a7e5 P 77f76f68575d4c08a7bf3d1dec1f38a7: Deleting consensus metadata
I20260811 08:14:02.227474 406 catalog_manager.cc:4841] TS 77f76f68575d4c08a7bf3d1dec1f38a7 (127.20.158.130:41529): tablet 9a3fa6a8dfe542b6a9e3dfc42513a7e5 (table test-table [id=6dc8a0a9382e4317b68d2c02495b4324]) successfully deleted
Aug 11 08:14:02 dist-test-slave-gkw7 krb5kdc[358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 11 08:14:02 dist-test-slave-gkw7 krb5kdc[358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:02 dist-test-slave-gkw7 krb5kdc[358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
W20260811 08:14:02.255990 506 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:02.248631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41208 (local address 127.20.158.190:34327)
0811 08:14:02.248682 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:02.248684 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:02.248879 (+ 195us) server_negotiation.cc:407] Connection header received
0811 08:14:02.248946 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:02.248948 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:02.248961 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:02.249030 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:02.249950 (+ 920us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.250770 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.251855 (+ 1085us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.252186 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.252266 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:02.255916 (+ 3650us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41208: BlockingRecv error: recv got EOF from 127.0.0.1:41208 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 11 08:14:02 dist-test-slave-gkw7 krb5kdc[358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436042, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM
I20260811 08:14:02.267093 506 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:02.257264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41224 (local address 127.20.158.190:34327)
0811 08:14:02.257307 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:02.257309 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:02.257645 (+ 336us) server_negotiation.cc:407] Connection header received
0811 08:14:02.257677 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:02.257678 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:02.257690 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:02.257758 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:02.258384 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.259249 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.260309 (+ 1060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.260596 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.260679 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:02.263779 (+ 3100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:02.263780 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:02.263781 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:14:02.263790 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:02.265677 (+ 1887us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:02.266096 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:02.266097 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:02.266098 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:02.266167 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:02.266410 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:02.266410 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:02.266411 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:02.266554 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:02.266668 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:02.266823 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 08:14:02.266906 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:14:02.268900 430 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41224:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:14:02.269088 430 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:14:02.270638 851 tablet_service.cc:1467] Processing CreateTablet for tablet ff08fe194ba9497a851d6c2bb09c487b (DEFAULT_TABLE table=test-table [id=ddee65228a774d56bee9d25acdf43050]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:14:02.270789 851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff08fe194ba9497a851d6c2bb09c487b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:14:02.270783 641 tablet_service.cc:1467] Processing CreateTablet for tablet ff08fe194ba9497a851d6c2bb09c487b (DEFAULT_TABLE table=test-table [id=ddee65228a774d56bee9d25acdf43050]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:14:02.270929 641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff08fe194ba9497a851d6c2bb09c487b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:14:02.272254 1246 tablet_bootstrap.cc:492] T ff08fe194ba9497a851d6c2bb09c487b P 77f76f68575d4c08a7bf3d1dec1f38a7: Bootstrap starting.
I20260811 08:14:02.272524 1243 tablet_bootstrap.cc:492] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb: Bootstrap starting.
I20260811 08:14:02.272912 1243 tablet_bootstrap.cc:654] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb: Neither blocks nor log segments found. Creating new log.
I20260811 08:14:02.272931 1246 tablet_bootstrap.cc:654] T ff08fe194ba9497a851d6c2bb09c487b P 77f76f68575d4c08a7bf3d1dec1f38a7: Neither blocks nor log segments found. Creating new log.
I20260811 08:14:02.272399 1078 tablet_service.cc:1467] Processing CreateTablet for tablet ff08fe194ba9497a851d6c2bb09c487b (DEFAULT_TABLE table=test-table [id=ddee65228a774d56bee9d25acdf43050]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:14:02.273402 1078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff08fe194ba9497a851d6c2bb09c487b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:14:02.275077 1245 tablet_bootstrap.cc:492] T ff08fe194ba9497a851d6c2bb09c487b P 77bf1e0e6a384d3ba35ded06b93e67d1: Bootstrap starting.
I20260811 08:14:02.275525 1245 tablet_bootstrap.cc:654] T ff08fe194ba9497a851d6c2bb09c487b P 77bf1e0e6a384d3ba35ded06b93e67d1: Neither blocks nor log segments found. Creating new log.
I20260811 08:14:02.275571 1243 tablet_bootstrap.cc:492] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb: No bootstrap required, opened a new log
I20260811 08:14:02.275616 1243 ts_tablet_manager.cc:1397] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260811 08:14:02.275758 1243 raft_consensus.cc:348] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.275830 1243 raft_consensus.cc:374] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:14:02.275851 1243 raft_consensus.cc:729] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9e2179c98f9446286dc5759ed8da7cb, State: Initialized, Role: FOLLOWER
I20260811 08:14:02.275894 1243 consensus_queue.cc:260] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.275986 1243 ts_tablet_manager.cc:1428] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:02.276515 1245 tablet_bootstrap.cc:492] T ff08fe194ba9497a851d6c2bb09c487b P 77bf1e0e6a384d3ba35ded06b93e67d1: No bootstrap required, opened a new log
I20260811 08:14:02.276566 1245 ts_tablet_manager.cc:1397] T ff08fe194ba9497a851d6c2bb09c487b P 77bf1e0e6a384d3ba35ded06b93e67d1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:14:02.276870 1245 raft_consensus.cc:348] T ff08fe194ba9497a851d6c2bb09c487b P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.276976 1245 raft_consensus.cc:374] T ff08fe194ba9497a851d6c2bb09c487b P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:14:02.277004 1245 raft_consensus.cc:729] T ff08fe194ba9497a851d6c2bb09c487b P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77bf1e0e6a384d3ba35ded06b93e67d1, State: Initialized, Role: FOLLOWER
I20260811 08:14:02.277051 1245 consensus_queue.cc:260] T ff08fe194ba9497a851d6c2bb09c487b P 77bf1e0e6a384d3ba35ded06b93e67d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.277174 1245 ts_tablet_manager.cc:1428] T ff08fe194ba9497a851d6c2bb09c487b P 77bf1e0e6a384d3ba35ded06b93e67d1: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:02.277715 1246 tablet_bootstrap.cc:492] T ff08fe194ba9497a851d6c2bb09c487b P 77f76f68575d4c08a7bf3d1dec1f38a7: No bootstrap required, opened a new log
I20260811 08:14:02.277776 1246 ts_tablet_manager.cc:1397] T ff08fe194ba9497a851d6c2bb09c487b P 77f76f68575d4c08a7bf3d1dec1f38a7: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260811 08:14:02.277935 1246 raft_consensus.cc:348] T ff08fe194ba9497a851d6c2bb09c487b P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.278012 1246 raft_consensus.cc:374] T ff08fe194ba9497a851d6c2bb09c487b P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:14:02.278035 1246 raft_consensus.cc:729] T ff08fe194ba9497a851d6c2bb09c487b P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77f76f68575d4c08a7bf3d1dec1f38a7, State: Initialized, Role: FOLLOWER
I20260811 08:14:02.278080 1246 consensus_queue.cc:260] T ff08fe194ba9497a851d6c2bb09c487b P 77f76f68575d4c08a7bf3d1dec1f38a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.278198 1246 ts_tablet_manager.cc:1428] T ff08fe194ba9497a851d6c2bb09c487b P 77f76f68575d4c08a7bf3d1dec1f38a7: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 08:14:02.459774 1257 raft_consensus.cc:482] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:14:02.459883 1257 raft_consensus.cc:504] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.460047 1257 leader_election.cc:288] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 77f76f68575d4c08a7bf3d1dec1f38a7 (127.20.158.130:41529), 77bf1e0e6a384d3ba35ded06b93e67d1 (127.20.158.131:37851)
I20260811 08:14:02.460287 1109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff08fe194ba9497a851d6c2bb09c487b" candidate_uuid: "e9e2179c98f9446286dc5759ed8da7cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" is_pre_election: true
I20260811 08:14:02.460379 1109 raft_consensus.cc:2454] T ff08fe194ba9497a851d6c2bb09c487b P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9e2179c98f9446286dc5759ed8da7cb in term 0.
I20260811 08:14:02.460294 883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff08fe194ba9497a851d6c2bb09c487b" candidate_uuid: "e9e2179c98f9446286dc5759ed8da7cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" is_pre_election: true
I20260811 08:14:02.460427 883 raft_consensus.cc:2454] T ff08fe194ba9497a851d6c2bb09c487b P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9e2179c98f9446286dc5759ed8da7cb in term 0.
I20260811 08:14:02.460556 571 leader_election.cc:302] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77bf1e0e6a384d3ba35ded06b93e67d1, e9e2179c98f9446286dc5759ed8da7cb; no voters:
I20260811 08:14:02.460700 1257 raft_consensus.cc:2781] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:14:02.460747 1257 raft_consensus.cc:482] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:14:02.460762 1257 raft_consensus.cc:3037] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:14:02.461479 1257 raft_consensus.cc:504] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.461632 1257 leader_election.cc:288] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb [CANDIDATE]: Term 1 election: Requested vote from peers 77f76f68575d4c08a7bf3d1dec1f38a7 (127.20.158.130:41529), 77bf1e0e6a384d3ba35ded06b93e67d1 (127.20.158.131:37851)
I20260811 08:14:02.461862 1109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff08fe194ba9497a851d6c2bb09c487b" candidate_uuid: "e9e2179c98f9446286dc5759ed8da7cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1"
I20260811 08:14:02.461861 883 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff08fe194ba9497a851d6c2bb09c487b" candidate_uuid: "e9e2179c98f9446286dc5759ed8da7cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7"
I20260811 08:14:02.461941 883 raft_consensus.cc:3037] T ff08fe194ba9497a851d6c2bb09c487b P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:14:02.461941 1109 raft_consensus.cc:3037] T ff08fe194ba9497a851d6c2bb09c487b P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:14:02.462714 1109 raft_consensus.cc:2454] T ff08fe194ba9497a851d6c2bb09c487b P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9e2179c98f9446286dc5759ed8da7cb in term 1.
I20260811 08:14:02.462714 883 raft_consensus.cc:2454] T ff08fe194ba9497a851d6c2bb09c487b P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9e2179c98f9446286dc5759ed8da7cb in term 1.
I20260811 08:14:02.462903 569 leader_election.cc:302] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77f76f68575d4c08a7bf3d1dec1f38a7, e9e2179c98f9446286dc5759ed8da7cb; no voters:
I20260811 08:14:02.463016 1257 raft_consensus.cc:2781] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:14:02.463125 1257 raft_consensus.cc:686] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb [term 1 LEADER]: Becoming Leader. State: Replica: e9e2179c98f9446286dc5759ed8da7cb, State: Running, Role: LEADER
I20260811 08:14:02.463176 1257 consensus_queue.cc:237] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.463785 425 catalog_manager.cc:5495] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb reported cstate change: term changed from 0 to 1, leader changed from <none> to e9e2179c98f9446286dc5759ed8da7cb (127.20.158.129). New cstate: current_term: 1 leader_uuid: "e9e2179c98f9446286dc5759ed8da7cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } health_report { overall_health: UNKNOWN } } }
I20260811 08:14:02.503660 1236 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:02.501394 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53378 (local address 127.20.158.129:42335)
0811 08:14:02.501465 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:02.501467 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:02.501494 (+ 27us) server_negotiation.cc:407] Connection header received
0811 08:14:02.501518 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:02.501519 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:02.501547 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:02.501588 (+ 41us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:14:02.501760 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.502264 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.503039 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.503232 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.503283 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:02.503415 (+ 132us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:14:02.503441 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:14:02.503480 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:02.503535 (+ 55us) server_negotiation.cc:299] Negotiation successful
0811 08:14:02.503552 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 08:14:02.504583 883 raft_consensus.cc:1261] T ff08fe194ba9497a851d6c2bb09c487b P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 1 FOLLOWER]: Refusing update from remote peer e9e2179c98f9446286dc5759ed8da7cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:14:02.504583 1109 raft_consensus.cc:1261] T ff08fe194ba9497a851d6c2bb09c487b P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 1 FOLLOWER]: Refusing update from remote peer e9e2179c98f9446286dc5759ed8da7cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:14:02.504889 1371 consensus_queue.cc:1035] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:14:02.505013 1257 consensus_queue.cc:1035] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:14:02.508491 430 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41224:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:14:02.508580 430 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41224:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:14:02.509284 430 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77: Sending DeleteTablet for 3 replicas of tablet ff08fe194ba9497a851d6c2bb09c487b
I20260811 08:14:02.509555 641 tablet_service.cc:1514] Processing DeleteTablet for tablet ff08fe194ba9497a851d6c2bb09c487b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:14:02 UTC) from {username='oryx', principal='oryx/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:53364
I20260811 08:14:02.509569 1078 tablet_service.cc:1514] Processing DeleteTablet for tablet ff08fe194ba9497a851d6c2bb09c487b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:14:02 UTC) from {username='oryx', principal='oryx/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:33780
I20260811 08:14:02.509619 851 tablet_service.cc:1514] Processing DeleteTablet for tablet ff08fe194ba9497a851d6c2bb09c487b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:14:02 UTC) from {username='oryx', principal='oryx/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:52198
I20260811 08:14:02.509658 1283 tablet_replica.cc:330] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb: stopping tablet replica
I20260811 08:14:02.509708 1286 tablet_replica.cc:330] T ff08fe194ba9497a851d6c2bb09c487b P 77f76f68575d4c08a7bf3d1dec1f38a7: stopping tablet replica
I20260811 08:14:02.509728 1283 raft_consensus.cc:2229] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:14:02.509763 1286 raft_consensus.cc:2229] T ff08fe194ba9497a851d6c2bb09c487b P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:14:02.509786 1283 raft_consensus.cc:2258] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:14:02.509816 1286 raft_consensus.cc:2258] T ff08fe194ba9497a851d6c2bb09c487b P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:14:02.509855 1288 tablet_replica.cc:330] T ff08fe194ba9497a851d6c2bb09c487b P 77bf1e0e6a384d3ba35ded06b93e67d1: stopping tablet replica
I20260811 08:14:02.509924 1288 raft_consensus.cc:2229] T ff08fe194ba9497a851d6c2bb09c487b P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:14:02.509975 1288 raft_consensus.cc:2258] T ff08fe194ba9497a851d6c2bb09c487b P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:14:02.510118 1286 ts_tablet_manager.cc:1905] T ff08fe194ba9497a851d6c2bb09c487b P 77f76f68575d4c08a7bf3d1dec1f38a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:14:02.510252 1288 ts_tablet_manager.cc:1905] T ff08fe194ba9497a851d6c2bb09c487b P 77bf1e0e6a384d3ba35ded06b93e67d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:14:02.510382 430 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41224:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260811 08:14:02.510530 1283 ts_tablet_manager.cc:1905] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 08:14:02.510546 430 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:14:02.511938 1286 ts_tablet_manager.cc:1918] T ff08fe194ba9497a851d6c2bb09c487b P 77f76f68575d4c08a7bf3d1dec1f38a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:14:02.511953 1288 ts_tablet_manager.cc:1918] T ff08fe194ba9497a851d6c2bb09c487b P 77bf1e0e6a384d3ba35ded06b93e67d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:14:02.512009 1286 log.cc:1196] T ff08fe194ba9497a851d6c2bb09c487b P 77f76f68575d4c08a7bf3d1dec1f38a7: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-1/wal/wals/ff08fe194ba9497a851d6c2bb09c487b
I20260811 08:14:02.512027 1288 log.cc:1196] T ff08fe194ba9497a851d6c2bb09c487b P 77bf1e0e6a384d3ba35ded06b93e67d1: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-2/wal/wals/ff08fe194ba9497a851d6c2bb09c487b
I20260811 08:14:02.512135 1283 ts_tablet_manager.cc:1918] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:14:02.512198 1283 log.cc:1196] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-0/wal/wals/ff08fe194ba9497a851d6c2bb09c487b
I20260811 08:14:02.512259 1286 ts_tablet_manager.cc:1939] T ff08fe194ba9497a851d6c2bb09c487b P 77f76f68575d4c08a7bf3d1dec1f38a7: Deleting consensus metadata
I20260811 08:14:02.512306 1288 ts_tablet_manager.cc:1939] T ff08fe194ba9497a851d6c2bb09c487b P 77bf1e0e6a384d3ba35ded06b93e67d1: Deleting consensus metadata
I20260811 08:14:02.512420 1283 ts_tablet_manager.cc:1939] T ff08fe194ba9497a851d6c2bb09c487b P e9e2179c98f9446286dc5759ed8da7cb: Deleting consensus metadata
I20260811 08:14:02.512596 406 catalog_manager.cc:4841] TS 77f76f68575d4c08a7bf3d1dec1f38a7 (127.20.158.130:41529): tablet ff08fe194ba9497a851d6c2bb09c487b (table test-table [id=ddee65228a774d56bee9d25acdf43050]) successfully deleted
I20260811 08:14:02.512667 408 catalog_manager.cc:4841] TS 77bf1e0e6a384d3ba35ded06b93e67d1 (127.20.158.131:37851): tablet ff08fe194ba9497a851d6c2bb09c487b (table test-table [id=ddee65228a774d56bee9d25acdf43050]) successfully deleted
I20260811 08:14:02.512992 407 catalog_manager.cc:4841] TS e9e2179c98f9446286dc5759ed8da7cb (127.20.158.129:42335): tablet ff08fe194ba9497a851d6c2bb09c487b (table test-table [id=ddee65228a774d56bee9d25acdf43050]) successfully deleted
I20260811 08:14:02.513604 851 tablet_service.cc:1467] Processing CreateTablet for tablet cec4fabac0ef4fd1a5ef6535db3fc0e6 (DEFAULT_TABLE table=test-table [id=b66abf84538649d9b82e3f847811adef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:14:02.513656 1078 tablet_service.cc:1467] Processing CreateTablet for tablet cec4fabac0ef4fd1a5ef6535db3fc0e6 (DEFAULT_TABLE table=test-table [id=b66abf84538649d9b82e3f847811adef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:14:02.513732 851 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cec4fabac0ef4fd1a5ef6535db3fc0e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:14:02.513742 1078 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cec4fabac0ef4fd1a5ef6535db3fc0e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:14:02.514894 1245 tablet_bootstrap.cc:492] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77bf1e0e6a384d3ba35ded06b93e67d1: Bootstrap starting.
I20260811 08:14:02.514902 641 tablet_service.cc:1467] Processing CreateTablet for tablet cec4fabac0ef4fd1a5ef6535db3fc0e6 (DEFAULT_TABLE table=test-table [id=b66abf84538649d9b82e3f847811adef]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:14:02.515000 641 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cec4fabac0ef4fd1a5ef6535db3fc0e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:14:02.515290 1245 tablet_bootstrap.cc:654] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77bf1e0e6a384d3ba35ded06b93e67d1: Neither blocks nor log segments found. Creating new log.
I20260811 08:14:02.515534 1246 tablet_bootstrap.cc:492] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7: Bootstrap starting.
I20260811 08:14:02.515870 1246 tablet_bootstrap.cc:654] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7: Neither blocks nor log segments found. Creating new log.
I20260811 08:14:02.515889 1245 tablet_bootstrap.cc:492] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77bf1e0e6a384d3ba35ded06b93e67d1: No bootstrap required, opened a new log
I20260811 08:14:02.515929 1245 ts_tablet_manager.cc:1397] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77bf1e0e6a384d3ba35ded06b93e67d1: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:14:02.516052 1245 raft_consensus.cc:348] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.516151 1245 raft_consensus.cc:374] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:14:02.516175 1245 raft_consensus.cc:729] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77bf1e0e6a384d3ba35ded06b93e67d1, State: Initialized, Role: FOLLOWER
I20260811 08:14:02.516175 1243 tablet_bootstrap.cc:492] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P e9e2179c98f9446286dc5759ed8da7cb: Bootstrap starting.
I20260811 08:14:02.516227 1245 consensus_queue.cc:260] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77bf1e0e6a384d3ba35ded06b93e67d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.516327 1245 ts_tablet_manager.cc:1428] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77bf1e0e6a384d3ba35ded06b93e67d1: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 08:14:02.516472 1243 tablet_bootstrap.cc:654] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P e9e2179c98f9446286dc5759ed8da7cb: Neither blocks nor log segments found. Creating new log.
I20260811 08:14:02.516564 1246 tablet_bootstrap.cc:492] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7: No bootstrap required, opened a new log
I20260811 08:14:02.516613 1246 ts_tablet_manager.cc:1397] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 08:14:02.516750 1246 raft_consensus.cc:348] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.516837 1246 raft_consensus.cc:374] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:14:02.516870 1246 raft_consensus.cc:729] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77f76f68575d4c08a7bf3d1dec1f38a7, State: Initialized, Role: FOLLOWER
I20260811 08:14:02.516911 1246 consensus_queue.cc:260] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.516960 1317 raft_consensus.cc:482] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:14:02.517000 1246 ts_tablet_manager.cc:1428] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260811 08:14:02.517025 1243 tablet_bootstrap.cc:492] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P e9e2179c98f9446286dc5759ed8da7cb: No bootstrap required, opened a new log
I20260811 08:14:02.517077 1243 ts_tablet_manager.cc:1397] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P e9e2179c98f9446286dc5759ed8da7cb: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260811 08:14:02.517005 1317 raft_consensus.cc:504] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.517182 1243 raft_consensus.cc:348] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.517254 1243 raft_consensus.cc:374] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:14:02.517251 1317 leader_election.cc:288] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9e2179c98f9446286dc5759ed8da7cb (127.20.158.129:42335), 77bf1e0e6a384d3ba35ded06b93e67d1 (127.20.158.131:37851)
I20260811 08:14:02.517283 1243 raft_consensus.cc:729] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9e2179c98f9446286dc5759ed8da7cb, State: Initialized, Role: FOLLOWER
I20260811 08:14:02.517324 1243 consensus_queue.cc:260] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P e9e2179c98f9446286dc5759ed8da7cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.517409 670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cec4fabac0ef4fd1a5ef6535db3fc0e6" candidate_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9e2179c98f9446286dc5759ed8da7cb" is_pre_election: true
I20260811 08:14:02.517491 670 raft_consensus.cc:2454] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77f76f68575d4c08a7bf3d1dec1f38a7 in term 0.
I20260811 08:14:02.517418 1243 ts_tablet_manager.cc:1428] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P e9e2179c98f9446286dc5759ed8da7cb: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260811 08:14:02.517690 783 leader_election.cc:302] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77f76f68575d4c08a7bf3d1dec1f38a7, e9e2179c98f9446286dc5759ed8da7cb; no voters:
I20260811 08:14:02.517712 1109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cec4fabac0ef4fd1a5ef6535db3fc0e6" candidate_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" is_pre_election: true
I20260811 08:14:02.517779 1109 raft_consensus.cc:2454] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 77f76f68575d4c08a7bf3d1dec1f38a7 in term 0.
I20260811 08:14:02.517964 1317 raft_consensus.cc:2781] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:14:02.517999 1317 raft_consensus.cc:482] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:14:02.518023 1317 raft_consensus.cc:3037] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:14:02.518667 1317 raft_consensus.cc:504] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.518812 1317 leader_election.cc:288] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7 [CANDIDATE]: Term 1 election: Requested vote from peers e9e2179c98f9446286dc5759ed8da7cb (127.20.158.129:42335), 77bf1e0e6a384d3ba35ded06b93e67d1 (127.20.158.131:37851)
I20260811 08:14:02.518951 670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cec4fabac0ef4fd1a5ef6535db3fc0e6" candidate_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9e2179c98f9446286dc5759ed8da7cb"
I20260811 08:14:02.519057 670 raft_consensus.cc:3037] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P e9e2179c98f9446286dc5759ed8da7cb [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:14:02.519611 670 raft_consensus.cc:2454] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P e9e2179c98f9446286dc5759ed8da7cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77f76f68575d4c08a7bf3d1dec1f38a7 in term 1.
I20260811 08:14:02.519793 783 leader_election.cc:302] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77f76f68575d4c08a7bf3d1dec1f38a7, e9e2179c98f9446286dc5759ed8da7cb; no voters:
I20260811 08:14:02.519838 1109 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cec4fabac0ef4fd1a5ef6535db3fc0e6" candidate_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1"
I20260811 08:14:02.519886 1317 raft_consensus.cc:2781] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:14:02.519901 1109 raft_consensus.cc:3037] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:14:02.519925 1317 raft_consensus.cc:686] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 1 LEADER]: Becoming Leader. State: Replica: 77f76f68575d4c08a7bf3d1dec1f38a7, State: Running, Role: LEADER
I20260811 08:14:02.519972 1317 consensus_queue.cc:237] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } }
I20260811 08:14:02.520430 430 catalog_manager.cc:5495] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 77f76f68575d4c08a7bf3d1dec1f38a7 (127.20.158.130). New cstate: current_term: 1 leader_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77f76f68575d4c08a7bf3d1dec1f38a7" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 41529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 } health_report { overall_health: UNKNOWN } } }
I20260811 08:14:02.520560 1109 raft_consensus.cc:2454] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 77f76f68575d4c08a7bf3d1dec1f38a7 in term 1.
I20260811 08:14:02.527900 1237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:02.525851 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52222 (local address 127.20.158.130:41529)
0811 08:14:02.525913 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:02.525915 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:02.525926 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:14:02.525949 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:02.525950 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:02.525959 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:02.526008 (+ 49us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:14:02.526093 (+ 85us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.526546 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.527237 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.527411 (+ 174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.527462 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:02.527676 (+ 214us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:14:02.527702 (+ 26us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:14:02.527740 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:02.527786 (+ 46us) server_negotiation.cc:299] Negotiation successful
0811 08:14:02.527806 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 08:14:02.532083 1237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:02.529961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:41913 (local address 127.20.158.130:41529)
0811 08:14:02.529997 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:02.529999 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:02.530017 (+ 18us) server_negotiation.cc:407] Connection header received
0811 08:14:02.530075 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:02.530076 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:02.530084 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:02.530134 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:14:02.530223 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.530718 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.531425 (+ 707us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.531608 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.531689 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:02.531836 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:14:02.531868 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:14:02.531933 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:02.531991 (+ 58us) server_negotiation.cc:299] Negotiation successful
0811 08:14:02.532012 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":19}
I20260811 08:14:02.532160 1344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:02.529887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:41529 (local address 127.20.158.130:41913)
0811 08:14:02.529949 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:02.529959 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:02.530031 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:02.530139 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:02.530140 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:02.530141 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0811 08:14:02.530177 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:02.530178 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.530815 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.530816 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:02.531339 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:02.531340 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:02.531687 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:02.531688 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:02.531738 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:02.531744 (+ 6us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0811 08:14:02.531933 (+ 189us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0811 08:14:02.531935 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:14:02.531988 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 08:14:02.532033 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 08:14:02.533965 1109 raft_consensus.cc:1261] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 1 FOLLOWER]: Refusing update from remote peer 77f76f68575d4c08a7bf3d1dec1f38a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:14:02.534039 670 raft_consensus.cc:1261] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P e9e2179c98f9446286dc5759ed8da7cb [term 1 FOLLOWER]: Refusing update from remote peer 77f76f68575d4c08a7bf3d1dec1f38a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:14:02.534186 1330 consensus_queue.cc:1035] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77bf1e0e6a384d3ba35ded06b93e67d1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 37851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:14:02.534308 1256 consensus_queue.cc:1035] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9e2179c98f9446286dc5759ed8da7cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:14:02.544835 425 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41224:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:14:02.544924 425 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41224:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:14:02.545639 425 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6851153a462b4dacad9142bdd64c7c77: Sending DeleteTablet for 3 replicas of tablet cec4fabac0ef4fd1a5ef6535db3fc0e6
I20260811 08:14:02.545907 1078 tablet_service.cc:1514] Processing DeleteTablet for tablet cec4fabac0ef4fd1a5ef6535db3fc0e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:14:02 UTC) from {username='oryx', principal='oryx/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:33780
I20260811 08:14:02.545917 641 tablet_service.cc:1514] Processing DeleteTablet for tablet cec4fabac0ef4fd1a5ef6535db3fc0e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:14:02 UTC) from {username='oryx', principal='oryx/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:53364
I20260811 08:14:02.546038 1283 tablet_replica.cc:330] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P e9e2179c98f9446286dc5759ed8da7cb: stopping tablet replica
I20260811 08:14:02.546110 1283 raft_consensus.cc:2229] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P e9e2179c98f9446286dc5759ed8da7cb [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:14:02.546095 851 tablet_service.cc:1514] Processing DeleteTablet for tablet cec4fabac0ef4fd1a5ef6535db3fc0e6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:14:02 UTC) from {username='oryx', principal='oryx/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:52198
I20260811 08:14:02.546129 1288 tablet_replica.cc:330] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77bf1e0e6a384d3ba35ded06b93e67d1: stopping tablet replica
I20260811 08:14:02.546152 1283 raft_consensus.cc:2258] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P e9e2179c98f9446286dc5759ed8da7cb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:14:02.546173 1286 tablet_replica.cc:330] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7: stopping tablet replica
I20260811 08:14:02.546195 1288 raft_consensus.cc:2229] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:14:02.546219 1286 raft_consensus.cc:2229] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:14:02.546233 1288 raft_consensus.cc:2258] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77bf1e0e6a384d3ba35ded06b93e67d1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:14:02.546312 1286 raft_consensus.cc:2258] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:14:02.546452 1283 ts_tablet_manager.cc:1905] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P e9e2179c98f9446286dc5759ed8da7cb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:14:02.546742 1288 ts_tablet_manager.cc:1905] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77bf1e0e6a384d3ba35ded06b93e67d1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:14:02.546748 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 543
I20260811 08:14:02.556753 1286 ts_tablet_manager.cc:1905] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:14:02.559015 1286 ts_tablet_manager.cc:1918] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:14:02.559137 1286 log.cc:1196] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-1/wal/wals/cec4fabac0ef4fd1a5ef6535db3fc0e6
I20260811 08:14:02.559490 1286 ts_tablet_manager.cc:1939] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77f76f68575d4c08a7bf3d1dec1f38a7: Deleting consensus metadata
I20260811 08:14:02.560101 406 catalog_manager.cc:4841] TS 77f76f68575d4c08a7bf3d1dec1f38a7 (127.20.158.130:41529): tablet cec4fabac0ef4fd1a5ef6535db3fc0e6 (table test-table [id=b66abf84538649d9b82e3f847811adef]) successfully deleted
I20260811 08:14:02.560269 1288 ts_tablet_manager.cc:1918] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77bf1e0e6a384d3ba35ded06b93e67d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260811 08:14:02.560349 1288 log.cc:1196] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77bf1e0e6a384d3ba35ded06b93e67d1: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786436003833085-21114-0/minicluster-data/ts-2/wal/wals/cec4fabac0ef4fd1a5ef6535db3fc0e6
I20260811 08:14:02.560566 1288 ts_tablet_manager.cc:1939] T cec4fabac0ef4fd1a5ef6535db3fc0e6 P 77bf1e0e6a384d3ba35ded06b93e67d1: Deleting consensus metadata
I20260811 08:14:02.561030 408 catalog_manager.cc:4841] TS 77bf1e0e6a384d3ba35ded06b93e67d1 (127.20.158.131:37851): tablet cec4fabac0ef4fd1a5ef6535db3fc0e6 (table test-table [id=b66abf84538649d9b82e3f847811adef]) successfully deleted
W20260811 08:14:02.568264 407 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.158.129:42335 (error 108)
I20260811 08:14:02.568605 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 759
I20260811 08:14:02.570976 1392 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:02.568668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:42335 (local address 127.0.0.1:53384)
0811 08:14:02.570871 (+ 2203us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:02.570926 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.129:42335: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":2181,"thread_start_us":45,"threads_started":1}
W20260811 08:14:02.571257 407 catalog_manager.cc:4584] TS e9e2179c98f9446286dc5759ed8da7cb (127.20.158.129:42335): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet cec4fabac0ef4fd1a5ef6535db3fc0e6: Network error: Client connection negotiation failed: client connection to 127.20.158.129:42335: connect: Connection refused (error 111)
I20260811 08:14:02.580387 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 966
I20260811 08:14:02.590910 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 378
2026-08-11T08:14:02Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2944 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:14:02 dist-test-slave-gkw7 krb5kdc[1397](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:14:02 dist-test-slave-gkw7 krb5kdc[1397](info): set up 2 sockets
Aug 11 08:14:02 dist-test-slave-gkw7 krb5kdc[1397](info): commencing operation
krb5kdc: starting...
W20260811 08:14:03.864820 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.247s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:14:03 dist-test-slave-gkw7 krb5kdc[1397](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436043, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:14:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:14:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:14:03.996786 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:34325
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:45587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:34325
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:14:04.083168 1416 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:14:04.083386 1416 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:14:04.083410 1416 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:14:04.084501 1416 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:14:04.084538 1416 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:14:04.084553 1416 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:14:04.084565 1416 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:14:04.084576 1416 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:14:04.086014 1416 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:45587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:34325
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:34325
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1416
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:14:04.086213 1416 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:14:04.086390 1416 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:14:04.091565 1423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:04.091572 1421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:04.091713 1416 server_base.cc:1034] running on GCE node
W20260811 08:14:04.091825 1427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:04.092074 1416 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:14:04.092406 1416 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:14:04.093598 1416 hybrid_clock.cc:648] HybridClock initialized: now 1786436044093564 us; error 57 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-11T08:14:04Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1509 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:14:04 dist-test-slave-gkw7 krb5kdc[1437](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:14:04 dist-test-slave-gkw7 krb5kdc[1437](info): set up 2 sockets
Aug 11 08:14:04 dist-test-slave-gkw7 krb5kdc[1437](info): commencing operation
krb5kdc: starting...
W20260811 08:14:05.410167 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.283s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:14:05 dist-test-slave-gkw7 krb5kdc[1437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:14:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:14:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:14:05.542869 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:36965
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:45409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:36965
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:14:05.628048 1457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:14:05.628280 1457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:14:05.628304 1457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:14:05.629424 1457 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:14:05.629475 1457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:14:05.629489 1457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:14:05.629501 1457 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:14:05.629513 1457 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:14:05.631155 1457 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:45409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:36965
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:36965
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1457
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:14:05.631384 1457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:14:05.631560 1457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:14:05.636761 1465 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:05.636765 1467 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:05.636785 1469 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:05.637172 1457 server_base.cc:1034] running on GCE node
I20260811 08:14:05.637439 1457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:14:05.637769 1457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:14:05.638923 1457 hybrid_clock.cc:648] HybridClock initialized: now 1786436045638899 us; error 42 us; skew 500 ppm
Aug 11 08:14:05 dist-test-slave-gkw7 krb5kdc[1437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436045, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:14:05.647545 1457 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:14:05.648105 1457 webserver.cc:460] Webserver started at http://127.20.158.190:37719/ using document root <none> and password file <none>
I20260811 08:14:05.648366 1457 fs_manager.cc:359] Metadata directory not provided
I20260811 08:14:05.648442 1457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:14:05.648604 1457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:14:05.649812 1457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "69d564c091454d2585d5e6815b23c7db"
format_stamp: "Formatted at 2026-08-11 08:14:05 on dist-test-slave-gkw7"
server_key: "be5b4aa3e2f38f01110f0e47ab243ddf"
server_key_iv: "850c61843e3d3acd78749b0cef339b0d"
server_key_version: "encryptionkey@0"
I20260811 08:14:05.650269 1457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "69d564c091454d2585d5e6815b23c7db"
format_stamp: "Formatted at 2026-08-11 08:14:05 on dist-test-slave-gkw7"
server_key: "be5b4aa3e2f38f01110f0e47ab243ddf"
server_key_iv: "850c61843e3d3acd78749b0cef339b0d"
server_key_version: "encryptionkey@0"
I20260811 08:14:05.651728 1457 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:14:05.652530 1481 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:05.652776 1457 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:14:05.652897 1457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "69d564c091454d2585d5e6815b23c7db"
format_stamp: "Formatted at 2026-08-11 08:14:05 on dist-test-slave-gkw7"
server_key: "be5b4aa3e2f38f01110f0e47ab243ddf"
server_key_iv: "850c61843e3d3acd78749b0cef339b0d"
server_key_version: "encryptionkey@0"
I20260811 08:14:05.652979 1457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:14:05.670030 1457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:14:05.672602 1457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:14:05.672788 1457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:14:05.677224 1457 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:36965
I20260811 08:14:05.677367 1552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:36965 every 8 connection(s)
I20260811 08:14:05.677706 1457 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:14:05.678709 1553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:14:05.679080 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 1457
I20260811 08:14:05.679234 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:14:05.679443 21114 external_mini_cluster.cc:1428] Setting key 94716089c8d9a52b3b25246d810e17f5
I20260811 08:14:05.682058 1553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db: Bootstrap starting.
I20260811 08:14:05.682792 1553 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db: Neither blocks nor log segments found. Creating new log.
I20260811 08:14:05.683086 1553 log.cc:824] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db: Log is configured to *not* fsync() on all Append() calls
I20260811 08:14:05.683880 1553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db: No bootstrap required, opened a new log
I20260811 08:14:05.686094 1553 raft_consensus.cc:348] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69d564c091454d2585d5e6815b23c7db" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36965 } }
I20260811 08:14:05.686256 1553 raft_consensus.cc:374] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:14:05.686304 1553 raft_consensus.cc:729] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69d564c091454d2585d5e6815b23c7db, State: Initialized, Role: FOLLOWER
I20260811 08:14:05.686468 1553 consensus_queue.cc:260] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69d564c091454d2585d5e6815b23c7db" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36965 } }
I20260811 08:14:05.686556 1553 raft_consensus.cc:388] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:14:05.686612 1553 raft_consensus.cc:482] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:14:05.686666 1553 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [term 0 FOLLOWER]: Advancing to term 1
Aug 11 08:14:05 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436045, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:14:05.687361 1553 raft_consensus.cc:504] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69d564c091454d2585d5e6815b23c7db" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36965 } }
I20260811 08:14:05.687495 1553 leader_election.cc:302] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 69d564c091454d2585d5e6815b23c7db; no voters:
I20260811 08:14:05.687681 1553 leader_election.cc:288] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:14:05.687896 1560 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:14:05.687979 1553 sys_catalog.cc:564] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:14:05.688088 1560 raft_consensus.cc:686] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [term 1 LEADER]: Becoming Leader. State: Replica: 69d564c091454d2585d5e6815b23c7db, State: Running, Role: LEADER
I20260811 08:14:05.688225 1560 consensus_queue.cc:237] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69d564c091454d2585d5e6815b23c7db" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36965 } }
I20260811 08:14:05.688786 1559 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "69d564c091454d2585d5e6815b23c7db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69d564c091454d2585d5e6815b23c7db" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36965 } } }
I20260811 08:14:05.688889 1559 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [sys.catalog]: This master's current role is: LEADER
I20260811 08:14:05.689483 1576 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:14:05.689659 1560 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [sys.catalog]: SysCatalogTable state changed. Reason: New leader 69d564c091454d2585d5e6815b23c7db. Latest consensus state: current_term: 1 leader_uuid: "69d564c091454d2585d5e6815b23c7db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69d564c091454d2585d5e6815b23c7db" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36965 } } }
I20260811 08:14:05.689837 1560 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [sys.catalog]: This master's current role is: LEADER
I20260811 08:14:05.690176 1576 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:14:05.691601 1556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:05.680012 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42014 (local address 127.20.158.190:36965)
0811 08:14:05.680213 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:05.680224 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:05.680262 (+ 38us) server_negotiation.cc:407] Connection header received
0811 08:14:05.680789 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:05.680798 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:05.680874 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:05.681025 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:05.681646 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:05.683036 (+ 1390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:05.684021 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:05.684637 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:05.684757 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:05.687337 (+ 2580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:05.687342 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:05.687342 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:14:05.687357 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:05.689811 (+ 2454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:05.690319 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:05.690323 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:05.690323 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:05.690431 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:05.690638 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:05.690639 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:05.690639 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:05.690940 (+ 301us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:05.691108 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:05.691256 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 08:14:05.691404 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":146,"thread_start_us":85,"threads_started":1}
I20260811 08:14:05.692153 1576 catalog_manager.cc:1347] Generated new cluster ID: ca79a08a5662484f80dfcffa0eede277
I20260811 08:14:05.692205 1576 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:14:05.705755 1576 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:14:05.706507 1576 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:14:05.717625 1576 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db: Generated new TSK 0
I20260811 08:14:05.717866 1576 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.158.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
I20260811 08:14:05.749228 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:0
--local_ip_for_outbound_sockets=127.20.158.129
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:36965
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:45409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:14:05.836225 1592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:14:05.836439 1592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:14:05.836464 1592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:14:05.837612 1592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:14:05.837649 1592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:14:05.837675 1592 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:14:05.839088 1592 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:45409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:36965
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1592
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:14:05.839303 1592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:14:05.839496 1592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:14:05.844934 1599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:05.844923 1592 server_base.cc:1034] running on GCE node
W20260811 08:14:05.844893 1600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:05.844893 1604 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:05.845428 1592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:14:05.845785 1592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:14:05.846976 1592 hybrid_clock.cc:648] HybridClock initialized: now 1786436045846959 us; error 47 us; skew 500 ppm
Aug 11 08:14:05 dist-test-slave-gkw7 krb5kdc[1437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436045, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:14:05.849704 1592 init.cc:377] Logged in from keytab as kudu/127.20.158.129@KRBTEST.COM (short username kudu)
I20260811 08:14:05.850176 1592 webserver.cc:460] Webserver started at http://127.20.158.129:33319/ using document root <none> and password file <none>
I20260811 08:14:05.850455 1592 fs_manager.cc:359] Metadata directory not provided
I20260811 08:14:05.850533 1592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:14:05.850695 1592 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:14:05.851771 1592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/data/instance:
uuid: "cc847c20d65a4028a76ee1adb7a9c083"
format_stamp: "Formatted at 2026-08-11 08:14:05 on dist-test-slave-gkw7"
server_key: "e05dfcaf75f23f5fc6bd51091c5fe7b5"
server_key_iv: "bad879903908130d50c4f7f02e3a735e"
server_key_version: "encryptionkey@0"
I20260811 08:14:05.852159 1592 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance:
uuid: "cc847c20d65a4028a76ee1adb7a9c083"
format_stamp: "Formatted at 2026-08-11 08:14:05 on dist-test-slave-gkw7"
server_key: "e05dfcaf75f23f5fc6bd51091c5fe7b5"
server_key_iv: "bad879903908130d50c4f7f02e3a735e"
server_key_version: "encryptionkey@0"
I20260811 08:14:05.853518 1592 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:14:05.854363 1617 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:05.854547 1592 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:14:05.854661 1592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "cc847c20d65a4028a76ee1adb7a9c083"
format_stamp: "Formatted at 2026-08-11 08:14:05 on dist-test-slave-gkw7"
server_key: "e05dfcaf75f23f5fc6bd51091c5fe7b5"
server_key_iv: "bad879903908130d50c4f7f02e3a735e"
server_key_version: "encryptionkey@0"
I20260811 08:14:05.854744 1592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:14:05.879340 1592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:14:05.881691 1592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:14:05.881912 1592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:14:05.882197 1592 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:14:05.882567 1592 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:14:05.882628 1592 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:05.882674 1592 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:14:05.882702 1592 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:05.889236 1592 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:34407
I20260811 08:14:05.889287 1785 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:34407 every 8 connection(s)
I20260811 08:14:05.889690 1592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:14:05.895777 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 1592
I20260811 08:14:05.895938 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance
I20260811 08:14:05.896169 21114 external_mini_cluster.cc:1428] Setting key ca77d6855fd81575ec977b233675cd9f
Aug 11 08:14:05 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436045, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:14:05.900914 1556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:05.890611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:45641 (local address 127.20.158.190:36965)
0811 08:14:05.890683 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:05.890686 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:05.890958 (+ 272us) server_negotiation.cc:407] Connection header received
0811 08:14:05.891471 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:05.891473 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:05.891486 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:05.891549 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:05.892641 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:05.893209 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:05.894437 (+ 1228us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:05.894673 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:05.894748 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:05.897428 (+ 2680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:05.897430 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:05.897431 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:14:05.897440 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:05.899203 (+ 1763us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:05.899762 (+ 559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:05.899764 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:05.899764 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:05.899836 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:05.900148 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:05.900149 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:05.900150 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:05.900285 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:05.900374 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:05.900712 (+ 338us) server_negotiation.cc:299] Negotiation successful
0811 08:14:05.900814 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 08:14:05.901136 1790 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:05.890599 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.129:45641)
0811 08:14:05.890803 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:05.890847 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:05.891363 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:05.891642 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:05.891647 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:05.892310 (+ 663us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:05.892528 (+ 218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:05.892533 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:05.893307 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:05.893308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:05.894279 (+ 971us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:05.894281 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:05.894775 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:05.894776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:05.894909 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:05.895546 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:05.895556 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:05.897305 (+ 1749us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:14:05.899346 (+ 2041us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:14:05.899357 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:14:05.899361 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:14:05.899660 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:14:05.899919 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:14:05.899920 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:14:05.899920 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:14:05.900060 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:14:05.900363 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:14:05.900373 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:14:05.900543 (+ 170us) client_negotiation.cc:769] Sending connection context
0811 08:14:05.900673 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 08:14:05.900862 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":107,"threads_started":1}
I20260811 08:14:05.901752 1786 heartbeater.cc:347] Connected to a master server at 127.20.158.190:36965
I20260811 08:14:05.901901 1786 heartbeater.cc:464] Registering TS with master...
I20260811 08:14:05.902156 1786 heartbeater.cc:511] Master 127.20.158.190:36965 requested a full tablet report, sending...
I20260811 08:14:05.902855 1505 ts_manager.cc:194] Registered new tserver with Master: cc847c20d65a4028a76ee1adb7a9c083 (127.20.158.129:34407)
I20260811 08:14:05.903543 1505 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.129@KRBTEST.COM'} at 127.20.158.129:45641
WARNING: no policy specified for kudu/127.20.158.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
I20260811 08:14:05.928886 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:0
--local_ip_for_outbound_sockets=127.20.158.130
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:36965
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:45409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:14:06.014684 1794 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:14:06.014904 1794 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:14:06.014927 1794 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:14:06.016050 1794 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:14:06.016089 1794 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:14:06.016122 1794 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:14:06.017508 1794 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:45409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:36965
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1794
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:14:06.017735 1794 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:14:06.017915 1794 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:14:06.023295 1801 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:06.023331 1800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:06.023350 1794 server_base.cc:1034] running on GCE node
W20260811 08:14:06.023313 1808 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:06.023751 1794 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:14:06.023988 1794 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:14:06.025235 1794 hybrid_clock.cc:648] HybridClock initialized: now 1786436046025221 us; error 29 us; skew 500 ppm
Aug 11 08:14:06 dist-test-slave-gkw7 krb5kdc[1437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436046, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:14:06.028144 1794 init.cc:377] Logged in from keytab as kudu/127.20.158.130@KRBTEST.COM (short username kudu)
I20260811 08:14:06.028677 1794 webserver.cc:460] Webserver started at http://127.20.158.130:39595/ using document root <none> and password file <none>
I20260811 08:14:06.028915 1794 fs_manager.cc:359] Metadata directory not provided
I20260811 08:14:06.028961 1794 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:14:06.029146 1794 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:14:06.030285 1794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/data/instance:
uuid: "5c8b641a886346409fe281b446c973c8"
format_stamp: "Formatted at 2026-08-11 08:14:06 on dist-test-slave-gkw7"
server_key: "55addc795df37d1fdda05e3078dc8ed9"
server_key_iv: "0b7c49b9fd7ffbf8e87ac73e03756b00"
server_key_version: "encryptionkey@0"
I20260811 08:14:06.030654 1794 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance:
uuid: "5c8b641a886346409fe281b446c973c8"
format_stamp: "Formatted at 2026-08-11 08:14:06 on dist-test-slave-gkw7"
server_key: "55addc795df37d1fdda05e3078dc8ed9"
server_key_iv: "0b7c49b9fd7ffbf8e87ac73e03756b00"
server_key_version: "encryptionkey@0"
I20260811 08:14:06.032025 1794 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:14:06.032847 1821 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:06.033068 1794 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:14:06.033221 1794 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "5c8b641a886346409fe281b446c973c8"
format_stamp: "Formatted at 2026-08-11 08:14:06 on dist-test-slave-gkw7"
server_key: "55addc795df37d1fdda05e3078dc8ed9"
server_key_iv: "0b7c49b9fd7ffbf8e87ac73e03756b00"
server_key_version: "encryptionkey@0"
I20260811 08:14:06.033301 1794 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:14:06.048964 1794 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:14:06.051565 1794 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:14:06.051749 1794 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:14:06.052011 1794 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:14:06.052368 1794 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:14:06.052428 1794 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:06.052464 1794 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:14:06.052492 1794 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:06.059028 1794 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:43503
I20260811 08:14:06.059082 1999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:43503 every 8 connection(s)
I20260811 08:14:06.059424 1794 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
I20260811 08:14:06.065176 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 1794
I20260811 08:14:06.065315 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance
I20260811 08:14:06.065608 21114 external_mini_cluster.cc:1428] Setting key 7f87f65377d95735f78a741a52f6a4f3
Aug 11 08:14:06 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436046, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:14:06.069322 1556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:06.060130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:57179 (local address 127.20.158.190:36965)
0811 08:14:06.060178 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:06.060179 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:06.060406 (+ 227us) server_negotiation.cc:407] Connection header received
0811 08:14:06.060915 (+ 509us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:06.060916 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:06.060927 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:06.060982 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:06.061957 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.062452 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.063501 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.063696 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.063756 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:06.066231 (+ 2475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:06.066232 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:06.066232 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:14:06.066239 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:06.067739 (+ 1500us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:06.068249 (+ 510us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:06.068250 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:06.068251 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:06.068320 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:06.068629 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:06.068630 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:06.068630 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:06.068779 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:06.068853 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:06.069103 (+ 250us) server_negotiation.cc:299] Negotiation successful
0811 08:14:06.069197 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:14:06.069347 2002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:06.060144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.130:57179)
0811 08:14:06.060299 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:06.060335 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:06.060797 (+ 462us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:06.061045 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:06.061048 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:06.061642 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:06.061865 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:06.061870 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.062549 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.062549 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:06.063409 (+ 860us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:06.063411 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.063777 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.063778 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:06.063886 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:06.064466 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:06.064474 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:06.066131 (+ 1657us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:14:06.067823 (+ 1692us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:14:06.067831 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:14:06.067833 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:14:06.068165 (+ 332us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:14:06.068406 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:14:06.068407 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:14:06.068408 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:14:06.068545 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:14:06.068850 (+ 305us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:14:06.068855 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:14:06.068973 (+ 118us) client_negotiation.cc:769] Sending connection context
0811 08:14:06.069057 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 08:14:06.069183 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":91,"threads_started":1}
I20260811 08:14:06.070079 2000 heartbeater.cc:347] Connected to a master server at 127.20.158.190:36965
I20260811 08:14:06.070190 2000 heartbeater.cc:464] Registering TS with master...
I20260811 08:14:06.070394 2000 heartbeater.cc:511] Master 127.20.158.190:36965 requested a full tablet report, sending...
I20260811 08:14:06.070763 1505 ts_manager.cc:194] Registered new tserver with Master: 5c8b641a886346409fe281b446c973c8 (127.20.158.130:43503)
I20260811 08:14:06.071151 1505 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.130@KRBTEST.COM'} at 127.20.158.130:57179
WARNING: no policy specified for kudu/127.20.158.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
I20260811 08:14:06.096643 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:0
--local_ip_for_outbound_sockets=127.20.158.131
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:36965
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:45409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:14:06.182428 2007 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:14:06.182683 2007 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:14:06.182722 2007 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:14:06.183909 2007 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:14:06.183981 2007 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:14:06.184026 2007 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:14:06.185523 2007 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:45409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:36965
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2007
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:14:06.185830 2007 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:14:06.186065 2007 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:14:06.191524 2020 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:06.191529 2025 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:06.191540 2022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:06.191548 2007 server_base.cc:1034] running on GCE node
I20260811 08:14:06.192220 2007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:14:06.192487 2007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:14:06.193609 2007 hybrid_clock.cc:648] HybridClock initialized: now 1786436046193592 us; error 32 us; skew 500 ppm
Aug 11 08:14:06 dist-test-slave-gkw7 krb5kdc[1437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436046, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:14:06.196149 2007 init.cc:377] Logged in from keytab as kudu/127.20.158.131@KRBTEST.COM (short username kudu)
I20260811 08:14:06.196668 2007 webserver.cc:460] Webserver started at http://127.20.158.131:33439/ using document root <none> and password file <none>
I20260811 08:14:06.196920 2007 fs_manager.cc:359] Metadata directory not provided
I20260811 08:14:06.196992 2007 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:14:06.197149 2007 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:14:06.198290 2007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/data/instance:
uuid: "90f6b21d245a4d81966f16448026d143"
format_stamp: "Formatted at 2026-08-11 08:14:06 on dist-test-slave-gkw7"
server_key: "cc26e968361ae50ac545b375bf173d6b"
server_key_iv: "d1bf7932fa45c3f5cc195602058f112f"
server_key_version: "encryptionkey@0"
I20260811 08:14:06.198662 2007 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance:
uuid: "90f6b21d245a4d81966f16448026d143"
format_stamp: "Formatted at 2026-08-11 08:14:06 on dist-test-slave-gkw7"
server_key: "cc26e968361ae50ac545b375bf173d6b"
server_key_iv: "d1bf7932fa45c3f5cc195602058f112f"
server_key_version: "encryptionkey@0"
I20260811 08:14:06.200038 2007 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:14:06.200829 2032 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:06.201061 2007 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:14:06.201172 2007 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "90f6b21d245a4d81966f16448026d143"
format_stamp: "Formatted at 2026-08-11 08:14:06 on dist-test-slave-gkw7"
server_key: "cc26e968361ae50ac545b375bf173d6b"
server_key_iv: "d1bf7932fa45c3f5cc195602058f112f"
server_key_version: "encryptionkey@0"
I20260811 08:14:06.201237 2007 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:14:06.218706 2007 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:14:06.220800 2007 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:14:06.220976 2007 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:14:06.221223 2007 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:14:06.221614 2007 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:14:06.221671 2007 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:06.221715 2007 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:14:06.221766 2007 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:06.228111 2007 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:36525
I20260811 08:14:06.228191 2212 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:36525 every 8 connection(s)
I20260811 08:14:06.228526 2007 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
I20260811 08:14:06.232673 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 2007
I20260811 08:14:06.232802 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance
I20260811 08:14:06.232990 21114 external_mini_cluster.cc:1428] Setting key e60cc3421c30cf20ef6f995f953d1741
Aug 11 08:14:06 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436046, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:14:06.239624 1556 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:06.229313 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:33233 (local address 127.20.158.190:36965)
0811 08:14:06.229386 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:06.229388 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:06.229594 (+ 206us) server_negotiation.cc:407] Connection header received
0811 08:14:06.230136 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:06.230138 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:06.230150 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:06.230206 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:06.231183 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.231704 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.232777 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.233073 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.233148 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:06.236888 (+ 3740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:06.236889 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:06.236889 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:14:06.236899 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:06.238291 (+ 1392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:06.238705 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:06.238706 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:06.238706 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:06.238767 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:06.239066 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:06.239066 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:06.239067 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:06.239171 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:06.239223 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:06.239490 (+ 267us) server_negotiation.cc:299] Negotiation successful
0811 08:14:06.239558 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 08:14:06.239902 2215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:06.229275 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.131:33233)
0811 08:14:06.229445 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:06.229488 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:06.230017 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:06.230283 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:06.230287 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:06.230866 (+ 579us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:06.231062 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:06.231067 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.231813 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.231814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:06.232679 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:06.232682 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.233156 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.233157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:06.233352 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:06.234006 (+ 654us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:06.234015 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:06.235431 (+ 1416us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:14:06.238372 (+ 2941us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:14:06.238379 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:14:06.238381 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:14:06.238632 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:14:06.238864 (+ 232us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:14:06.238866 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:14:06.238866 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:14:06.238994 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:14:06.239232 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:14:06.239238 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:14:06.239371 (+ 133us) client_negotiation.cc:769] Sending connection context
0811 08:14:06.239459 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 08:14:06.239595 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":96,"threads_started":1}
I20260811 08:14:06.240413 2213 heartbeater.cc:347] Connected to a master server at 127.20.158.190:36965
I20260811 08:14:06.240532 2213 heartbeater.cc:464] Registering TS with master...
I20260811 08:14:06.240751 2213 heartbeater.cc:511] Master 127.20.158.190:36965 requested a full tablet report, sending...
I20260811 08:14:06.241155 1505 ts_manager.cc:194] Registered new tserver with Master: 90f6b21d245a4d81966f16448026d143 (127.20.158.131:36525)
I20260811 08:14:06.241726 1505 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.131@KRBTEST.COM'} at 127.20.158.131:33233
I20260811 08:14:06.245036 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.20.158.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.158.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.158.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.129.keytab.
Entry for principal oryx/127.20.158.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.129.keytab.
WARNING: no policy specified for oryx/127.20.158.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.158.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.158.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.130.keytab.
Entry for principal oryx/127.20.158.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.130.keytab.
WARNING: no policy specified for oryx/127.20.158.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.20.158.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.20.158.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.131.keytab.
Entry for principal oryx/127.20.158.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.131.keytab.
I20260811 08:14:06.327679 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 1592
I20260811 08:14:06.345288 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 1794
I20260811 08:14:06.362468 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 2007
I20260811 08:14:06.376225 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 1457
I20260811 08:14:06.386854 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:36965
--webserver_interface=127.20.158.190
--webserver_port=37719
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:45409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:36965
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:14:06.473141 2225 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:14:06.473445 2225 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:14:06.473498 2225 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:14:06.474766 2225 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:14:06.474862 2225 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:14:06.474895 2225 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:14:06.474927 2225 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:14:06.474952 2225 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:14:06.476572 2225 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:45409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:36965
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:36965
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=37719
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2225
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:14:06.476881 2225 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:14:06.477149 2225 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:14:06.482558 2242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:06.482654 2225 server_base.cc:1034] running on GCE node
W20260811 08:14:06.482532 2234 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:06.482542 2232 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:06.483008 2225 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:14:06.483310 2225 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:14:06.484490 2225 hybrid_clock.cc:648] HybridClock initialized: now 1786436046484480 us; error 31 us; skew 500 ppm
Aug 11 08:14:06 dist-test-slave-gkw7 krb5kdc[1437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436046, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:14:06.487068 2225 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:14:06.487511 2225 webserver.cc:460] Webserver started at http://127.20.158.190:37719/ using document root <none> and password file <none>
I20260811 08:14:06.487756 2225 fs_manager.cc:359] Metadata directory not provided
I20260811 08:14:06.487843 2225 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:14:06.489257 2225 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:14:06.490036 2252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:06.490257 2225 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:14:06.490365 2225 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "69d564c091454d2585d5e6815b23c7db"
format_stamp: "Formatted at 2026-08-11 08:14:05 on dist-test-slave-gkw7"
server_key: "be5b4aa3e2f38f01110f0e47ab243ddf"
server_key_iv: "850c61843e3d3acd78749b0cef339b0d"
server_key_version: "encryptionkey@0"
I20260811 08:14:06.490749 2225 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:14:06.520826 2225 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:14:06.523277 2225 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:14:06.523519 2225 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:14:06.528764 2225 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:36965
I20260811 08:14:06.528801 2330 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:36965 every 8 connection(s)
I20260811 08:14:06.529254 2225 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:14:06.530903 2331 sys_catalog.cc:263] Verifying existing consensus state
I20260811 08:14:06.531567 2331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db: Bootstrap starting.
I20260811 08:14:06.532505 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 2225
I20260811 08:14:06.532853 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:34407
--local_ip_for_outbound_sockets=127.20.158.129
--tserver_master_addrs=127.20.158.190:36965
--webserver_port=33319
--webserver_interface=127.20.158.129
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:45409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.20.158.129
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:14:06.540894 2331 log.cc:824] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db: Log is configured to *not* fsync() on all Append() calls
I20260811 08:14:06.542737 2331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:14:06.543053 2331 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db: Bootstrap complete.
I20260811 08:14:06.545356 2331 raft_consensus.cc:348] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69d564c091454d2585d5e6815b23c7db" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36965 } }
I20260811 08:14:06.545658 2331 raft_consensus.cc:729] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69d564c091454d2585d5e6815b23c7db, State: Initialized, Role: FOLLOWER
I20260811 08:14:06.545855 2331 consensus_queue.cc:260] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69d564c091454d2585d5e6815b23c7db" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36965 } }
I20260811 08:14:06.545938 2331 raft_consensus.cc:388] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:14:06.546011 2331 raft_consensus.cc:482] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:14:06.546052 2331 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [term 1 FOLLOWER]: Advancing to term 2
I20260811 08:14:06.547235 2331 raft_consensus.cc:504] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69d564c091454d2585d5e6815b23c7db" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36965 } }
I20260811 08:14:06.547377 2331 leader_election.cc:302] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 69d564c091454d2585d5e6815b23c7db; no voters:
I20260811 08:14:06.547545 2331 leader_election.cc:288] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 08:14:06.547614 2335 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [term 2 FOLLOWER]: Leader election won for term 2
I20260811 08:14:06.547802 2335 raft_consensus.cc:686] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [term 2 LEADER]: Becoming Leader. State: Replica: 69d564c091454d2585d5e6815b23c7db, State: Running, Role: LEADER
I20260811 08:14:06.547842 2331 sys_catalog.cc:564] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:14:06.547925 2335 consensus_queue.cc:237] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69d564c091454d2585d5e6815b23c7db" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36965 } }
I20260811 08:14:06.548249 2336 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "69d564c091454d2585d5e6815b23c7db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69d564c091454d2585d5e6815b23c7db" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36965 } } }
I20260811 08:14:06.548453 2336 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [sys.catalog]: This master's current role is: LEADER
I20260811 08:14:06.548249 2335 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [sys.catalog]: SysCatalogTable state changed. Reason: New leader 69d564c091454d2585d5e6815b23c7db. Latest consensus state: current_term: 2 leader_uuid: "69d564c091454d2585d5e6815b23c7db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "69d564c091454d2585d5e6815b23c7db" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36965 } } }
I20260811 08:14:06.548635 2335 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db [sys.catalog]: This master's current role is: LEADER
I20260811 08:14:06.548682 2355 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:14:06.549279 2355 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:14:06.549472 2355 catalog_manager.cc:1259] Loaded cluster ID: ca79a08a5662484f80dfcffa0eede277
I20260811 08:14:06.549715 2355 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:14:06.551003 2355 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:14:06.551177 2355 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 69d564c091454d2585d5e6815b23c7db: Loaded TSK: 0
I20260811 08:14:06.551395 2355 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 08:14:06.618665 2333 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:14:06.618880 2333 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:14:06.618903 2333 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:14:06.620111 2333 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:14:06.620154 2333 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:14:06.620186 2333 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:14:06.621755 2333 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:45409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.129.keytab
--principal=oryx/127.20.158.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:34407
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=33319
--tserver_master_addrs=127.20.158.190:36965
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2333
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:14:06.622025 2333 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:14:06.622280 2333 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:14:06.628357 2380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:06.628356 2373 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:06.628508 2375 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:06.628798 2333 server_base.cc:1034] running on GCE node
I20260811 08:14:06.629014 2333 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:14:06.629277 2333 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:14:06.630430 2333 hybrid_clock.cc:648] HybridClock initialized: now 1786436046630412 us; error 38 us; skew 500 ppm
Aug 11 08:14:06 dist-test-slave-gkw7 krb5kdc[1437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436046, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:14:06.632947 2333 init.cc:377] Logged in from keytab as oryx/127.20.158.129@KRBTEST.COM (short username oryx)
I20260811 08:14:06.633471 2333 webserver.cc:460] Webserver started at http://127.20.158.129:33319/ using document root <none> and password file <none>
I20260811 08:14:06.633745 2333 fs_manager.cc:359] Metadata directory not provided
I20260811 08:14:06.633805 2333 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:14:06.635236 2333 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:14:06.635905 2393 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:06.636083 2333 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:14:06.636193 2333 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "cc847c20d65a4028a76ee1adb7a9c083"
format_stamp: "Formatted at 2026-08-11 08:14:05 on dist-test-slave-gkw7"
server_key: "e05dfcaf75f23f5fc6bd51091c5fe7b5"
server_key_iv: "bad879903908130d50c4f7f02e3a735e"
server_key_version: "encryptionkey@0"
I20260811 08:14:06.636551 2333 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:14:06.650882 2333 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:14:06.653208 2333 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:14:06.653360 2333 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:14:06.653687 2333 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:14:06.654091 2333 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:14:06.654130 2333 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:06.654153 2333 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:14:06.654166 2333 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:06.661064 2333 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:34407
I20260811 08:14:06.661163 2578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:34407 every 8 connection(s)
I20260811 08:14:06.661522 2333 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:14:06.669266 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 2333
I20260811 08:14:06.669649 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:43503
--local_ip_for_outbound_sockets=127.20.158.130
--tserver_master_addrs=127.20.158.190:36965
--webserver_port=39595
--webserver_interface=127.20.158.130
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:45409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.20.158.130
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 08:14:06 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:06 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:06.674038 2583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:06.662352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.129:41007)
0811 08:14:06.662568 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:06.662616 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:06.663228 (+ 612us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:06.666181 (+ 2953us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:06.666185 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:06.666775 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:06.666968 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:06.666973 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.668712 (+ 1739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.668713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:06.669680 (+ 967us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:06.669688 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.670407 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.670409 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:06.670549 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:06.671110 (+ 561us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:06.671119 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:06.673820 (+ 2701us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":112,"threads_started":1}
W20260811 08:14:06.674554 2580 heartbeater.cc:644] Failed to heartbeat to 127.20.158.190:36965 (0 consecutive failures): Not authorized: Failed to ping master at 127.20.158.190:36965: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
W20260811 08:14:06.675347 2584 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:06.662491 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:41007 (local address 127.20.158.190:36965)
0811 08:14:06.665714 (+ 3223us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:06.665725 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:06.665773 (+ 48us) server_negotiation.cc:407] Connection header received
0811 08:14:06.665910 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:06.665918 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:06.665977 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:06.666116 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:06.667101 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.668593 (+ 1492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.669811 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.670293 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.670433 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:06.673937 (+ 3504us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.129:41007: BlockingRecv error: recv got EOF from 127.20.158.129:41007 (error 108)
Metrics: {"server-negotiator.queue_time_us":3167,"thread_start_us":83,"threads_started":1}
Aug 11 08:14:06 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:06 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:06.679867 2583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:06.674821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.129:33433)
0811 08:14:06.675046 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:06.675058 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:06.675119 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:06.675615 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:06.675616 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:06.675761 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:06.675805 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:06.675806 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.676508 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.676509 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:06.677012 (+ 503us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:06.677013 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.677391 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.677392 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:06.677457 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:06.677937 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:06.677943 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:06.679783 (+ 1840us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":70,"threads_started":1}
W20260811 08:14:06.679921 2584 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:06.674862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:33433 (local address 127.20.158.190:36965)
0811 08:14:06.675472 (+ 610us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:06.675474 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:06.675483 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:14:06.675505 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:06.675506 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:06.675518 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:06.675571 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:06.675888 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.676410 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.677109 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.677302 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.677391 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:06.679857 (+ 2466us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.129:33433: BlockingRecv error: recv got EOF from 127.20.158.129:33433 (error 108)
Metrics: {"server-negotiator.queue_time_us":591,"thread_start_us":76,"threads_started":1}
Aug 11 08:14:06 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:06 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:06.684474 2583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:06.680353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.129:41601)
0811 08:14:06.680431 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:06.680442 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:06.680488 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:06.680613 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:06.680613 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:06.680740 (+ 127us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:06.680765 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:06.680766 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.681396 (+ 630us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.681396 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:06.681967 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:06.681969 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.682347 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.682348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:06.682401 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:06.682828 (+ 427us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:06.682833 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:06.684399 (+ 1566us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":64}
W20260811 08:14:06.684523 2584 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:06.680396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:41601 (local address 127.20.158.190:36965)
0811 08:14:06.680433 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:06.680435 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:06.680474 (+ 39us) server_negotiation.cc:407] Connection header received
0811 08:14:06.680544 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:06.680545 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:06.680554 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:06.680608 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:06.680849 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.681302 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.682065 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.682257 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.682346 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:06.684464 (+ 2118us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.129:41601: BlockingRecv error: recv got EOF from 127.20.158.129:41601 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260811 08:14:06.684819 2580 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 08:14:06.757999 2587 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:14:06.758208 2587 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:14:06.758240 2587 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:14:06.759351 2587 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:14:06.759385 2587 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:14:06.759410 2587 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:14:06.760775 2587 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:45409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.130.keytab
--principal=oryx/127.20.158.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:43503
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=39595
--tserver_master_addrs=127.20.158.190:36965
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2587
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:14:06.760963 2587 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:14:06.761142 2587 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:14:06.766297 2610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:06.766310 2607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:06.766518 2587 server_base.cc:1034] running on GCE node
W20260811 08:14:06.766438 2600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:06.766808 2587 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:14:06.767027 2587 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:14:06.768175 2587 hybrid_clock.cc:648] HybridClock initialized: now 1786436046768151 us; error 41 us; skew 500 ppm
Aug 11 08:14:06 dist-test-slave-gkw7 krb5kdc[1437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436046, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:14:06.770737 2587 init.cc:377] Logged in from keytab as oryx/127.20.158.130@KRBTEST.COM (short username oryx)
I20260811 08:14:06.771281 2587 webserver.cc:460] Webserver started at http://127.20.158.130:39595/ using document root <none> and password file <none>
I20260811 08:14:06.771517 2587 fs_manager.cc:359] Metadata directory not provided
I20260811 08:14:06.771605 2587 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:14:06.773131 2587 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:14:06.774011 2622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:06.774441 2587 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:14:06.774559 2587 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "5c8b641a886346409fe281b446c973c8"
format_stamp: "Formatted at 2026-08-11 08:14:06 on dist-test-slave-gkw7"
server_key: "55addc795df37d1fdda05e3078dc8ed9"
server_key_iv: "0b7c49b9fd7ffbf8e87ac73e03756b00"
server_key_version: "encryptionkey@0"
I20260811 08:14:06.774930 2587 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:14:06.789469 2587 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:14:06.791373 2587 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:14:06.791546 2587 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:14:06.791806 2587 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:14:06.792136 2587 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:14:06.792196 2587 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:06.792238 2587 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:14:06.792273 2587 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:06.798700 2587 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:43503
I20260811 08:14:06.798743 2791 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:43503 every 8 connection(s)
I20260811 08:14:06.799130 2587 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
Aug 11 08:14:06 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:06 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:06.806577 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 2587
I20260811 08:14:06.806952 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:36525
--local_ip_for_outbound_sockets=127.20.158.131
--tserver_master_addrs=127.20.158.190:36965
--webserver_port=33439
--webserver_interface=127.20.158.131
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:45409
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.20.158.131
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:14:06.807313 2584 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:06.799948 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:49083 (local address 127.20.158.190:36965)
0811 08:14:06.800020 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:06.800022 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:06.800251 (+ 229us) server_negotiation.cc:407] Connection header received
0811 08:14:06.800789 (+ 538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:06.800791 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:06.800807 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:06.800864 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:06.801966 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.802482 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.803525 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.803725 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.803841 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:06.807215 (+ 3374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.130:49083: BlockingRecv error: recv got EOF from 127.20.158.130:49083 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 08:14:06.807696 2798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:06.799935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.130:49083)
0811 08:14:06.800106 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:06.800144 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:06.800675 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:06.800943 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:06.800946 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:06.801618 (+ 672us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:06.801858 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:06.801864 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.802591 (+ 727us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.802592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:06.803423 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:06.803425 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.803852 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.803853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:06.803987 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:06.804507 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:06.804516 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:06.807449 (+ 2933us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":95,"threads_started":1}
W20260811 08:14:06.808018 2792 heartbeater.cc:644] Failed to heartbeat to 127.20.158.190:36965 (0 consecutive failures): Not authorized: Failed to ping master at 127.20.158.190:36965: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Aug 11 08:14:06 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:06 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:06.813687 2798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:06.808329 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.130:33021)
0811 08:14:06.808485 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:06.808496 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:06.808563 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:06.808754 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:06.808755 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:06.808966 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:06.809040 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:06.809042 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.809734 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.809735 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:06.810657 (+ 922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:06.810660 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.811177 (+ 517us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.811179 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:06.811244 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:06.811755 (+ 511us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:06.811759 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:06.813636 (+ 1877us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137}
W20260811 08:14:06.813843 2584 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:06.808427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:33021 (local address 127.20.158.190:36965)
0811 08:14:06.808496 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:06.808499 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:06.808535 (+ 36us) server_negotiation.cc:407] Connection header received
0811 08:14:06.808631 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:06.808632 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:06.808644 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:06.808708 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:06.809133 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.809650 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.810753 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.811073 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.811148 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:06.813760 (+ 2612us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.130:33021: BlockingRecv error: recv got EOF from 127.20.158.130:33021 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 11 08:14:06 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:06 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:06.818455 2798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:06.814023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.130:43119)
0811 08:14:06.814064 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:06.814074 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:06.814115 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:06.814271 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:06.814272 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:06.814402 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:06.814429 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:06.814430 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.815073 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.815074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:06.815574 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:06.815575 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.815945 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.815945 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:06.816000 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:06.816504 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:06.816508 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:06.818373 (+ 1865us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 08:14:06.818580 2792 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 08:14:06.818511 2584 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:06.814099 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:43119 (local address 127.20.158.190:36965)
0811 08:14:06.814146 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:06.814148 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:06.814157 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:14:06.814178 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:06.814179 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:06.814189 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:06.814266 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:06.814511 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.814982 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.815665 (+ 683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.815854 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.815945 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:06.818447 (+ 2502us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.130:43119: BlockingRecv error: recv got EOF from 127.20.158.130:43119 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 08:14:06.893630 2799 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:14:06.893888 2799 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:14:06.893929 2799 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:14:06.895201 2799 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:14:06.895282 2799 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:14:06.895328 2799 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:14:06.896809 2799 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:45409
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/krb5kdc/oryx_127.20.158.131.keytab
--principal=oryx/127.20.158.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:36525
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=33439
--tserver_master_addrs=127.20.158.190:36965
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2799
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:14:06.897104 2799 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:14:06.897354 2799 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:14:06.902586 2809 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:06.902573 2806 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:06.902575 2805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:06.902868 2799 server_base.cc:1034] running on GCE node
I20260811 08:14:06.903117 2799 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:14:06.903388 2799 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:14:06.904575 2799 hybrid_clock.cc:648] HybridClock initialized: now 1786436046904560 us; error 76 us; skew 500 ppm
Aug 11 08:14:06 dist-test-slave-gkw7 krb5kdc[1437](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436046, etypes {rep=17 tkt=17 ses=17}, oryx/127.20.158.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:14:06.907310 2799 init.cc:377] Logged in from keytab as oryx/127.20.158.131@KRBTEST.COM (short username oryx)
I20260811 08:14:06.907810 2799 webserver.cc:460] Webserver started at http://127.20.158.131:33439/ using document root <none> and password file <none>
I20260811 08:14:06.908074 2799 fs_manager.cc:359] Metadata directory not provided
I20260811 08:14:06.908169 2799 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:14:06.909649 2799 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:14:06.910254 2818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:06.910434 2799 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:14:06.910544 2799 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "90f6b21d245a4d81966f16448026d143"
format_stamp: "Formatted at 2026-08-11 08:14:06 on dist-test-slave-gkw7"
server_key: "cc26e968361ae50ac545b375bf173d6b"
server_key_iv: "d1bf7932fa45c3f5cc195602058f112f"
server_key_version: "encryptionkey@0"
I20260811 08:14:06.910902 2799 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:14:06.921061 2799 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:14:06.923476 2799 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:14:06.923652 2799 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:14:06.923897 2799 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:14:06.924229 2799 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:14:06.924288 2799 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:06.924329 2799 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:14:06.924357 2799 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:06.930497 2799 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:36525
I20260811 08:14:06.930573 2998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:36525 every 8 connection(s)
I20260811 08:14:06.930962 2799 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
I20260811 08:14:06.934005 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 2799
Aug 11 08:14:06 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:06 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
W20260811 08:14:06.939613 2584 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:06.931804 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:39989 (local address 127.20.158.190:36965)
0811 08:14:06.931885 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:06.931887 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:06.932115 (+ 228us) server_negotiation.cc:407] Connection header received
0811 08:14:06.932668 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:06.932670 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:06.932683 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:06.932751 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:06.933786 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.934447 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.935919 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.936150 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.936220 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:06.939537 (+ 3317us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.131:39989: BlockingRecv error: recv got EOF from 127.20.158.131:39989 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
I20260811 08:14:06.939786 3005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:06.931807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.131:39989)
0811 08:14:06.931983 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:06.932018 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:06.932545 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:06.932829 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:06.932832 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:06.933410 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:06.933682 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:06.933687 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.934558 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.934560 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:06.935830 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:06.935832 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.936244 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.936245 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:06.936357 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:06.936932 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:06.936940 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:06.939461 (+ 2521us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":73,"threads_started":1}
W20260811 08:14:06.940625 3002 heartbeater.cc:644] Failed to heartbeat to 127.20.158.190:36965 (0 consecutive failures): Not authorized: Failed to ping master at 127.20.158.190:36965: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
I20260811 08:14:06.942062 2590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:06.934587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56760 (local address 127.20.158.190:36965)
0811 08:14:06.934663 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:06.934665 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:06.934677 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:14:06.934765 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:06.934766 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:06.934775 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:06.934837 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:06.935572 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.936046 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.936825 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.937046 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.937099 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:06.938523 (+ 1424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:06.938528 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:06.938528 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:14:06.938543 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:06.940370 (+ 1827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:06.940854 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:06.940857 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:06.940858 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:06.941006 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:06.941273 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:06.941274 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:06.941274 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:06.941513 (+ 239us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:06.941699 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:06.941839 (+ 140us) server_negotiation.cc:299] Negotiation successful
0811 08:14:06.941950 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
Aug 11 08:14:06 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:06 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:06.945688 3005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:06.940879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.131:46221)
0811 08:14:06.940921 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:06.940930 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:06.940967 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:06.941116 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:06.941117 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:06.941247 (+ 130us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:06.941289 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:06.941291 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.942005 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.942007 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:06.942758 (+ 751us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:06.942761 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.943176 (+ 415us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.943177 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:06.943235 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:06.943660 (+ 425us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:06.943665 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:06.945618 (+ 1953us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 08:14:06.945801 2584 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:06.940931 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:46221 (local address 127.20.158.190:36965)
0811 08:14:06.940995 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:06.940997 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:06.941004 (+ 7us) server_negotiation.cc:407] Connection header received
0811 08:14:06.941025 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:06.941026 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:06.941034 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:06.941113 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:06.941378 (+ 265us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.941924 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.942845 (+ 921us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.943097 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.943162 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:06.945703 (+ 2541us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.131:46221: BlockingRecv error: recv got EOF from 127.20.158.131:46221 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 11 08:14:06 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:06 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:06.950191 3005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:06.945962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.131:43941)
0811 08:14:06.946059 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:06.946067 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:06.946099 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:06.946236 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:06.946237 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:06.946343 (+ 106us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:06.946371 (+ 28us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:06.946372 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.946991 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.946992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:06.947563 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:06.947565 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.947928 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.947929 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:06.947969 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:06.948462 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:06.948466 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:06.950139 (+ 1673us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":84}
W20260811 08:14:06.950311 2584 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:06.946024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:43941 (local address 127.20.158.190:36965)
0811 08:14:06.946114 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:06.946116 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:06.946142 (+ 26us) server_negotiation.cc:407] Connection header received
0811 08:14:06.946161 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:06.946162 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:06.946171 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:06.946216 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:06.946437 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.946923 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.947667 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:06.947851 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:06.947912 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:06.950238 (+ 2326us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.131:43941: BlockingRecv error: recv got EOF from 127.20.158.131:43941 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260811 08:14:06.950389 3002 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 08:14:07 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:07 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:07.690208 3007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:07.685240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.129:56103)
0811 08:14:07.685381 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:07.685399 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:07.685453 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:07.685688 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:07.685689 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:07.685856 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:07.685908 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:07.685910 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:07.686572 (+ 662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:07.686572 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:07.687118 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:07.687120 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:07.687445 (+ 325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:07.687446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:07.687489 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:07.688018 (+ 529us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:07.688023 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:07.690141 (+ 2118us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":81,"threads_started":1}
W20260811 08:14:07.690269 3009 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:07.685354 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:56103 (local address 127.20.158.190:36965)
0811 08:14:07.685505 (+ 151us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:07.685507 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:07.685515 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:14:07.685575 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:07.685578 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:07.685594 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:07.685670 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:07.685974 (+ 304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:07.686500 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:07.687190 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:07.687380 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:07.687431 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:07.690213 (+ 2782us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.129:56103: BlockingRecv error: recv got EOF from 127.20.158.129:56103 (error 108)
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":90,"threads_started":1}
Aug 11 08:14:07 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:07 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:07.824021 3014 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:07.819122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.130:57857)
0811 08:14:07.819299 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:07.819314 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:07.819422 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:07.819613 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:07.819614 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:07.819808 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:07.819859 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:07.819861 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:07.820555 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:07.820557 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:07.821108 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:07.821110 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:07.821490 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:07.821491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:07.821586 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:07.822065 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:07.822069 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:07.823917 (+ 1848us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":96,"threads_started":1}
W20260811 08:14:07.824079 3009 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:07.819245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:57857 (local address 127.20.158.190:36965)
0811 08:14:07.819317 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:07.819319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:07.819402 (+ 83us) server_negotiation.cc:407] Connection header received
0811 08:14:07.819505 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:07.819507 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:07.819527 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:07.819589 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:07.819948 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:07.820454 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:07.821204 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:07.821408 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:07.821491 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:07.824013 (+ 2522us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.130:57857: BlockingRecv error: recv got EOF from 127.20.158.130:57857 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Aug 11 08:14:07 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:07 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:07.955827 3015 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:07.950841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.131:58743)
0811 08:14:07.950995 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:07.951011 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:07.951097 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:07.951332 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:07.951333 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:07.951642 (+ 309us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:07.951701 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:07.951703 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:07.952373 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:07.952374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:07.952921 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:07.952923 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:07.953273 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:07.953274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:07.953328 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:07.953876 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:07.953889 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:07.955719 (+ 1830us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":81,"threads_started":1}
W20260811 08:14:07.955870 3009 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:07.950959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:58743 (local address 127.20.158.190:36965)
0811 08:14:07.951011 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:07.951013 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:07.951086 (+ 73us) server_negotiation.cc:407] Connection header received
0811 08:14:07.951180 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:07.951181 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:07.951193 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:07.951271 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:07.951783 (+ 512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:07.952283 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:07.953005 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:07.953187 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:07.953240 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:07.955806 (+ 2566us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.131:58743: BlockingRecv error: recv got EOF from 127.20.158.131:58743 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Aug 11 08:14:08 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:08 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:08.695756 3016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:08.690789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.129:53285)
0811 08:14:08.690935 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:08.690947 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:08.691028 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:08.691202 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:08.691203 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:08.691384 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:08.691445 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:08.691446 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:08.692114 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:08.692115 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:08.692683 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:08.692685 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:08.693029 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:08.693030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:08.693116 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:08.693761 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:08.693774 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:08.695652 (+ 1878us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":77,"threads_started":1}
W20260811 08:14:08.695819 3018 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:08.690877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:53285 (local address 127.20.158.190:36965)
0811 08:14:08.691001 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:08.691004 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:08.691013 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:14:08.691105 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:08.691106 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:08.691119 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:08.691190 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:08.691514 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:08.692029 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:08.692769 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:08.692952 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:08.693027 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:08.695746 (+ 2719us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.129:53285: BlockingRecv error: recv got EOF from 127.20.158.129:53285 (error 108)
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":53,"threads_started":1}
Aug 11 08:14:08 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:08 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:08.830044 3019 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:08.824652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.130:33187)
0811 08:14:08.824863 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:08.824877 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:08.824955 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:08.825119 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:08.825120 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:08.825328 (+ 208us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:08.825380 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:08.825382 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:08.826306 (+ 924us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:08.826307 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:08.826982 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:08.826984 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:08.827397 (+ 413us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:08.827398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:08.827459 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:08.828050 (+ 591us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:08.828059 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:08.829936 (+ 1877us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":93,"threads_started":1}
W20260811 08:14:08.830127 3018 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:08.824766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:33187 (local address 127.20.158.190:36965)
0811 08:14:08.824850 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:08.824853 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:08.824933 (+ 80us) server_negotiation.cc:407] Connection header received
0811 08:14:08.825019 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:08.825020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:08.825034 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:08.825108 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:08.825481 (+ 373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:08.826211 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:08.827088 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:08.827315 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:08.827400 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:08.830036 (+ 2636us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.130:33187: BlockingRecv error: recv got EOF from 127.20.158.130:33187 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
Aug 11 08:14:08 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:08 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:08.961318 3020 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:08.956388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.131:35029)
0811 08:14:08.956546 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:08.956560 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:08.956626 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:08.956766 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:08.956766 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:08.956937 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:08.956989 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:08.956991 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:08.957825 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:08.957826 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:08.958352 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:08.958354 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:08.958724 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:08.958725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:08.958767 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:08.959243 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:08.959247 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:08.961252 (+ 2005us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":77,"threads_started":1}
W20260811 08:14:08.961462 3018 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:08.956524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:35029 (local address 127.20.158.190:36965)
0811 08:14:08.956611 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:08.956612 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:08.956621 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:14:08.956687 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:08.956688 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:08.956699 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:08.956750 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:08.957089 (+ 339us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:08.957750 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:08.958432 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:08.958649 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:08.958709 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:08.961374 (+ 2665us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.131:35029: BlockingRecv error: recv got EOF from 127.20.158.131:35029 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
Aug 11 08:14:09 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:09 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:09.701571 3022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:09.696321 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.129:35581)
0811 08:14:09.696501 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:09.696513 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:09.696583 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:09.696745 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:09.696746 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:09.696934 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:09.696998 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:09.697000 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:09.697737 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:09.697738 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:09.698305 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:09.698307 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:09.698657 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:09.698658 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:09.698706 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:09.699255 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:09.699260 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:09.701429 (+ 2169us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":93,"threads_started":1}
W20260811 08:14:09.701660 3023 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:09.696429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:35581 (local address 127.20.158.190:36965)
0811 08:14:09.696573 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:09.696574 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:09.696585 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:14:09.696654 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:09.696654 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:09.696666 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:09.696718 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:09.697073 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:09.697657 (+ 584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:09.698382 (+ 725us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:09.698575 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:09.698626 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:09.701570 (+ 2944us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.129:35581: BlockingRecv error: recv got EOF from 127.20.158.129:35581 (error 108)
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":84,"threads_started":1}
Aug 11 08:14:09 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:09 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:09.835484 3026 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:09.830632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.130:57185)
0811 08:14:09.830795 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:09.830806 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:09.830872 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:09.831040 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:09.831041 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:09.831206 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:09.831278 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:09.831279 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:09.831971 (+ 692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:09.831971 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:09.832501 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:09.832502 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:09.832866 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:09.832867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:09.832907 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:09.833595 (+ 688us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:09.833601 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:09.835410 (+ 1809us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":101,"threads_started":1}
W20260811 08:14:09.835621 3023 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:09.830673 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:57185 (local address 127.20.158.190:36965)
0811 08:14:09.830744 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:09.830747 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:09.830923 (+ 176us) server_negotiation.cc:407] Connection header received
0811 08:14:09.830960 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:09.830961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:09.830975 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:09.831025 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:09.831370 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:09.831899 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:09.832573 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:09.832795 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:09.832858 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:09.835535 (+ 2677us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.130:57185: BlockingRecv error: recv got EOF from 127.20.158.130:57185 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 11 08:14:09 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:09 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:09.967012 3027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:09.961922 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.131:50039)
0811 08:14:09.962124 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:09.962142 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:09.962212 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:09.962391 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:09.962392 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:09.962564 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:09.962617 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:09.962618 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:09.963293 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:09.963293 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:09.963812 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:09.963813 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:09.964168 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:09.964169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:09.964210 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:09.964873 (+ 663us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:09.964879 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:09.966942 (+ 2063us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":89,"threads_started":1}
W20260811 08:14:09.967199 3023 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:09.962063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:50039 (local address 127.20.158.190:36965)
0811 08:14:09.962152 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:09.962155 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:09.962194 (+ 39us) server_negotiation.cc:407] Connection header received
0811 08:14:09.962295 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:09.962296 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:09.962310 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:09.962368 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:09.962684 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:09.963223 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:09.963888 (+ 665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:09.964093 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:09.964160 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:09.967092 (+ 2932us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.131:50039: BlockingRecv error: recv got EOF from 127.20.158.131:50039 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 11 08:14:10 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:10 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:10.710634 3028 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:10.702070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.129:43397)
0811 08:14:10.702218 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:10.702232 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:10.702285 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:10.702451 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:10.702452 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:10.702625 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:10.702679 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:10.702680 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:10.703428 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:10.703429 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:10.703961 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:10.703964 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:10.704294 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:10.704295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:10.704338 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:10.708590 (+ 4252us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:10.708595 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:10.710574 (+ 1979us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":84,"threads_started":1}
W20260811 08:14:10.710803 3029 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:10.702178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:43397 (local address 127.20.158.190:36965)
0811 08:14:10.702313 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:10.702316 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:10.702330 (+ 14us) server_negotiation.cc:407] Connection header received
0811 08:14:10.702352 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:10.702353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:10.702364 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:10.702431 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:10.702749 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:10.703357 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:10.704034 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:10.704228 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:10.704279 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:10.710707 (+ 6428us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.129:43397: BlockingRecv error: recv got EOF from 127.20.158.129:43397 (error 108)
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":81,"threads_started":1}
Aug 11 08:14:10 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:10 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:10.841012 3030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:10.836065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.130:55673)
0811 08:14:10.836217 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:10.836249 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:10.836302 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:10.836458 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:10.836459 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:10.836630 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:10.836681 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:10.836682 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:10.837416 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:10.837417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:10.838002 (+ 585us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:10.838005 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:10.838373 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:10.838374 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:10.838417 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:10.838871 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:10.838880 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:10.840952 (+ 2072us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":88,"threads_started":1}
W20260811 08:14:10.841220 3029 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:10.836200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:55673 (local address 127.20.158.190:36965)
0811 08:14:10.836276 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:10.836279 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:10.836295 (+ 16us) server_negotiation.cc:407] Connection header received
0811 08:14:10.836353 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:10.836354 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:10.836369 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:10.836440 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:10.836800 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:10.837329 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:10.838083 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:10.838301 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:10.838356 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:10.841136 (+ 2780us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.130:55673: BlockingRecv error: recv got EOF from 127.20.158.130:55673 (error 108)
Metrics: {"server-negotiator.queue_time_us":46}
Aug 11 08:14:10 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:10 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:10.976861 3031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:10.967517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.131:42435)
0811 08:14:10.967667 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:10.967682 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:10.967770 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:10.967988 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:10.967989 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:10.968157 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:10.968206 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:10.968207 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:10.968873 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:10.968874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:10.969400 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:10.969401 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:10.969732 (+ 331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:10.969733 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:10.969779 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:10.974723 (+ 4944us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:10.974737 (+ 14us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:10.976751 (+ 2014us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":76,"threads_started":1}
W20260811 08:14:10.976948 3029 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:10.967612 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:42435 (local address 127.20.158.190:36965)
0811 08:14:10.967668 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:10.967670 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:10.967747 (+ 77us) server_negotiation.cc:407] Connection header received
0811 08:14:10.967847 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:10.967849 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:10.967864 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:10.967920 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:10.968286 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:10.968800 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:10.969472 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:10.969670 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:10.969731 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:10.976864 (+ 7133us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.131:42435: BlockingRecv error: recv got EOF from 127.20.158.131:42435 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
Aug 11 08:14:11 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:11 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:11.716197 3033 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:11.711136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.129:49515)
0811 08:14:11.711290 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:11.711301 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:11.711361 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:11.711515 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:11.711516 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:11.711685 (+ 169us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:11.711755 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:11.711756 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:11.712421 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:11.712422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:11.712967 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:11.712969 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:11.713324 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:11.713325 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:11.713378 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:11.713959 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:11.713964 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:11.716092 (+ 2128us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":97,"threads_started":1}
W20260811 08:14:11.716252 3034 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:11.711226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:49515 (local address 127.20.158.190:36965)
0811 08:14:11.711362 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:11.711364 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:11.711403 (+ 39us) server_negotiation.cc:407] Connection header received
0811 08:14:11.711427 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:11.711428 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:11.711440 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:11.711494 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:11.711827 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:11.712341 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:11.713043 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:11.713233 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:11.713287 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:11.716178 (+ 2891us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.129:49515: BlockingRecv error: recv got EOF from 127.20.158.129:49515 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":77,"threads_started":1}
Aug 11 08:14:11 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:11 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:11.846984 3035 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:11.841502 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.130:39889)
0811 08:14:11.841715 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:11.841730 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:11.841816 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:11.841981 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:11.841982 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:11.842204 (+ 222us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:11.842260 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:11.842262 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:11.843144 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:11.843145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:11.843734 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:11.843736 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:11.844210 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:11.844211 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:11.844256 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:11.844722 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:11.844728 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:11.846919 (+ 2191us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":100,"threads_started":1}
W20260811 08:14:11.847112 3034 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:11.841689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:39889 (local address 127.20.158.190:36965)
0811 08:14:11.841771 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:11.841774 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:11.841788 (+ 14us) server_negotiation.cc:407] Connection header received
0811 08:14:11.841879 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:11.841880 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:11.841892 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:11.841968 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:11.842350 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:11.843057 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:11.843829 (+ 772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:11.844110 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:11.844184 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:11.847012 (+ 2828us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.130:39889: BlockingRecv error: recv got EOF from 127.20.158.130:39889 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Aug 11 08:14:11 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:11 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:11.982575 3036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:11.977535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.131:46437)
0811 08:14:11.977780 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:11.977790 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:11.977887 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:11.978071 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:11.978073 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:11.978269 (+ 196us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:11.978318 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:11.978320 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:11.979100 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:11.979101 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:11.979642 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:11.979643 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:11.980037 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:11.980038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:11.980103 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:11.980545 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:11.980550 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:11.982473 (+ 1923us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":127,"threads_started":1}
W20260811 08:14:11.982620 3034 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:11.977652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:46437 (local address 127.20.158.190:36965)
0811 08:14:11.977734 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:11.977737 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:11.977954 (+ 217us) server_negotiation.cc:407] Connection header received
0811 08:14:11.977984 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:11.977985 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:11.978003 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:11.978062 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:11.978443 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:11.979004 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:11.979732 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:11.979946 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:11.980034 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:11.982559 (+ 2525us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.131:46437: BlockingRecv error: recv got EOF from 127.20.158.131:46437 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 11 08:14:12 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:12 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:12.721738 3038 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:12.716743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.129:48973)
0811 08:14:12.716900 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:12.716911 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:12.716962 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:12.717118 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:12.717119 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:12.717304 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:12.717356 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:12.717358 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:12.718061 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:12.718063 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:12.718636 (+ 573us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:12.718638 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:12.718978 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:12.718979 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:12.719023 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:12.719539 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:12.719544 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:12.721676 (+ 2132us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":91,"threads_started":1}
W20260811 08:14:12.721959 3040 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:12.716824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:48973 (local address 127.20.158.190:36965)
0811 08:14:12.716953 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:12.716955 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:12.716964 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:14:12.717008 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:12.717008 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:12.717020 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:12.717077 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:12.717424 (+ 347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:12.717985 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:12.718715 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:12.718910 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:12.718963 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:12.721871 (+ 2908us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.129:48973: BlockingRecv error: recv got EOF from 127.20.158.129:48973 (error 108)
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":73,"threads_started":1}
Aug 11 08:14:12 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:12 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:12.852622 3041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:12.847476 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.130:45035)
0811 08:14:12.847662 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:12.847674 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:12.847778 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:12.847975 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:12.847976 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:12.848179 (+ 203us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:12.848296 (+ 117us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:12.848299 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:12.848969 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:12.848976 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:12.849612 (+ 636us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:12.849614 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:12.849991 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:12.849992 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:12.850064 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:12.850573 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:12.850579 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:12.852524 (+ 1945us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":104,"threads_started":1}
W20260811 08:14:12.852689 3040 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:12.847565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:45035 (local address 127.20.158.190:36965)
0811 08:14:12.847644 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:12.847647 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:12.847755 (+ 108us) server_negotiation.cc:407] Connection header received
0811 08:14:12.847860 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:12.847861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:12.847882 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:12.847954 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:12.848375 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:12.848884 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:12.849718 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:12.849913 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:12.849991 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:12.852623 (+ 2632us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.130:45035: BlockingRecv error: recv got EOF from 127.20.158.130:45035 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Aug 11 08:14:12 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:12 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:12.988353 3042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:12.983186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.131:59231)
0811 08:14:12.983399 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:12.983408 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:12.983483 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:12.983651 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:12.983652 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:12.983851 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:12.983898 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:12.983900 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:12.984659 (+ 759us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:12.984660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:12.985241 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:12.985243 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:12.985680 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:12.985680 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:12.985753 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:12.986254 (+ 501us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:12.986267 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:12.988288 (+ 2021us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":118,"threads_started":1}
W20260811 08:14:12.988478 3040 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:12.983268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:59231 (local address 127.20.158.190:36965)
0811 08:14:12.983342 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:12.983345 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:12.983470 (+ 125us) server_negotiation.cc:407] Connection header received
0811 08:14:12.983544 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:12.983545 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:12.983568 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:12.983632 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:12.983992 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:12.984570 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:12.985338 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:12.985585 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:12.985677 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:12.988398 (+ 2721us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.131:59231: BlockingRecv error: recv got EOF from 127.20.158.131:59231 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
Aug 11 08:14:13 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:13 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:13.727151 3043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:13.722463 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.129:40371)
0811 08:14:13.722609 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:13.722623 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:13.722690 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:13.722840 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:13.722841 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:13.723020 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:13.723075 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:13.723077 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:13.723779 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:13.723780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:13.724380 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:13.724382 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:13.724717 (+ 335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:13.724718 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:13.724762 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:13.725216 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:13.725221 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:13.727084 (+ 1863us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":90,"threads_started":1}
W20260811 08:14:13.727299 3044 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:13.722548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:40371 (local address 127.20.158.190:36965)
0811 08:14:13.722686 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:13.722688 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:13.722697 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:14:13.722746 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:13.722747 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:13.722759 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:13.722822 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:13.723171 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:13.723679 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:13.724459 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:13.724651 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:13.724702 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:13.727205 (+ 2503us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.129:40371: BlockingRecv error: recv got EOF from 127.20.158.129:40371 (error 108)
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":82,"threads_started":1}
Aug 11 08:14:13 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:13 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:13.857775 3045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:13.853161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.130:52565)
0811 08:14:13.853344 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:13.853354 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:13.853417 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:13.853574 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:13.853575 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:13.853757 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:13.853808 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:13.853810 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:13.854445 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:13.854446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:13.854986 (+ 540us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:13.854988 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:13.855331 (+ 343us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:13.855332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:13.855375 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:13.855819 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:13.855824 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:13.857716 (+ 1892us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":130,"threads_started":1}
W20260811 08:14:13.857906 3044 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:13.853220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:52565 (local address 127.20.158.190:36965)
0811 08:14:13.853287 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:13.853290 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:13.853413 (+ 123us) server_negotiation.cc:407] Connection header received
0811 08:14:13.853460 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:13.853461 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:13.853475 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:13.853523 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:13.853872 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:13.854369 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:13.855066 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:13.855261 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:13.855316 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:13.857825 (+ 2509us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.130:52565: BlockingRecv error: recv got EOF from 127.20.158.130:52565 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Aug 11 08:14:13 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:13 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:13.993799 3046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:13.988947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.131:33593)
0811 08:14:13.989168 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:13.989181 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:13.989283 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:13.989451 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:13.989452 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:13.989720 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:13.989788 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:13.989791 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:13.990459 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:13.990460 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:13.990988 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:13.990990 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:13.991307 (+ 317us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:13.991308 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:13.991350 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:13.991809 (+ 459us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:13.991814 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:13.993739 (+ 1925us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":86,"threads_started":1}
W20260811 08:14:13.993901 3044 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:13.989076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:33593 (local address 127.20.158.190:36965)
0811 08:14:13.989127 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:13.989136 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:13.989255 (+ 119us) server_negotiation.cc:407] Connection header received
0811 08:14:13.989351 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:13.989352 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:13.989370 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:13.989430 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:13.989879 (+ 449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:13.990385 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:13.991065 (+ 680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:13.991246 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:13.991296 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:13.993833 (+ 2537us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.131:33593: BlockingRecv error: recv got EOF from 127.20.158.131:33593 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
Aug 11 08:14:14 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:14 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:14.732543 3049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:14.727634 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.129:33603)
0811 08:14:14.727790 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:14.727807 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:14.727858 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:14.728023 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:14.728024 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:14.728191 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:14.728245 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:14.728246 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:14.728927 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:14.728928 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:14.729447 (+ 519us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:14.729448 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:14.729946 (+ 498us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:14.729947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:14.729993 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:14.730544 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:14.730549 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:14.732482 (+ 1933us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":95,"threads_started":1}
W20260811 08:14:14.732723 3050 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:14.727762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:33603 (local address 127.20.158.190:36965)
0811 08:14:14.727895 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:14.727897 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:14.727905 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:14:14.727926 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:14.727927 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:14.727937 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:14.728003 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:14.728336 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:14.728852 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:14.729663 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:14.729874 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:14.729931 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:14.732615 (+ 2684us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.129:33603: BlockingRecv error: recv got EOF from 127.20.158.129:33603 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":71,"threads_started":1}
Aug 11 08:14:14 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:14 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:14.863576 3051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:14.858421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.130:42051)
0811 08:14:14.858616 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:14.858628 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:14.858727 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:14.858913 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:14.858914 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:14.859154 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:14.859205 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:14.859207 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:14.860087 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:14.860088 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:14.860633 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:14.860635 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:14.861005 (+ 370us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:14.861005 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:14.861077 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:14.861617 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:14.861623 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:14.863476 (+ 1853us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":98,"threads_started":1}
W20260811 08:14:14.863634 3050 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:14.858515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:42051 (local address 127.20.158.190:36965)
0811 08:14:14.858612 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:14.858615 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:14.858705 (+ 90us) server_negotiation.cc:407] Connection header received
0811 08:14:14.858818 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:14.858819 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:14.858840 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:14.858904 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:14.859297 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:14.859996 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:14.860724 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:14.860927 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:14.861005 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:14.863561 (+ 2556us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.130:42051: BlockingRecv error: recv got EOF from 127.20.158.130:42051 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
Aug 11 08:14:14 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:14 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:14.999693 3052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:14.994443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.131:41547)
0811 08:14:14.994662 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:14.994673 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:14.994769 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:14.994932 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:14.994933 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:14.995138 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:14.995185 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:14.995188 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:14.995890 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:14.995891 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:14.996455 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:14.996457 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:14.997060 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:14.997062 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:14.997165 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:14.997769 (+ 604us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:14.997773 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:14.999634 (+ 1861us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":125,"threads_started":1}
W20260811 08:14:14.999850 3050 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:14.994544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:41547 (local address 127.20.158.190:36965)
0811 08:14:14.994613 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:14.994616 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:14.994747 (+ 131us) server_negotiation.cc:407] Connection header received
0811 08:14:14.994853 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:14.994854 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:14.994870 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:14.994926 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:14.995276 (+ 350us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:14.995796 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:14.996648 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:14.996922 (+ 274us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:14.997013 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:14.999760 (+ 2747us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.131:41547: BlockingRecv error: recv got EOF from 127.20.158.131:41547 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Aug 11 08:14:15 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:15 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:15.741485 3053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:15.733121 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.129:35145)
0811 08:14:15.733258 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:15.733268 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:15.733319 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:15.733458 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:15.733458 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:15.733699 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:15.733753 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:15.733755 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:15.734410 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:15.734411 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:15.734938 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:15.734940 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:15.735262 (+ 322us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:15.735263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:15.735305 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:15.739334 (+ 4029us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:15.739353 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:15.741421 (+ 2068us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":74,"threads_started":1}
W20260811 08:14:15.741688 3055 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:15.733170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:35145 (local address 127.20.158.190:36965)
0811 08:14:15.733323 (+ 153us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:15.733325 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:15.733335 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:14:15.733358 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:15.733359 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:15.733369 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:15.733441 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:15.733824 (+ 383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:15.734333 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:15.735012 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:15.735198 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:15.735250 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:15.741607 (+ 6357us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.129:35145: BlockingRecv error: recv got EOF from 127.20.158.129:35145 (error 108)
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":87,"threads_started":1}
Aug 11 08:14:15 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:15 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:15.868726 3056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:15.864039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.130:49265)
0811 08:14:15.864194 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:15.864206 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:15.864288 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:15.864404 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:15.864404 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:15.864577 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:15.864629 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:15.864631 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:15.865276 (+ 645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:15.865277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:15.865833 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:15.865835 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:15.866175 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:15.866176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:15.866215 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:15.866677 (+ 462us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:15.866681 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:15.868660 (+ 1979us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":90,"threads_started":1}
W20260811 08:14:15.868865 3055 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:15.864159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:49265 (local address 127.20.158.190:36965)
0811 08:14:15.864209 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:15.864211 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:15.864279 (+ 68us) server_negotiation.cc:407] Connection header received
0811 08:14:15.864336 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:15.864337 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:15.864348 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:15.864393 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:15.864693 (+ 300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:15.865193 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:15.865908 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:15.866101 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:15.866163 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:15.868780 (+ 2617us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.130:49265: BlockingRecv error: recv got EOF from 127.20.158.130:49265 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
Aug 11 08:14:15 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:15 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:16.005128 3057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:16.000221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.131:39193)
0811 08:14:16.000359 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:16.000370 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:16.000435 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:16.000637 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:16.000638 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:16.000820 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:16.000872 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:16.000874 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:16.001617 (+ 743us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:16.001618 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:16.002157 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:16.002160 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:16.002545 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:16.002546 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:16.002589 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:16.003083 (+ 494us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:16.003088 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:16.005021 (+ 1933us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":69,"threads_started":1}
W20260811 08:14:16.005213 3055 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:16.000303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:39193 (local address 127.20.158.190:36965)
0811 08:14:16.000395 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:16.000397 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:16.000419 (+ 22us) server_negotiation.cc:407] Connection header received
0811 08:14:16.000533 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:16.000534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:16.000551 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:16.000620 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:16.000981 (+ 361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:16.001510 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:16.002265 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:16.002468 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:16.002535 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:16.005139 (+ 2604us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.131:39193: BlockingRecv error: recv got EOF from 127.20.158.131:39193 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 11 08:14:16 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:16 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:16.747699 3058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:16.742179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.129:42593)
0811 08:14:16.742351 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:16.742363 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:16.742470 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:16.742681 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:16.742682 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:16.742887 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:16.742941 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:16.742943 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:16.743740 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:16.743741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:16.744352 (+ 611us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:16.744355 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:16.744804 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:16.744806 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:16.744866 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:16.745456 (+ 590us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:16.745462 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:16.747616 (+ 2154us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":83,"threads_started":1}
W20260811 08:14:16.747912 3060 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:16.742207 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:42593 (local address 127.20.158.190:36965)
0811 08:14:16.742392 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:16.742395 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:16.742443 (+ 48us) server_negotiation.cc:407] Connection header received
0811 08:14:16.742522 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:16.742523 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:16.742534 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:16.742607 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:16.743058 (+ 451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:16.743600 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:16.744466 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:16.744708 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:16.744781 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:16.747736 (+ 2955us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.129:42593: BlockingRecv error: recv got EOF from 127.20.158.129:42593 (error 108)
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":59,"threads_started":1}
Aug 11 08:14:16 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:16 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:16.874451 3061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:16.869369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.130:43253)
0811 08:14:16.869614 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:16.869627 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:16.869737 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:16.869915 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:16.869916 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:16.870108 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:16.870158 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:16.870160 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:16.870859 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:16.870861 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:16.871398 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:16.871399 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:16.871784 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:16.871785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:16.871855 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:16.872379 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:16.872392 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:16.874353 (+ 1961us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":225,"thread_start_us":130,"threads_started":1}
W20260811 08:14:16.874501 3060 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:16.869508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:43253 (local address 127.20.158.190:36965)
0811 08:14:16.869597 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:16.869600 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:16.869706 (+ 106us) server_negotiation.cc:407] Connection header received
0811 08:14:16.869802 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:16.869804 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:16.869817 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:16.869893 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:16.870251 (+ 358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:16.870760 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:16.871488 (+ 728us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:16.871695 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:16.871773 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:16.874434 (+ 2661us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.130:43253: BlockingRecv error: recv got EOF from 127.20.158.130:43253 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 11 08:14:17 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:17 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:17.011221 3062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:17.005813 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.131:52061)
0811 08:14:17.005975 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:17.005988 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:17.006056 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:17.006253 (+ 197us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:17.006255 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:17.006515 (+ 260us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:17.006595 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:17.006597 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:17.007449 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:17.007450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:17.008024 (+ 574us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:17.008026 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:17.008409 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:17.008410 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:17.008458 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:17.009009 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:17.009015 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:17.011141 (+ 2126us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":100,"threads_started":1}
W20260811 08:14:17.011451 3060 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:17.006008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:52061 (local address 127.20.158.190:36965)
0811 08:14:17.006084 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:17.006086 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:17.006097 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:14:17.006132 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:17.006133 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:17.006151 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:17.006226 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:17.006696 (+ 470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:17.007338 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:17.008128 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:17.008328 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:17.008392 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:17.011391 (+ 2999us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.131:52061: BlockingRecv error: recv got EOF from 127.20.158.131:52061 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 11 08:14:17 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:17 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:17.753417 3064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:17.748289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.129:49963)
0811 08:14:17.748494 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:17.748506 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:17.748611 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:17.748768 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:17.748769 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:17.748952 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:17.749002 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:17.749004 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:17.749804 (+ 800us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:17.749805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:17.750360 (+ 555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:17.750362 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:17.750712 (+ 350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:17.750713 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:17.750766 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:17.751252 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:17.751257 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:17.753333 (+ 2076us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":131,"threads_started":1}
W20260811 08:14:17.753512 3065 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:17.748395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:49963 (local address 127.20.158.190:36965)
0811 08:14:17.748505 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:17.748509 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:17.748618 (+ 109us) server_negotiation.cc:407] Connection header received
0811 08:14:17.748672 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:17.748673 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:17.748685 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:17.748748 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:17.749072 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:17.749697 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:17.750438 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:17.750643 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:17.750697 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:17.753436 (+ 2739us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.129:49963: BlockingRecv error: recv got EOF from 127.20.158.129:49963 (error 108)
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":51,"threads_started":1}
Aug 11 08:14:17 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:17 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:17.880837 3066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:17.875133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.130:45127)
0811 08:14:17.875341 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:17.875354 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:17.875462 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:17.875823 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:17.875824 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:17.876068 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:17.876128 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:17.876130 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:17.876893 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:17.876894 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:17.877641 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:17.877644 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:17.878050 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:17.878051 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:17.878114 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:17.878763 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:17.878767 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:17.880763 (+ 1996us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":112,"threads_started":1}
W20260811 08:14:17.880939 3065 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:17.875214 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:45127 (local address 127.20.158.190:36965)
0811 08:14:17.875330 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:17.875332 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:17.875438 (+ 106us) server_negotiation.cc:407] Connection header received
0811 08:14:17.875706 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:17.875707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:17.875726 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:17.875799 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:17.876232 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:17.876794 (+ 562us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:17.877731 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:17.877954 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:17.878050 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:17.880869 (+ 2819us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.130:45127: BlockingRecv error: recv got EOF from 127.20.158.130:45127 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
Aug 11 08:14:18 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:18 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:18.017259 3068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:18.011814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.131:43125)
0811 08:14:18.012025 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:18.012040 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:18.012159 (+ 119us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:18.012313 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:18.012313 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:18.012520 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:18.012575 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:18.012577 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:18.013308 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:18.013309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:18.013958 (+ 649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:18.013961 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:18.014388 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:18.014389 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:18.014444 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:18.015071 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:18.015078 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:18.017180 (+ 2102us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":184,"thread_start_us":81,"threads_started":1}
W20260811 08:14:18.017359 3065 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:18.011958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:43125 (local address 127.20.158.190:36965)
0811 08:14:18.012043 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:18.012045 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:18.012155 (+ 110us) server_negotiation.cc:407] Connection header received
0811 08:14:18.012213 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:18.012214 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:18.012230 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:18.012287 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:18.012647 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:18.013210 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:18.014033 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:18.014266 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:18.014328 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:18.017290 (+ 2962us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.131:43125: BlockingRecv error: recv got EOF from 127.20.158.131:43125 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 11 08:14:18 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:18 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:18.758723 3069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:18.753970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.129:50933)
0811 08:14:18.754134 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:18.754146 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:18.754201 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:18.754349 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:18.754350 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:18.754570 (+ 220us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:18.754629 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:18.754631 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:18.755312 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:18.755313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:18.755862 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:18.755864 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:18.756265 (+ 401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:18.756266 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:18.756315 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:18.756802 (+ 487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:18.756807 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:18.758664 (+ 1857us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":90,"threads_started":1}
W20260811 08:14:18.758854 3071 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:18.754063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:50933 (local address 127.20.158.190:36965)
0811 08:14:18.754200 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:18.754202 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:18.754239 (+ 37us) server_negotiation.cc:407] Connection header received
0811 08:14:18.754263 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:18.754264 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:18.754275 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:18.754328 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:18.754699 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:18.755232 (+ 533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:18.755966 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:18.756167 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:18.756250 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:18.758765 (+ 2515us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.129:50933: BlockingRecv error: recv got EOF from 127.20.158.129:50933 (error 108)
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":72,"threads_started":1}
Aug 11 08:14:18 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:18 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:18.886261 3072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:18.881336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.130:43971)
0811 08:14:18.881517 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:18.881531 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:18.881645 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:18.881831 (+ 186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:18.881832 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:18.882034 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:18.882084 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:18.882086 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:18.882794 (+ 708us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:18.882795 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:18.883332 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:18.883334 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:18.883711 (+ 377us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:18.883712 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:18.883781 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:18.884278 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:18.884283 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:18.886158 (+ 1875us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":96,"threads_started":1}
W20260811 08:14:18.886322 3071 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:18.881430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:43971 (local address 127.20.158.190:36965)
0811 08:14:18.881512 (+ 82us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:18.881515 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:18.881626 (+ 111us) server_negotiation.cc:407] Connection header received
0811 08:14:18.881705 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:18.881706 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:18.881719 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:18.881823 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:18.882172 (+ 349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:18.882700 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:18.883424 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:18.883633 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:18.883713 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:18.886258 (+ 2545us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.130:43971: BlockingRecv error: recv got EOF from 127.20.158.130:43971 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Aug 11 08:14:19 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:19 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:19.023092 3074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:19.017844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.131:52933)
0811 08:14:19.018082 (+ 238us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:19.018095 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:19.018198 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:19.018362 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:19.018363 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:19.018560 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:19.018606 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:19.018608 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:19.019405 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:19.019406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:19.020103 (+ 697us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:19.020105 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:19.020481 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:19.020481 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:19.020535 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:19.021025 (+ 490us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:19.021029 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:19.022996 (+ 1967us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":133,"threads_started":1}
W20260811 08:14:19.023156 3071 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:19.017970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:52933 (local address 127.20.158.190:36965)
0811 08:14:19.018063 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:19.018066 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:19.018178 (+ 112us) server_negotiation.cc:407] Connection header received
0811 08:14:19.018278 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:19.018279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:19.018295 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:19.018345 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:19.018697 (+ 352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:19.019335 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:19.020200 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:19.020405 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:19.020483 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:19.023090 (+ 2607us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.131:52933: BlockingRecv error: recv got EOF from 127.20.158.131:52933 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
Aug 11 08:14:19 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:19 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:19.764796 3075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:19.759448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.129:40759)
0811 08:14:19.759609 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:19.759627 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:19.759737 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:19.759960 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:19.759961 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:19.760203 (+ 242us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:19.760264 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:19.760266 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:19.761052 (+ 786us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:19.761053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:19.761643 (+ 590us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:19.761646 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:19.762071 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:19.762071 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:19.762113 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:19.762630 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:19.762635 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:19.764725 (+ 2090us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":98,"threads_started":1}
W20260811 08:14:19.764910 3077 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:19.759521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:40759 (local address 127.20.158.190:36965)
0811 08:14:19.759682 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:19.759686 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:19.759704 (+ 18us) server_negotiation.cc:407] Connection header received
0811 08:14:19.759830 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:19.759832 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:19.759848 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:19.759926 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:19.760404 (+ 478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:19.760979 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:19.761753 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:19.761993 (+ 240us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:19.762065 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:19.764833 (+ 2768us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.129:40759: BlockingRecv error: recv got EOF from 127.20.158.129:40759 (error 108)
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":122,"threads_started":1}
Aug 11 08:14:19 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:19 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:19.891809 3080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:19.886850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.130:35779)
0811 08:14:19.887030 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:19.887062 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:19.887204 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:19.887396 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:19.887397 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:19.887596 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:19.887647 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:19.887649 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:19.888337 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:19.888339 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:19.888875 (+ 536us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:19.888876 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:19.889254 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:19.889255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:19.889315 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:19.889880 (+ 565us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:19.889892 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:19.891708 (+ 1816us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":65,"threads_started":1}
W20260811 08:14:19.891902 3077 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:19.887018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:35779 (local address 127.20.158.190:36965)
0811 08:14:19.887088 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:19.887090 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:19.887180 (+ 90us) server_negotiation.cc:407] Connection header received
0811 08:14:19.887277 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:19.887278 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:19.887299 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:19.887384 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:19.887735 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:19.888250 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:19.888969 (+ 719us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:19.889175 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:19.889256 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:19.891795 (+ 2539us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.130:35779: BlockingRecv error: recv got EOF from 127.20.158.130:35779 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
Aug 11 08:14:20 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:20 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:20.028496 3082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:20.023597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.131:57189)
0811 08:14:20.023764 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:20.023776 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:20.023873 (+ 97us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:20.024013 (+ 140us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:20.024014 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:20.024241 (+ 227us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:20.024290 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:20.024293 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:20.025008 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:20.025009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:20.025644 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:20.025646 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:20.026025 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:20.026026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:20.026083 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:20.026547 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:20.026551 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:20.028386 (+ 1835us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":93,"threads_started":1}
W20260811 08:14:20.028553 3077 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:20.023680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:57189 (local address 127.20.158.190:36965)
0811 08:14:20.023760 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:20.023762 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:20.023851 (+ 89us) server_negotiation.cc:407] Connection header received
0811 08:14:20.023940 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:20.023941 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:20.023956 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:20.024009 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:20.024384 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:20.024905 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:20.025725 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:20.025935 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:20.026023 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:20.028482 (+ 2459us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.131:57189: BlockingRecv error: recv got EOF from 127.20.158.131:57189 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Aug 11 08:14:20 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:20 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:20.778620 3085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:20.765349 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.129:56863)
0811 08:14:20.765575 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:20.765587 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:20.765663 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:20.765795 (+ 132us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:20.765796 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:20.765972 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:20.766022 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:20.766024 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:20.766769 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:20.766770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:20.767301 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:20.767303 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:20.767664 (+ 361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:20.767665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:20.767705 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:20.776317 (+ 8612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:20.776324 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:20.778532 (+ 2208us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":108,"threads_started":1}
W20260811 08:14:20.778800 3086 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:20.765456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:56863 (local address 127.20.158.190:36965)
0811 08:14:20.765592 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:20.765594 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:20.765660 (+ 66us) server_negotiation.cc:407] Connection header received
0811 08:14:20.765715 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:20.765716 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:20.765727 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:20.765785 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:20.766147 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:20.766694 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:20.767384 (+ 690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:20.767593 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:20.767651 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:20.778711 (+ 11060us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.129:56863: BlockingRecv error: recv got EOF from 127.20.158.129:56863 (error 108)
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":53,"threads_started":1}
Aug 11 08:14:20 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:20 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:20.897567 3087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:20.892461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.130:44651)
0811 08:14:20.892662 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:20.892674 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:20.892769 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:20.892940 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:20.892941 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:20.893142 (+ 201us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:20.893232 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:20.893235 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:20.894025 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:20.894027 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:20.894646 (+ 619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:20.894649 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:20.895025 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:20.895026 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:20.895086 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:20.895612 (+ 526us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:20.895618 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:20.897430 (+ 1812us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":92,"threads_started":1}
W20260811 08:14:20.897624 3086 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:20.892554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:44651 (local address 127.20.158.190:36965)
0811 08:14:20.892633 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:20.892636 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:20.892754 (+ 118us) server_negotiation.cc:407] Connection header received
0811 08:14:20.892839 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:20.892840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:20.892854 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:20.892933 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:20.893326 (+ 393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:20.893932 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:20.894750 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:20.894951 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:20.895026 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:20.897519 (+ 2493us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.130:44651: BlockingRecv error: recv got EOF from 127.20.158.130:44651 (error 108)
Metrics: {"server-negotiator.queue_time_us":44}
Aug 11 08:14:21 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:21 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.131@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:21.034192 3088 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:21.029016 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.131:41473)
0811 08:14:21.029231 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:21.029243 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:21.029310 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:21.029479 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:21.029480 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:21.029680 (+ 200us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:21.029729 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:21.029731 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:21.030418 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:21.030419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:21.030996 (+ 577us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:21.030999 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:21.031416 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:21.031418 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:21.031469 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:21.032003 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:21.032008 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:21.034126 (+ 2118us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":98,"threads_started":1}
W20260811 08:14:21.034356 3086 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:21.029072 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:41473 (local address 127.20.158.190:36965)
0811 08:14:21.029144 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:21.029146 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:21.029360 (+ 214us) server_negotiation.cc:407] Connection header received
0811 08:14:21.029389 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:21.029390 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:21.029406 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:21.029453 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:21.029798 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:21.030316 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:21.031132 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:21.031334 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:21.031389 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:21.034265 (+ 2876us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.131:41473: BlockingRecv error: recv got EOF from 127.20.158.131:41473 (error 108)
Metrics: {"server-negotiator.queue_time_us":39}
Aug 11 08:14:21 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:21 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.129@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:21.784452 3091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:21.779334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.129:36183)
0811 08:14:21.779520 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:21.779536 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:21.779609 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:21.779734 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:21.779735 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:21.779909 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:21.779962 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:21.779964 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:21.780686 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:21.780687 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:21.781251 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:21.781254 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:21.781715 (+ 461us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:21.781716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:21.781770 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:21.782293 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:21.782298 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:21.784379 (+ 2081us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":103,"threads_started":1}
W20260811 08:14:21.784592 3092 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:21.779408 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:36183 (local address 127.20.158.190:36965)
0811 08:14:21.779565 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:21.779567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:21.779584 (+ 17us) server_negotiation.cc:407] Connection header received
0811 08:14:21.779657 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:21.779658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:21.779669 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:21.779730 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:21.780029 (+ 299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:21.780604 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:21.781338 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:21.781635 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:21.781697 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:21.784492 (+ 2795us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.129:36183: BlockingRecv error: recv got EOF from 127.20.158.129:36183 (error 108)
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":91,"threads_started":1}
Aug 11 08:14:21 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
Aug 11 08:14:21 dist-test-slave-gkw7 krb5kdc[1437](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.20.158.130@KRBTEST.COM for oryx/127.20.158.190@KRBTEST.COM, Server not found in Kerberos database
I20260811 08:14:21.903162 3094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:21.898136 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36965 (local address 127.20.158.130:36375)
0811 08:14:21.898358 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:21.898371 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:21.898447 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:21.898625 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:21.898627 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:21.898845 (+ 218us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:21.898895 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:21.898897 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:21.899594 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:21.899595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:21.900192 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:21.900194 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:21.900584 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:21.900585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:21.900644 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:21.901142 (+ 498us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:21.901147 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:21.903034 (+ 1887us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.20.158.190:36965: Server oryx/127.20.158.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":101,"threads_started":1}
W20260811 08:14:21.903199 3092 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:21.898251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:36375 (local address 127.20.158.190:36965)
0811 08:14:21.898344 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:21.898347 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:21.898426 (+ 79us) server_negotiation.cc:407] Connection header received
0811 08:14:21.898506 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:21.898507 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:21.898520 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:21.898612 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:21.898994 (+ 382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:21.899496 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:21.900289 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:21.900501 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:21.900587 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:21.903136 (+ 2549us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.20.158.130:36375: BlockingRecv error: recv got EOF from 127.20.158.130:36375 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
I20260811 08:14:21.940420 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 2333
I20260811 08:14:21.952842 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 2587
I20260811 08:14:21.963991 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 2799
I20260811 08:14:21.975242 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 2225
2026-08-11T08:14:21Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17874 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-11T08:14:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:14:22Z Disabled control of system clock
I20260811 08:14:22.010990 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:41881
--webserver_interface=127.20.158.190
--webserver_port=0
--builtin_ntp_servers=127.20.158.148:35025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:41881
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260811 08:14:22.097764 3106 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:14:22.097975 3106 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:14:22.097995 3106 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:14:22.099210 3106 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:14:22.099258 3106 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:14:22.099272 3106 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:14:22.099285 3106 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:14:22.099298 3106 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:14:22.100675 3106 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:35025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:41881
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:41881
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3106
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:14:22.100956 3106 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:14:22.101289 3106 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:14:22.106709 3113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:22.106756 3112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:22.106775 3115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:22.106818 3106 server_base.cc:1034] running on GCE node
I20260811 08:14:22.107210 3106 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:14:22.107473 3106 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:14:22.108628 3106 hybrid_clock.cc:648] HybridClock initialized: now 1786436062108614 us; error 30 us; skew 500 ppm
I20260811 08:14:22.109877 3106 webserver.cc:460] Webserver started at http://127.20.158.190:44799/ using document root <none> and password file <none>
I20260811 08:14:22.110072 3106 fs_manager.cc:359] Metadata directory not provided
I20260811 08:14:22.110119 3106 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:14:22.110227 3106 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:14:22.111253 3106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "4d7bd20a5b134ceba1d6ac3630e88707"
format_stamp: "Formatted at 2026-08-11 08:14:22 on dist-test-slave-gkw7"
server_key: "cd5bed1c528d5f01d04fa4ca2321aee0"
server_key_iv: "3b0d4e007a7c54d668f1b3bb9fc833ee"
server_key_version: "encryptionkey@0"
I20260811 08:14:22.111567 3106 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "4d7bd20a5b134ceba1d6ac3630e88707"
format_stamp: "Formatted at 2026-08-11 08:14:22 on dist-test-slave-gkw7"
server_key: "cd5bed1c528d5f01d04fa4ca2321aee0"
server_key_iv: "3b0d4e007a7c54d668f1b3bb9fc833ee"
server_key_version: "encryptionkey@0"
I20260811 08:14:22.112984 3106 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:14:22.113760 3128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:22.113960 3106 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:14:22.114055 3106 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "4d7bd20a5b134ceba1d6ac3630e88707"
format_stamp: "Formatted at 2026-08-11 08:14:22 on dist-test-slave-gkw7"
server_key: "cd5bed1c528d5f01d04fa4ca2321aee0"
server_key_iv: "3b0d4e007a7c54d668f1b3bb9fc833ee"
server_key_version: "encryptionkey@0"
I20260811 08:14:22.114127 3106 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:14:22.129278 3106 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:14:22.129679 3106 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:14:22.129833 3106 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:14:22.133742 3106 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:41881
I20260811 08:14:22.133828 3211 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:41881 every 8 connection(s)
I20260811 08:14:22.134168 3106 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:14:22.134956 3212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:14:22.136806 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 3106
I20260811 08:14:22.136912 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:14:22.137154 21114 external_mini_cluster.cc:1428] Setting key e771c73678a7752bfa658ee0090b84ca
I20260811 08:14:22.138211 3212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d7bd20a5b134ceba1d6ac3630e88707: Bootstrap starting.
I20260811 08:14:22.138947 3212 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4d7bd20a5b134ceba1d6ac3630e88707: Neither blocks nor log segments found. Creating new log.
I20260811 08:14:22.139261 3212 log.cc:824] T 00000000000000000000000000000000 P 4d7bd20a5b134ceba1d6ac3630e88707: Log is configured to *not* fsync() on all Append() calls
I20260811 08:14:22.140026 3212 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4d7bd20a5b134ceba1d6ac3630e88707: No bootstrap required, opened a new log
I20260811 08:14:22.142503 3212 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4d7bd20a5b134ceba1d6ac3630e88707 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d7bd20a5b134ceba1d6ac3630e88707" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 41881 } }
I20260811 08:14:22.142668 3212 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4d7bd20a5b134ceba1d6ac3630e88707 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:14:22.142693 3212 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4d7bd20a5b134ceba1d6ac3630e88707 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4d7bd20a5b134ceba1d6ac3630e88707, State: Initialized, Role: FOLLOWER
I20260811 08:14:22.142836 3212 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4d7bd20a5b134ceba1d6ac3630e88707 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d7bd20a5b134ceba1d6ac3630e88707" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 41881 } }
I20260811 08:14:22.142948 3212 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4d7bd20a5b134ceba1d6ac3630e88707 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:14:22.142988 3212 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4d7bd20a5b134ceba1d6ac3630e88707 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:14:22.143075 3212 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4d7bd20a5b134ceba1d6ac3630e88707 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:14:22.143361 3215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:22.137783 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39658 (local address 127.20.158.190:41881)
0811 08:14:22.137991 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:22.137998 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:22.138023 (+ 25us) server_negotiation.cc:407] Connection header received
0811 08:14:22.138478 (+ 455us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:22.138485 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:22.138547 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:22.138664 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:22.138930 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:22.140167 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:22.141243 (+ 1076us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:22.141709 (+ 466us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:22.141827 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:22.142552 (+ 725us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:22.142556 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:22.142556 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:14:22.142795 (+ 239us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:22.142860 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:14:22.142876 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:22.142932 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:22.143042 (+ 110us) server_negotiation.cc:299] Negotiation successful
0811 08:14:22.143128 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":85,"threads_started":1}
I20260811 08:14:22.143827 3212 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4d7bd20a5b134ceba1d6ac3630e88707 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d7bd20a5b134ceba1d6ac3630e88707" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 41881 } }
I20260811 08:14:22.143939 3212 leader_election.cc:302] T 00000000000000000000000000000000 P 4d7bd20a5b134ceba1d6ac3630e88707 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4d7bd20a5b134ceba1d6ac3630e88707; no voters:
I20260811 08:14:22.144119 3212 leader_election.cc:288] T 00000000000000000000000000000000 P 4d7bd20a5b134ceba1d6ac3630e88707 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:14:22.144181 3218 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4d7bd20a5b134ceba1d6ac3630e88707 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:14:22.144384 3218 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4d7bd20a5b134ceba1d6ac3630e88707 [term 1 LEADER]: Becoming Leader. State: Replica: 4d7bd20a5b134ceba1d6ac3630e88707, State: Running, Role: LEADER
I20260811 08:14:22.144420 3212 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4d7bd20a5b134ceba1d6ac3630e88707 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:14:22.144505 3218 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4d7bd20a5b134ceba1d6ac3630e88707 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d7bd20a5b134ceba1d6ac3630e88707" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 41881 } }
I20260811 08:14:22.144881 3220 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d7bd20a5b134ceba1d6ac3630e88707 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4d7bd20a5b134ceba1d6ac3630e88707" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d7bd20a5b134ceba1d6ac3630e88707" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 41881 } } }
I20260811 08:14:22.144889 3223 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4d7bd20a5b134ceba1d6ac3630e88707 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4d7bd20a5b134ceba1d6ac3630e88707. Latest consensus state: current_term: 1 leader_uuid: "4d7bd20a5b134ceba1d6ac3630e88707" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4d7bd20a5b134ceba1d6ac3630e88707" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 41881 } } }
I20260811 08:14:22.145090 3223 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d7bd20a5b134ceba1d6ac3630e88707 [sys.catalog]: This master's current role is: LEADER
I20260811 08:14:22.145006 3220 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4d7bd20a5b134ceba1d6ac3630e88707 [sys.catalog]: This master's current role is: LEADER
I20260811 08:14:22.145557 3234 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:14:22.145994 3234 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:14:22.147598 3234 catalog_manager.cc:1347] Generated new cluster ID: 797dcbd74dd448f4a0c2ab881863b2e3
I20260811 08:14:22.147655 3234 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:14:22.162845 3234 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:14:22.163419 3234 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:14:22.168519 3234 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4d7bd20a5b134ceba1d6ac3630e88707: Generated new TSK 0
I20260811 08:14:22.168735 3234 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:14:22.177203 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:0
--local_ip_for_outbound_sockets=127.20.158.129
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:41881
--builtin_ntp_servers=127.20.158.148:35025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 08:14:22.260591 3249 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:14:22.260788 3249 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:14:22.260809 3249 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:14:22.261983 3249 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:14:22.262023 3249 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:14:22.262048 3249 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:14:22.263379 3249 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:35025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:41881
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3249
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:14:22.263665 3249 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:14:22.263973 3249 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:14:22.270179 3258 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:22.270226 3259 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:22.270179 3263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:22.270665 3249 server_base.cc:1034] running on GCE node
I20260811 08:14:22.270896 3249 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:14:22.271224 3249 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:14:22.272388 3249 hybrid_clock.cc:648] HybridClock initialized: now 1786436062272364 us; error 42 us; skew 500 ppm
I20260811 08:14:22.273876 3249 webserver.cc:460] Webserver started at http://127.20.158.129:42291/ using document root <none> and password file <none>
I20260811 08:14:22.274184 3249 fs_manager.cc:359] Metadata directory not provided
I20260811 08:14:22.274232 3249 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:14:22.274391 3249 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:14:22.275499 3249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/data/instance:
uuid: "0b6c6542f27f49269072852c45b6a1b9"
format_stamp: "Formatted at 2026-08-11 08:14:22 on dist-test-slave-gkw7"
server_key: "a0147f535b3dfab24fc94deaf01e9b64"
server_key_iv: "d1373b91e6aedaeb33743b268526e118"
server_key_version: "encryptionkey@0"
I20260811 08:14:22.275871 3249 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance:
uuid: "0b6c6542f27f49269072852c45b6a1b9"
format_stamp: "Formatted at 2026-08-11 08:14:22 on dist-test-slave-gkw7"
server_key: "a0147f535b3dfab24fc94deaf01e9b64"
server_key_iv: "d1373b91e6aedaeb33743b268526e118"
server_key_version: "encryptionkey@0"
I20260811 08:14:22.277272 3249 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:14:22.278123 3271 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:22.278321 3249 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:14:22.278424 3249 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "0b6c6542f27f49269072852c45b6a1b9"
format_stamp: "Formatted at 2026-08-11 08:14:22 on dist-test-slave-gkw7"
server_key: "a0147f535b3dfab24fc94deaf01e9b64"
server_key_iv: "d1373b91e6aedaeb33743b268526e118"
server_key_version: "encryptionkey@0"
I20260811 08:14:22.278496 3249 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:14:22.292681 3249 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:14:22.292954 3249 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:14:22.293058 3249 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:14:22.293239 3249 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:14:22.293654 3249 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:14:22.293695 3249 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:22.293747 3249 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:14:22.293772 3249 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:22.299831 3249 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:38233
I20260811 08:14:22.299875 3469 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:38233 every 8 connection(s)
I20260811 08:14:22.300258 3249 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:14:22.303165 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 3249
I20260811 08:14:22.303280 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance
I20260811 08:14:22.303495 21114 external_mini_cluster.cc:1428] Setting key 8a3e55797117d09865e367c0da34b14e
I20260811 08:14:22.304481 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:0
--local_ip_for_outbound_sockets=127.20.158.130
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:41881
--builtin_ntp_servers=127.20.158.148:35025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260811 08:14:22.306381 3215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:22.301103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:33471 (local address 127.20.158.190:41881)
0811 08:14:22.301174 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:22.301177 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:22.301458 (+ 281us) server_negotiation.cc:407] Connection header received
0811 08:14:22.302029 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:22.302030 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:22.302040 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:22.302100 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:22.302789 (+ 689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:22.303436 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:22.304816 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:22.305024 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:22.305102 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:22.306074 (+ 972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:22.306076 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:22.306076 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:14:22.306082 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:22.306109 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:14:22.306114 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:22.306182 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:22.306302 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 08:14:22.306323 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 08:14:22.306731 3473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:22.301103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:41881 (local address 127.20.158.129:33471)
0811 08:14:22.301334 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:22.301368 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:22.301940 (+ 572us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:22.302163 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:22.302166 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:22.302174 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:22.302689 (+ 515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:22.302694 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:22.303531 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:22.303532 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:22.304704 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:22.304708 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:22.305111 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:22.305112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:22.305258 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:22.305898 (+ 640us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:14:22.305898 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:22.305927 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:14:22.305950 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:14:22.306197 (+ 247us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:14:22.306206 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:14:22.306209 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:14:22.306284 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 08:14:22.306403 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":99,"threads_started":1}
I20260811 08:14:22.307322 3470 heartbeater.cc:347] Connected to a master server at 127.20.158.190:41881
I20260811 08:14:22.307433 3470 heartbeater.cc:464] Registering TS with master...
I20260811 08:14:22.307618 3470 heartbeater.cc:511] Master 127.20.158.190:41881 requested a full tablet report, sending...
I20260811 08:14:22.308123 3157 ts_manager.cc:194] Registered new tserver with Master: 0b6c6542f27f49269072852c45b6a1b9 (127.20.158.129:38233)
I20260811 08:14:22.309036 3157 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.158.129:33471
W20260811 08:14:22.390403 3474 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:14:22.390626 3474 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:14:22.390650 3474 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:14:22.391825 3474 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:14:22.391870 3474 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:14:22.391894 3474 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:14:22.393153 3474 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:35025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:41881
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3474
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:14:22.393340 3474 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:14:22.393615 3474 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:14:22.398712 3487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:22.398924 3474 server_base.cc:1034] running on GCE node
W20260811 08:14:22.398808 3483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:22.398713 3485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:22.399199 3474 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:14:22.399453 3474 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:14:22.400632 3474 hybrid_clock.cc:648] HybridClock initialized: now 1786436062400627 us; error 38 us; skew 500 ppm
I20260811 08:14:22.402051 3474 webserver.cc:460] Webserver started at http://127.20.158.130:42641/ using document root <none> and password file <none>
I20260811 08:14:22.402335 3474 fs_manager.cc:359] Metadata directory not provided
I20260811 08:14:22.402406 3474 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:14:22.402577 3474 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:14:22.403640 3474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/data/instance:
uuid: "280ec1cd28084c53a39650df84060d34"
format_stamp: "Formatted at 2026-08-11 08:14:22 on dist-test-slave-gkw7"
server_key: "38457da78ccc36b12796413cde790845"
server_key_iv: "9c6ee48ca85dd847c2a9cb7593408b8f"
server_key_version: "encryptionkey@0"
I20260811 08:14:22.404012 3474 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance:
uuid: "280ec1cd28084c53a39650df84060d34"
format_stamp: "Formatted at 2026-08-11 08:14:22 on dist-test-slave-gkw7"
server_key: "38457da78ccc36b12796413cde790845"
server_key_iv: "9c6ee48ca85dd847c2a9cb7593408b8f"
server_key_version: "encryptionkey@0"
I20260811 08:14:22.406126 3474 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 08:14:22.407205 3499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:22.407430 3474 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:14:22.407532 3474 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "280ec1cd28084c53a39650df84060d34"
format_stamp: "Formatted at 2026-08-11 08:14:22 on dist-test-slave-gkw7"
server_key: "38457da78ccc36b12796413cde790845"
server_key_iv: "9c6ee48ca85dd847c2a9cb7593408b8f"
server_key_version: "encryptionkey@0"
I20260811 08:14:22.407630 3474 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:14:22.416846 3474 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:14:22.417124 3474 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:14:22.417251 3474 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:14:22.417428 3474 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:14:22.417768 3474 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:14:22.417804 3474 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:22.417824 3474 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:14:22.417837 3474 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:22.423846 3474 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:45393
I20260811 08:14:22.423923 3678 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:45393 every 8 connection(s)
I20260811 08:14:22.424261 3474 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
I20260811 08:14:22.429407 3215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:22.425055 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:50825 (local address 127.20.158.190:41881)
0811 08:14:22.425129 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:22.425132 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:22.425378 (+ 246us) server_negotiation.cc:407] Connection header received
0811 08:14:22.425950 (+ 572us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:22.425951 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:22.425961 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:22.426024 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:22.426677 (+ 653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:22.427173 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:22.428143 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:22.428322 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:22.428373 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:22.429179 (+ 806us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:22.429180 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:22.429180 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:14:22.429185 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:22.429198 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:14:22.429202 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:22.429246 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:22.429325 (+ 79us) server_negotiation.cc:299] Negotiation successful
0811 08:14:22.429347 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 08:14:22.429682 3683 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:22.425025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:41881 (local address 127.20.158.130:50825)
0811 08:14:22.425250 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:22.425290 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:22.425861 (+ 571us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:22.426079 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:22.426082 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:22.426091 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:22.426604 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:22.426608 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:22.427263 (+ 655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:22.427264 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:22.428048 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:22.428050 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:22.428402 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:22.428402 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:22.428518 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:22.429043 (+ 525us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:14:22.429044 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:22.429071 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:14:22.429094 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:14:22.429258 (+ 164us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:14:22.429262 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:14:22.429265 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:14:22.429318 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 08:14:22.429398 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":114,"threads_started":1}
I20260811 08:14:22.430163 3681 heartbeater.cc:347] Connected to a master server at 127.20.158.190:41881
I20260811 08:14:22.430285 3681 heartbeater.cc:464] Registering TS with master...
I20260811 08:14:22.430474 3681 heartbeater.cc:511] Master 127.20.158.190:41881 requested a full tablet report, sending...
I20260811 08:14:22.430852 3157 ts_manager.cc:194] Registered new tserver with Master: 280ec1cd28084c53a39650df84060d34 (127.20.158.130:45393)
I20260811 08:14:22.431241 3157 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.158.130:50825
I20260811 08:14:22.431625 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 3474
I20260811 08:14:22.431707 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance
I20260811 08:14:22.431921 21114 external_mini_cluster.cc:1428] Setting key 126f578da6e61c9b0dbc6b16f453226f
I20260811 08:14:22.432899 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:0
--local_ip_for_outbound_sockets=127.20.158.131
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:41881
--builtin_ntp_servers=127.20.158.148:35025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260811 08:14:22.516394 3684 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:14:22.516634 3684 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:14:22.516667 3684 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:14:22.517957 3684 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:14:22.518021 3684 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:14:22.518077 3684 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:14:22.519402 3684 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:35025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:41881
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3684
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:14:22.519636 3684 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:14:22.519953 3684 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:14:22.525339 3691 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:22.525352 3696 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:22.525372 3690 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:22.525617 3684 server_base.cc:1034] running on GCE node
I20260811 08:14:22.525894 3684 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:14:22.526189 3684 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:14:22.527366 3684 hybrid_clock.cc:648] HybridClock initialized: now 1786436062527349 us; error 27 us; skew 500 ppm
I20260811 08:14:22.528626 3684 webserver.cc:460] Webserver started at http://127.20.158.131:35377/ using document root <none> and password file <none>
I20260811 08:14:22.528874 3684 fs_manager.cc:359] Metadata directory not provided
I20260811 08:14:22.528945 3684 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:14:22.529088 3684 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:14:22.530321 3684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/data/instance:
uuid: "832af920755f418a8c7741ae2d048f1b"
format_stamp: "Formatted at 2026-08-11 08:14:22 on dist-test-slave-gkw7"
server_key: "bee1b05832e3d8b3c1d28b27a741575c"
server_key_iv: "b07d4a8e133001844f656684eb13ff48"
server_key_version: "encryptionkey@0"
I20260811 08:14:22.530740 3684 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance:
uuid: "832af920755f418a8c7741ae2d048f1b"
format_stamp: "Formatted at 2026-08-11 08:14:22 on dist-test-slave-gkw7"
server_key: "bee1b05832e3d8b3c1d28b27a741575c"
server_key_iv: "b07d4a8e133001844f656684eb13ff48"
server_key_version: "encryptionkey@0"
I20260811 08:14:22.532143 3684 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:14:22.533106 3706 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:22.533354 3684 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:14:22.533469 3684 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "832af920755f418a8c7741ae2d048f1b"
format_stamp: "Formatted at 2026-08-11 08:14:22 on dist-test-slave-gkw7"
server_key: "bee1b05832e3d8b3c1d28b27a741575c"
server_key_iv: "b07d4a8e133001844f656684eb13ff48"
server_key_version: "encryptionkey@0"
I20260811 08:14:22.533568 3684 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:14:22.576162 3684 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:14:22.576566 3684 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:14:22.576743 3684 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:14:22.577023 3684 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:14:22.577406 3684 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:14:22.577467 3684 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:22.577510 3684 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:14:22.577579 3684 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:22.583912 3684 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:41141
I20260811 08:14:22.583956 3881 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:41141 every 8 connection(s)
I20260811 08:14:22.584357 3684 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
I20260811 08:14:22.589061 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 3684
I20260811 08:14:22.589195 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance
I20260811 08:14:22.589425 21114 external_mini_cluster.cc:1428] Setting key 94cb9a7218c9f299ebf8a10d8d6b7d76
I20260811 08:14:22.590139 3215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:22.585198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:39685 (local address 127.20.158.190:41881)
0811 08:14:22.585271 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:22.585273 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:22.585567 (+ 294us) server_negotiation.cc:407] Connection header received
0811 08:14:22.586140 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:22.586142 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:22.586155 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:22.586219 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:22.586914 (+ 695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:22.587420 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:22.588459 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:22.588663 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:22.588763 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:22.589807 (+ 1044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:22.589808 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:22.589809 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:14:22.589814 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:22.589833 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:14:22.589838 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:22.589907 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:22.590024 (+ 117us) server_negotiation.cc:299] Negotiation successful
0811 08:14:22.590056 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 08:14:22.590363 3886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:22.585215 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:41881 (local address 127.20.158.131:39685)
0811 08:14:22.585429 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:22.585464 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:22.586024 (+ 560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:22.586303 (+ 279us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:22.586306 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:22.586315 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:22.586812 (+ 497us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:22.586816 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:22.587526 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:22.587527 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:22.588339 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:22.588341 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:22.588776 (+ 435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:22.588777 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:22.588919 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:22.589632 (+ 713us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:14:22.589633 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:22.589678 (+ 45us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:14:22.589710 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:14:22.589927 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:14:22.589932 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:14:22.589936 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:14:22.590015 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 08:14:22.590132 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":92,"threads_started":1}
I20260811 08:14:22.590929 3882 heartbeater.cc:347] Connected to a master server at 127.20.158.190:41881
I20260811 08:14:22.591012 3882 heartbeater.cc:464] Registering TS with master...
I20260811 08:14:22.591156 3882 heartbeater.cc:511] Master 127.20.158.190:41881 requested a full tablet report, sending...
I20260811 08:14:22.591511 3157 ts_manager.cc:194] Registered new tserver with Master: 832af920755f418a8c7741ae2d048f1b (127.20.158.131:41141)
I20260811 08:14:22.591843 3157 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.158.131:39685
I20260811 08:14:22.601476 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 08:14:22.603612 3215 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:22.602957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39666 (local address 127.20.158.190:41881)
0811 08:14:22.603012 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:22.603014 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:22.603194 (+ 180us) server_negotiation.cc:407] Connection header received
0811 08:14:22.603271 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:22.603272 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:22.603285 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:22.603354 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:22.603523 (+ 169us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:39666: BlockingRecv error: recv got EOF from 127.0.0.1:39666 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 08:14:22.603648 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 3249
I20260811 08:14:22.620334 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 3474
I20260811 08:14:22.632293 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 3684
I20260811 08:14:22.638278 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 3106
2026-08-11T08:14:22Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (665 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-11T08:14:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:14:22Z Disabled control of system clock
I20260811 08:14:22.676198 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:34977
--webserver_interface=127.20.158.190
--webserver_port=0
--builtin_ntp_servers=127.20.158.148:42583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:34977
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 08:14:22.758864 3902 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:14:22.759073 3902 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:14:22.759095 3902 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:14:22.760289 3902 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:14:22.760332 3902 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:14:22.760345 3902 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:14:22.760358 3902 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:14:22.760370 3902 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:14:22.761739 3902 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:42583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:34977
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:34977
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3902
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:14:22.761960 3902 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:14:22.762210 3902 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:14:22.767094 3910 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:22.767163 3912 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:22.767153 3909 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:22.767473 3902 server_base.cc:1034] running on GCE node
I20260811 08:14:22.767735 3902 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:14:22.767982 3902 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:14:22.769150 3902 hybrid_clock.cc:648] HybridClock initialized: now 1786436062769125 us; error 40 us; skew 500 ppm
I20260811 08:14:22.770481 3902 webserver.cc:460] Webserver started at http://127.20.158.190:42511/ using document root <none> and password file <none>
I20260811 08:14:22.770722 3902 fs_manager.cc:359] Metadata directory not provided
I20260811 08:14:22.770769 3902 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:14:22.770925 3902 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:14:22.771998 3902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "d7573c47d3304dfe90aa4fd5bbcef435"
format_stamp: "Formatted at 2026-08-11 08:14:22 on dist-test-slave-gkw7"
server_key: "edb4ca60ad209ed315b15503769db278"
server_key_iv: "4994e51811a70a8a62405b011fa917f5"
server_key_version: "encryptionkey@0"
I20260811 08:14:22.772373 3902 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "d7573c47d3304dfe90aa4fd5bbcef435"
format_stamp: "Formatted at 2026-08-11 08:14:22 on dist-test-slave-gkw7"
server_key: "edb4ca60ad209ed315b15503769db278"
server_key_iv: "4994e51811a70a8a62405b011fa917f5"
server_key_version: "encryptionkey@0"
I20260811 08:14:22.773751 3902 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:14:22.774551 3921 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:22.774739 3902 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:14:22.774837 3902 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "d7573c47d3304dfe90aa4fd5bbcef435"
format_stamp: "Formatted at 2026-08-11 08:14:22 on dist-test-slave-gkw7"
server_key: "edb4ca60ad209ed315b15503769db278"
server_key_iv: "4994e51811a70a8a62405b011fa917f5"
server_key_version: "encryptionkey@0"
I20260811 08:14:22.774914 3902 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:14:22.778491 3902 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:14:22.778782 3902 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:14:22.778924 3902 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:14:22.783020 3902 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:34977
I20260811 08:14:22.783062 4004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:34977 every 8 connection(s)
I20260811 08:14:22.783396 3902 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:14:22.784108 4005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:14:22.786948 4005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7573c47d3304dfe90aa4fd5bbcef435: Bootstrap starting.
I20260811 08:14:22.787489 4005 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d7573c47d3304dfe90aa4fd5bbcef435: Neither blocks nor log segments found. Creating new log.
I20260811 08:14:22.787738 4005 log.cc:824] T 00000000000000000000000000000000 P d7573c47d3304dfe90aa4fd5bbcef435: Log is configured to *not* fsync() on all Append() calls
I20260811 08:14:22.788416 4005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d7573c47d3304dfe90aa4fd5bbcef435: No bootstrap required, opened a new log
I20260811 08:14:22.790082 4005 raft_consensus.cc:348] T 00000000000000000000000000000000 P d7573c47d3304dfe90aa4fd5bbcef435 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7573c47d3304dfe90aa4fd5bbcef435" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34977 } }
I20260811 08:14:22.790225 4005 raft_consensus.cc:374] T 00000000000000000000000000000000 P d7573c47d3304dfe90aa4fd5bbcef435 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:14:22.790251 4005 raft_consensus.cc:729] T 00000000000000000000000000000000 P d7573c47d3304dfe90aa4fd5bbcef435 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7573c47d3304dfe90aa4fd5bbcef435, State: Initialized, Role: FOLLOWER
I20260811 08:14:22.790395 4005 consensus_queue.cc:260] T 00000000000000000000000000000000 P d7573c47d3304dfe90aa4fd5bbcef435 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7573c47d3304dfe90aa4fd5bbcef435" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34977 } }
I20260811 08:14:22.790481 4005 raft_consensus.cc:388] T 00000000000000000000000000000000 P d7573c47d3304dfe90aa4fd5bbcef435 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:14:22.790505 4005 raft_consensus.cc:482] T 00000000000000000000000000000000 P d7573c47d3304dfe90aa4fd5bbcef435 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:14:22.790534 4005 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d7573c47d3304dfe90aa4fd5bbcef435 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:14:22.790773 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 3902
I20260811 08:14:22.790874 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:14:22.791074 21114 external_mini_cluster.cc:1428] Setting key c79ee04a870ab4f93f9b7f295cb79852
I20260811 08:14:22.791335 4005 raft_consensus.cc:504] T 00000000000000000000000000000000 P d7573c47d3304dfe90aa4fd5bbcef435 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7573c47d3304dfe90aa4fd5bbcef435" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34977 } }
I20260811 08:14:22.791426 4005 leader_election.cc:302] T 00000000000000000000000000000000 P d7573c47d3304dfe90aa4fd5bbcef435 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d7573c47d3304dfe90aa4fd5bbcef435; no voters:
I20260811 08:14:22.791635 4005 leader_election.cc:288] T 00000000000000000000000000000000 P d7573c47d3304dfe90aa4fd5bbcef435 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:14:22.791718 4009 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d7573c47d3304dfe90aa4fd5bbcef435 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:14:22.791941 4009 raft_consensus.cc:686] T 00000000000000000000000000000000 P d7573c47d3304dfe90aa4fd5bbcef435 [term 1 LEADER]: Becoming Leader. State: Replica: d7573c47d3304dfe90aa4fd5bbcef435, State: Running, Role: LEADER
I20260811 08:14:22.792042 4005 sys_catalog.cc:564] T 00000000000000000000000000000000 P d7573c47d3304dfe90aa4fd5bbcef435 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:14:22.792083 4009 consensus_queue.cc:237] T 00000000000000000000000000000000 P d7573c47d3304dfe90aa4fd5bbcef435 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7573c47d3304dfe90aa4fd5bbcef435" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34977 } }
I20260811 08:14:22.792798 4015 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7573c47d3304dfe90aa4fd5bbcef435 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7573c47d3304dfe90aa4fd5bbcef435. Latest consensus state: current_term: 1 leader_uuid: "d7573c47d3304dfe90aa4fd5bbcef435" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7573c47d3304dfe90aa4fd5bbcef435" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34977 } } }
I20260811 08:14:22.792881 4015 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7573c47d3304dfe90aa4fd5bbcef435 [sys.catalog]: This master's current role is: LEADER
I20260811 08:14:22.793303 4013 sys_catalog.cc:455] T 00000000000000000000000000000000 P d7573c47d3304dfe90aa4fd5bbcef435 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d7573c47d3304dfe90aa4fd5bbcef435" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d7573c47d3304dfe90aa4fd5bbcef435" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34977 } } }
I20260811 08:14:22.793433 4013 sys_catalog.cc:458] T 00000000000000000000000000000000 P d7573c47d3304dfe90aa4fd5bbcef435 [sys.catalog]: This master's current role is: LEADER
W20260811 08:14:22.794124 4034 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d7573c47d3304dfe90aa4fd5bbcef435: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260811 08:14:22.794155 4012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:22.791648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47358 (local address 127.20.158.190:34977)
0811 08:14:22.791875 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:22.791885 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:22.792091 (+ 206us) server_negotiation.cc:407] Connection header received
0811 08:14:22.792340 (+ 249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:22.792348 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:22.792396 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:22.792512 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:22.793688 (+ 1176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:22.793692 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:22.793693 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:14:22.793697 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:22.793748 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:14:22.793764 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:22.793837 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:22.793913 (+ 76us) server_negotiation.cc:299] Negotiation successful
0811 08:14:22.793974 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":86,"threads_started":1}
W20260811 08:14:22.794216 4034 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:14:22.794394 4022 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:14:22.794610 4022 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:14:22.796159 4022 catalog_manager.cc:1347] Generated new cluster ID: a90df18d44e74a3bb23cd0b008809361
I20260811 08:14:22.796221 4022 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:14:22.814967 4022 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:14:22.815224 4022 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:14:22.820214 4022 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d7573c47d3304dfe90aa4fd5bbcef435: Generated new TSK 0
I20260811 08:14:22.820446 4022 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:14:22.822484 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:0
--local_ip_for_outbound_sockets=127.20.158.129
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:34977
--builtin_ntp_servers=127.20.158.148:42583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 08:14:22.908098 4039 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:14:22.908321 4039 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:14:22.908345 4039 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:14:22.909611 4039 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:14:22.909654 4039 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:14:22.909682 4039 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:14:22.911077 4039 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:42583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:34977
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4039
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:14:22.911347 4039 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:14:22.911657 4039 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:14:22.918103 4050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:22.918147 4056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:22.918111 4048 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:22.918304 4039 server_base.cc:1034] running on GCE node
I20260811 08:14:22.918591 4039 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:14:22.918859 4039 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:14:22.920017 4039 hybrid_clock.cc:648] HybridClock initialized: now 1786436062920003 us; error 30 us; skew 500 ppm
I20260811 08:14:22.921460 4039 webserver.cc:460] Webserver started at http://127.20.158.129:43279/ using document root <none> and password file <none>
I20260811 08:14:22.921757 4039 fs_manager.cc:359] Metadata directory not provided
I20260811 08:14:22.921826 4039 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:14:22.921952 4039 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:14:22.923487 4039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/data/instance:
uuid: "65d240e0e1d7476f9c602ed0fe3c5123"
format_stamp: "Formatted at 2026-08-11 08:14:22 on dist-test-slave-gkw7"
server_key: "02a8cd3e85c5e92edd594ac3be93fdac"
server_key_iv: "563b25c3d4d97c1a85d5de6980fb0c01"
server_key_version: "encryptionkey@0"
I20260811 08:14:22.923926 4039 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance:
uuid: "65d240e0e1d7476f9c602ed0fe3c5123"
format_stamp: "Formatted at 2026-08-11 08:14:22 on dist-test-slave-gkw7"
server_key: "02a8cd3e85c5e92edd594ac3be93fdac"
server_key_iv: "563b25c3d4d97c1a85d5de6980fb0c01"
server_key_version: "encryptionkey@0"
I20260811 08:14:22.925583 4039 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260811 08:14:22.926512 4064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:22.926694 4039 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:14:22.926807 4039 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "65d240e0e1d7476f9c602ed0fe3c5123"
format_stamp: "Formatted at 2026-08-11 08:14:22 on dist-test-slave-gkw7"
server_key: "02a8cd3e85c5e92edd594ac3be93fdac"
server_key_iv: "563b25c3d4d97c1a85d5de6980fb0c01"
server_key_version: "encryptionkey@0"
I20260811 08:14:22.926889 4039 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:14:22.930423 4039 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:14:22.930706 4039 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:14:22.930857 4039 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:14:22.931089 4039 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:14:22.931417 4039 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:14:22.931456 4039 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:22.931512 4039 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:14:22.931540 4039 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:22.937237 4039 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:40357
I20260811 08:14:22.937316 4242 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:40357 every 8 connection(s)
I20260811 08:14:22.937703 4039 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:14:22.938433 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 4039
I20260811 08:14:22.938550 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance
I20260811 08:14:22.938786 21114 external_mini_cluster.cc:1428] Setting key 2882e714afefc304f77360e994b9d786
I20260811 08:14:22.939832 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:0
--local_ip_for_outbound_sockets=127.20.158.130
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:34977
--builtin_ntp_servers=127.20.158.148:42583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260811 08:14:22.941134 4012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:22.938578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:60019 (local address 127.20.158.190:34977)
0811 08:14:22.938661 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:22.938665 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:22.938910 (+ 245us) server_negotiation.cc:407] Connection header received
0811 08:14:22.939476 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:22.939477 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:22.939482 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:22.939573 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:22.940850 (+ 1277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:22.940852 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:22.940852 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:14:22.940857 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:22.940878 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:14:22.940883 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:22.940948 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:22.941013 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 08:14:22.941030 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 08:14:22.941344 4245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:22.938540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:34977 (local address 127.20.158.129:60019)
0811 08:14:22.938761 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:22.938805 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:22.939355 (+ 550us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:22.939658 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:22.939662 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:22.939671 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:22.940681 (+ 1010us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:14:22.940681 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:22.940709 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:14:22.940747 (+ 38us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:14:22.940954 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:14:22.940960 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:14:22.940962 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:14:22.941022 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 08:14:22.941073 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":112,"threads_started":1}
I20260811 08:14:22.941866 4243 heartbeater.cc:347] Connected to a master server at 127.20.158.190:34977
I20260811 08:14:22.941967 4243 heartbeater.cc:464] Registering TS with master...
I20260811 08:14:22.942129 4243 heartbeater.cc:511] Master 127.20.158.190:34977 requested a full tablet report, sending...
I20260811 08:14:22.942687 3947 ts_manager.cc:194] Registered new tserver with Master: 65d240e0e1d7476f9c602ed0fe3c5123 (127.20.158.129:40357)
W20260811 08:14:23.024089 4246 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:14:23.024294 4246 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:14:23.024317 4246 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:14:23.025493 4246 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:14:23.025590 4246 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:14:23.025640 4246 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:14:23.027001 4246 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:42583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:34977
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4246
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:14:23.027272 4246 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:14:23.027581 4246 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:14:23.032919 4258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:23.032924 4254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:23.033167 4246 server_base.cc:1034] running on GCE node
W20260811 08:14:23.032927 4253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:23.033572 4246 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:14:23.033847 4246 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:14:23.035014 4246 hybrid_clock.cc:648] HybridClock initialized: now 1786436063034992 us; error 46 us; skew 500 ppm
I20260811 08:14:23.036319 4246 webserver.cc:460] Webserver started at http://127.20.158.130:45619/ using document root <none> and password file <none>
I20260811 08:14:23.036582 4246 fs_manager.cc:359] Metadata directory not provided
I20260811 08:14:23.036656 4246 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:14:23.036831 4246 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:14:23.038033 4246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/data/instance:
uuid: "7c152270c99647978ca25d6831e3f91e"
format_stamp: "Formatted at 2026-08-11 08:14:23 on dist-test-slave-gkw7"
server_key: "60a5434d992a1021b94b983222e4f64e"
server_key_iv: "f070f296bbd9b302511c5497020623c2"
server_key_version: "encryptionkey@0"
I20260811 08:14:23.038426 4246 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance:
uuid: "7c152270c99647978ca25d6831e3f91e"
format_stamp: "Formatted at 2026-08-11 08:14:23 on dist-test-slave-gkw7"
server_key: "60a5434d992a1021b94b983222e4f64e"
server_key_iv: "f070f296bbd9b302511c5497020623c2"
server_key_version: "encryptionkey@0"
I20260811 08:14:23.039819 4246 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:14:23.040632 4269 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:23.040844 4246 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:14:23.040954 4246 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "7c152270c99647978ca25d6831e3f91e"
format_stamp: "Formatted at 2026-08-11 08:14:23 on dist-test-slave-gkw7"
server_key: "60a5434d992a1021b94b983222e4f64e"
server_key_iv: "f070f296bbd9b302511c5497020623c2"
server_key_version: "encryptionkey@0"
I20260811 08:14:23.041034 4246 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:14:23.044579 4246 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:14:23.044865 4246 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:14:23.045012 4246 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:14:23.045229 4246 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:14:23.045629 4246 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:14:23.045697 4246 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:23.045746 4246 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:14:23.045774 4246 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:23.051705 4246 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:35345
I20260811 08:14:23.051745 4444 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:35345 every 8 connection(s)
I20260811 08:14:23.052109 4246 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
I20260811 08:14:23.055312 4012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:23.052953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:43615 (local address 127.20.158.190:34977)
0811 08:14:23.053025 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:23.053027 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:23.053245 (+ 218us) server_negotiation.cc:407] Connection header received
0811 08:14:23.053835 (+ 590us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:23.053837 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:23.053852 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:23.053918 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:23.055064 (+ 1146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:23.055065 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:23.055065 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:14:23.055070 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:23.055087 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:14:23.055091 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:23.055171 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:23.055233 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 08:14:23.055247 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 08:14:23.055511 4447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:23.052928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:34977 (local address 127.20.158.130:43615)
0811 08:14:23.053115 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:23.053155 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:23.053701 (+ 546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:23.053979 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:23.053983 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:23.053991 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:23.054905 (+ 914us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:14:23.054906 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:23.054935 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:14:23.054965 (+ 30us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:14:23.055166 (+ 201us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:14:23.055169 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:14:23.055171 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:14:23.055224 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 08:14:23.055274 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":82,"threads_started":1}
I20260811 08:14:23.056063 4445 heartbeater.cc:347] Connected to a master server at 127.20.158.190:34977
I20260811 08:14:23.056120 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 4246
I20260811 08:14:23.056190 4445 heartbeater.cc:464] Registering TS with master...
I20260811 08:14:23.056234 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance
I20260811 08:14:23.056354 4445 heartbeater.cc:511] Master 127.20.158.190:34977 requested a full tablet report, sending...
I20260811 08:14:23.056504 21114 external_mini_cluster.cc:1428] Setting key 4a8f6967b3003a0b9361b21808cedc64
I20260811 08:14:23.056743 3947 ts_manager.cc:194] Registered new tserver with Master: 7c152270c99647978ca25d6831e3f91e (127.20.158.130:35345)
I20260811 08:14:23.057583 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:0
--local_ip_for_outbound_sockets=127.20.158.131
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:34977
--builtin_ntp_servers=127.20.158.148:42583
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260811 08:14:23.141104 4449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:14:23.141327 4449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:14:23.141350 4449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:14:23.143021 4449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:14:23.143069 4449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:14:23.143122 4449 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:14:23.144665 4449 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:42583
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:34977
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4449
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:14:23.144960 4449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:14:23.145295 4449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:14:23.150457 4461 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:23.150486 4460 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:23.150458 4464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:23.150731 4449 server_base.cc:1034] running on GCE node
I20260811 08:14:23.150941 4449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:14:23.151189 4449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:14:23.152356 4449 hybrid_clock.cc:648] HybridClock initialized: now 1786436063152348 us; error 38 us; skew 500 ppm
I20260811 08:14:23.153791 4449 webserver.cc:460] Webserver started at http://127.20.158.131:41371/ using document root <none> and password file <none>
I20260811 08:14:23.154039 4449 fs_manager.cc:359] Metadata directory not provided
I20260811 08:14:23.154160 4449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:14:23.154317 4449 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:14:23.155397 4449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/data/instance:
uuid: "f7e7586d5cf947ce8b115d4b07ae51ad"
format_stamp: "Formatted at 2026-08-11 08:14:23 on dist-test-slave-gkw7"
server_key: "fbf4dd2399ebe5736ce1cbb2464a21c6"
server_key_iv: "4d6ac6059f39ead9d9147e0cf7f4b84b"
server_key_version: "encryptionkey@0"
I20260811 08:14:23.155773 4449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance:
uuid: "f7e7586d5cf947ce8b115d4b07ae51ad"
format_stamp: "Formatted at 2026-08-11 08:14:23 on dist-test-slave-gkw7"
server_key: "fbf4dd2399ebe5736ce1cbb2464a21c6"
server_key_iv: "4d6ac6059f39ead9d9147e0cf7f4b84b"
server_key_version: "encryptionkey@0"
I20260811 08:14:23.157140 4449 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:14:23.157980 4477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:23.158161 4449 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:23.158269 4449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "f7e7586d5cf947ce8b115d4b07ae51ad"
format_stamp: "Formatted at 2026-08-11 08:14:23 on dist-test-slave-gkw7"
server_key: "fbf4dd2399ebe5736ce1cbb2464a21c6"
server_key_iv: "4d6ac6059f39ead9d9147e0cf7f4b84b"
server_key_version: "encryptionkey@0"
I20260811 08:14:23.158357 4449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:14:23.161755 4449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:14:23.162045 4449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:14:23.162199 4449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:14:23.162411 4449 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:14:23.162729 4449 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:14:23.162784 4449 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:23.162824 4449 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:14:23.162845 4449 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:23.168717 4449 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:37481
I20260811 08:14:23.168804 4670 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:37481 every 8 connection(s)
I20260811 08:14:23.169124 4449 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
I20260811 08:14:23.172166 4012 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:23.169843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:55893 (local address 127.20.158.190:34977)
0811 08:14:23.169888 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:23.169890 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:23.170136 (+ 246us) server_negotiation.cc:407] Connection header received
0811 08:14:23.170651 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:23.170653 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:23.170659 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:23.170724 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:23.171886 (+ 1162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:23.171888 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:23.171888 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:14:23.171893 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:23.171910 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:14:23.171914 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:23.171975 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:23.172070 (+ 95us) server_negotiation.cc:299] Negotiation successful
0811 08:14:23.172087 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:14:23.172358 4676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:23.169817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:34977 (local address 127.20.158.131:55893)
0811 08:14:23.170003 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:23.170036 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:23.170519 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:23.170793 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:23.170797 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:23.170808 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:23.171728 (+ 920us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:14:23.171729 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:23.171755 (+ 26us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:14:23.171783 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:14:23.171974 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:14:23.171979 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:14:23.171982 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:14:23.172081 (+ 99us) client_negotiation.cc:240] Negotiation successful
0811 08:14:23.172143 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":70,"threads_started":1}
I20260811 08:14:23.172888 4674 heartbeater.cc:347] Connected to a master server at 127.20.158.190:34977
I20260811 08:14:23.172971 4674 heartbeater.cc:464] Registering TS with master...
I20260811 08:14:23.173086 4674 heartbeater.cc:511] Master 127.20.158.190:34977 requested a full tablet report, sending...
I20260811 08:14:23.173359 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 4449
I20260811 08:14:23.173480 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance
I20260811 08:14:23.173491 3946 ts_manager.cc:194] Registered new tserver with Master: f7e7586d5cf947ce8b115d4b07ae51ad (127.20.158.131:37481)
I20260811 08:14:23.173712 21114 external_mini_cluster.cc:1428] Setting key d1def709b3c1cf5946cbe1986c600bec
I20260811 08:14:23.174574 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260811 08:14:23.176360 4012 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:14:23.175922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47370 (local address 127.20.158.190:34977)
0811 08:14:23.175972 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:23.175974 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:23.176039 (+ 65us) server_negotiation.cc:407] Connection header received
0811 08:14:23.176113 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:23.176114 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:23.176119 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:23.176171 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:23.176300 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:47370: BlockingRecv error: recv got EOF from 127.0.0.1:47370 (error 108)
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 08:14:23.176447 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 4039
I20260811 08:14:23.190631 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 4246
I20260811 08:14:23.200703 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 4449
I20260811 08:14:23.214798 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 3902
2026-08-11T08:14:23Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (573 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:14:23 dist-test-slave-gkw7 krb5kdc[4688](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:14:23 dist-test-slave-gkw7 krb5kdc[4688](info): set up 2 sockets
Aug 11 08:14:23 dist-test-slave-gkw7 krb5kdc[4688](info): commencing operation
krb5kdc: starting...
W20260811 08:14:24.469224 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.227s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:14:24 dist-test-slave-gkw7 krb5kdc[4688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436064, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:14:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:14:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:14:24.597143 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:45247
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:44383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:45247
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:14:24.681262 4711 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:14:24.681535 4711 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:14:24.681594 4711 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:14:24.682830 4711 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:14:24.682909 4711 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:14:24.682933 4711 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:14:24.682955 4711 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:14:24.682984 4711 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:14:24.684531 4711 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:44383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:45247
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:45247
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4711
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:14:24.684841 4711 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:14:24.685089 4711 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:14:24.690213 4719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:24.690263 4724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:24.690263 4718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:24.690439 4711 server_base.cc:1034] running on GCE node
I20260811 08:14:24.690694 4711 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:14:24.691021 4711 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:14:24.692178 4711 hybrid_clock.cc:648] HybridClock initialized: now 1786436064692150 us; error 40 us; skew 500 ppm
Aug 11 08:14:24 dist-test-slave-gkw7 krb5kdc[4688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436064, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:14:24.694819 4711 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:14:24.695329 4711 webserver.cc:460] Webserver started at http://127.20.158.190:42449/ using document root <none> and password file <none>
I20260811 08:14:24.695571 4711 fs_manager.cc:359] Metadata directory not provided
I20260811 08:14:24.695619 4711 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:14:24.695768 4711 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:14:24.696906 4711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "129d497e5fbc4a38a93ca0c68a94aa30"
format_stamp: "Formatted at 2026-08-11 08:14:24 on dist-test-slave-gkw7"
server_key: "874f6d3b899dbe36b6b4ef41c1d821f0"
server_key_iv: "433f0f2b801a0b530ba5f73e026a8f76"
server_key_version: "encryptionkey@0"
I20260811 08:14:24.697288 4711 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "129d497e5fbc4a38a93ca0c68a94aa30"
format_stamp: "Formatted at 2026-08-11 08:14:24 on dist-test-slave-gkw7"
server_key: "874f6d3b899dbe36b6b4ef41c1d821f0"
server_key_iv: "433f0f2b801a0b530ba5f73e026a8f76"
server_key_version: "encryptionkey@0"
I20260811 08:14:24.698815 4711 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:14:24.699680 4736 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:24.699890 4711 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:14:24.700003 4711 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "129d497e5fbc4a38a93ca0c68a94aa30"
format_stamp: "Formatted at 2026-08-11 08:14:24 on dist-test-slave-gkw7"
server_key: "874f6d3b899dbe36b6b4ef41c1d821f0"
server_key_iv: "433f0f2b801a0b530ba5f73e026a8f76"
server_key_version: "encryptionkey@0"
I20260811 08:14:24.700084 4711 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:14:24.717762 4711 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:14:24.719920 4711 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:14:24.720041 4711 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:14:24.724442 4711 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:45247
I20260811 08:14:24.724522 4810 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:45247 every 8 connection(s)
I20260811 08:14:24.724895 4711 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:14:24.725934 4811 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:14:24.728302 4811 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 129d497e5fbc4a38a93ca0c68a94aa30: Bootstrap starting.
I20260811 08:14:24.728955 4811 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 129d497e5fbc4a38a93ca0c68a94aa30: Neither blocks nor log segments found. Creating new log.
I20260811 08:14:24.729269 4811 log.cc:824] T 00000000000000000000000000000000 P 129d497e5fbc4a38a93ca0c68a94aa30: Log is configured to *not* fsync() on all Append() calls
I20260811 08:14:24.730064 4811 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 129d497e5fbc4a38a93ca0c68a94aa30: No bootstrap required, opened a new log
I20260811 08:14:24.731721 4811 raft_consensus.cc:348] T 00000000000000000000000000000000 P 129d497e5fbc4a38a93ca0c68a94aa30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "129d497e5fbc4a38a93ca0c68a94aa30" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 45247 } }
I20260811 08:14:24.731869 4811 raft_consensus.cc:374] T 00000000000000000000000000000000 P 129d497e5fbc4a38a93ca0c68a94aa30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:14:24.731894 4811 raft_consensus.cc:729] T 00000000000000000000000000000000 P 129d497e5fbc4a38a93ca0c68a94aa30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 129d497e5fbc4a38a93ca0c68a94aa30, State: Initialized, Role: FOLLOWER
I20260811 08:14:24.732069 4811 consensus_queue.cc:260] T 00000000000000000000000000000000 P 129d497e5fbc4a38a93ca0c68a94aa30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "129d497e5fbc4a38a93ca0c68a94aa30" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 45247 } }
I20260811 08:14:24.732154 4811 raft_consensus.cc:388] T 00000000000000000000000000000000 P 129d497e5fbc4a38a93ca0c68a94aa30 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:14:24.732198 4811 raft_consensus.cc:482] T 00000000000000000000000000000000 P 129d497e5fbc4a38a93ca0c68a94aa30 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:14:24.732251 4811 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 129d497e5fbc4a38a93ca0c68a94aa30 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:14:24.733184 4811 raft_consensus.cc:504] T 00000000000000000000000000000000 P 129d497e5fbc4a38a93ca0c68a94aa30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "129d497e5fbc4a38a93ca0c68a94aa30" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 45247 } }
I20260811 08:14:24.733237 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 4711
I20260811 08:14:24.733340 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:14:24.733315 4811 leader_election.cc:302] T 00000000000000000000000000000000 P 129d497e5fbc4a38a93ca0c68a94aa30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 129d497e5fbc4a38a93ca0c68a94aa30; no voters:
I20260811 08:14:24.733500 4811 leader_election.cc:288] T 00000000000000000000000000000000 P 129d497e5fbc4a38a93ca0c68a94aa30 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:14:24.733595 21114 external_mini_cluster.cc:1428] Setting key ad654711a3b7941c9c9ec56bebf20bda
I20260811 08:14:24.733577 4815 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 129d497e5fbc4a38a93ca0c68a94aa30 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:14:24.733731 4815 raft_consensus.cc:686] T 00000000000000000000000000000000 P 129d497e5fbc4a38a93ca0c68a94aa30 [term 1 LEADER]: Becoming Leader. State: Replica: 129d497e5fbc4a38a93ca0c68a94aa30, State: Running, Role: LEADER
I20260811 08:14:24.733834 4815 consensus_queue.cc:237] T 00000000000000000000000000000000 P 129d497e5fbc4a38a93ca0c68a94aa30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "129d497e5fbc4a38a93ca0c68a94aa30" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 45247 } }
I20260811 08:14:24.733850 4811 sys_catalog.cc:564] T 00000000000000000000000000000000 P 129d497e5fbc4a38a93ca0c68a94aa30 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:14:24.734189 4818 sys_catalog.cc:455] T 00000000000000000000000000000000 P 129d497e5fbc4a38a93ca0c68a94aa30 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "129d497e5fbc4a38a93ca0c68a94aa30" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "129d497e5fbc4a38a93ca0c68a94aa30" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 45247 } } }
I20260811 08:14:24.734279 4818 sys_catalog.cc:458] T 00000000000000000000000000000000 P 129d497e5fbc4a38a93ca0c68a94aa30 [sys.catalog]: This master's current role is: LEADER
I20260811 08:14:24.734162 4815 sys_catalog.cc:455] T 00000000000000000000000000000000 P 129d497e5fbc4a38a93ca0c68a94aa30 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 129d497e5fbc4a38a93ca0c68a94aa30. Latest consensus state: current_term: 1 leader_uuid: "129d497e5fbc4a38a93ca0c68a94aa30" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "129d497e5fbc4a38a93ca0c68a94aa30" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 45247 } } }
I20260811 08:14:24.734376 4815 sys_catalog.cc:458] T 00000000000000000000000000000000 P 129d497e5fbc4a38a93ca0c68a94aa30 [sys.catalog]: This master's current role is: LEADER
I20260811 08:14:24.734632 4829 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:14:24.735293 4829 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:14:24.737701 4829 catalog_manager.cc:1347] Generated new cluster ID: 5d2985cd6d2b4c12984fc8b29bc7114d
I20260811 08:14:24.737771 4829 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:14:24 dist-test-slave-gkw7 krb5kdc[4688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436064, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:14:24.746754 4824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:24.734264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40266 (local address 127.20.158.190:45247)
0811 08:14:24.734482 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:24.734492 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:24.734746 (+ 254us) server_negotiation.cc:407] Connection header received
0811 08:14:24.734982 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:24.734992 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:24.735067 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:24.735241 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:24.736296 (+ 1055us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:24.737519 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:24.738621 (+ 1102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:24.739269 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:24.739401 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:24.742270 (+ 2869us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:24.742275 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:24.742275 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:14:24.742310 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:24.744957 (+ 2647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:24.745391 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:24.745394 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:24.745395 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:24.745517 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:24.745766 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:24.745767 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:24.745767 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:24.746092 (+ 325us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:24.746257 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:24.746377 (+ 120us) server_negotiation.cc:299] Negotiation successful
0811 08:14:24.746516 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":159,"thread_start_us":70,"threads_started":1}
I20260811 08:14:24.752547 4829 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:14:24.753260 4829 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:14:24.770021 4829 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 129d497e5fbc4a38a93ca0c68a94aa30: Generated new TSK 0
I20260811 08:14:24.770246 4829 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.158.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
I20260811 08:14:24.800937 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:0
--local_ip_for_outbound_sockets=127.20.158.129
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:45247
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:44383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:14:24.886076 4856 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:14:24.886343 4856 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:14:24.886387 4856 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:14:24.887576 4856 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:14:24.887657 4856 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:14:24.887704 4856 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:14:24.889278 4856 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:44383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:45247
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4856
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:14:24.889616 4856 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:14:24.889896 4856 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:14:24.895548 4856 server_base.cc:1034] running on GCE node
W20260811 08:14:24.895551 4861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:24.895565 4864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:24.895704 4862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:24.895958 4856 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:14:24.896193 4856 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:14:24.897351 4856 hybrid_clock.cc:648] HybridClock initialized: now 1786436064897321 us; error 51 us; skew 500 ppm
Aug 11 08:14:24 dist-test-slave-gkw7 krb5kdc[4688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436064, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:14:24.900051 4856 init.cc:377] Logged in from keytab as kudu/127.20.158.129@KRBTEST.COM (short username kudu)
I20260811 08:14:24.900534 4856 webserver.cc:460] Webserver started at http://127.20.158.129:38101/ using document root <none> and password file <none>
I20260811 08:14:24.900802 4856 fs_manager.cc:359] Metadata directory not provided
I20260811 08:14:24.900851 4856 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:14:24.901059 4856 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:14:24.902283 4856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/data/instance:
uuid: "1112a4d85b0f4293a095d13b251a170e"
format_stamp: "Formatted at 2026-08-11 08:14:24 on dist-test-slave-gkw7"
server_key: "bbaf8ce01447891815e0c4012403cfb0"
server_key_iv: "7f35c34214b52df6182e19331afbd61a"
server_key_version: "encryptionkey@0"
I20260811 08:14:24.902721 4856 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance:
uuid: "1112a4d85b0f4293a095d13b251a170e"
format_stamp: "Formatted at 2026-08-11 08:14:24 on dist-test-slave-gkw7"
server_key: "bbaf8ce01447891815e0c4012403cfb0"
server_key_iv: "7f35c34214b52df6182e19331afbd61a"
server_key_version: "encryptionkey@0"
I20260811 08:14:24.904212 4856 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:14:24.904990 4875 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:24.905179 4856 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:14:24.905299 4856 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "1112a4d85b0f4293a095d13b251a170e"
format_stamp: "Formatted at 2026-08-11 08:14:24 on dist-test-slave-gkw7"
server_key: "bbaf8ce01447891815e0c4012403cfb0"
server_key_iv: "7f35c34214b52df6182e19331afbd61a"
server_key_version: "encryptionkey@0"
I20260811 08:14:24.905373 4856 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:14:24.916076 4856 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:14:24.918134 4856 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:14:24.918334 4856 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:14:24.918589 4856 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:14:24.918927 4856 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:14:24.918989 4856 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:24.919034 4856 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:14:24.919078 4856 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:24.925388 4856 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:43905
I20260811 08:14:24.925446 5040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:43905 every 8 connection(s)
I20260811 08:14:24.925804 4856 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:14:24.927034 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 4856
I20260811 08:14:24.927156 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance
I20260811 08:14:24.927371 21114 external_mini_cluster.cc:1428] Setting key 9185a6ca3e6da3323fcaee2b0e29e59a
Aug 11 08:14:24 dist-test-slave-gkw7 krb5kdc[4688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436064, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:14:24.936892 4824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:24.926554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:47751 (local address 127.20.158.190:45247)
0811 08:14:24.926609 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:24.926625 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:24.926809 (+ 184us) server_negotiation.cc:407] Connection header received
0811 08:14:24.927609 (+ 800us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:24.927611 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:24.927629 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:24.927693 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:24.928796 (+ 1103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:24.929312 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:24.930865 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:24.931071 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:24.931132 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:24.933796 (+ 2664us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:24.933797 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:24.933798 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:14:24.933806 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:24.935457 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:24.935876 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:24.935878 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:24.935878 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:24.935941 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:24.936209 (+ 268us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:24.936210 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:24.936211 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:24.936335 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:24.936409 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:24.936704 (+ 295us) server_negotiation.cc:299] Negotiation successful
0811 08:14:24.936794 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:14:24.937112 5046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:24.926505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:45247 (local address 127.20.158.129:47751)
0811 08:14:24.926660 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:24.926713 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:24.927469 (+ 756us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:24.927792 (+ 323us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:24.927796 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:24.928475 (+ 679us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:24.928687 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:24.928692 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:24.929415 (+ 723us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:24.929416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:24.930767 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:24.930771 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:24.931165 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:24.931166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:24.931316 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:24.931863 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:24.931875 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:24.933690 (+ 1815us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:14:24.935547 (+ 1857us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:14:24.935555 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:14:24.935558 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:14:24.935796 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:14:24.936012 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:14:24.936013 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:14:24.936014 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:14:24.936133 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:14:24.936412 (+ 279us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:14:24.936420 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:14:24.936568 (+ 148us) client_negotiation.cc:769] Sending connection context
0811 08:14:24.936681 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 08:14:24.936856 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":75,"threads_started":1}
WARNING: no policy specified for kudu/127.20.158.130@KRBTEST.COM; defaulting to no policy
I20260811 08:14:24.937763 5044 heartbeater.cc:347] Connected to a master server at 127.20.158.190:45247
I20260811 08:14:24.937896 5044 heartbeater.cc:464] Registering TS with master...
I20260811 08:14:24.938095 5044 heartbeater.cc:511] Master 127.20.158.190:45247 requested a full tablet report, sending...
I20260811 08:14:24.938670 4762 ts_manager.cc:194] Registered new tserver with Master: 1112a4d85b0f4293a095d13b251a170e (127.20.158.129:43905)
I20260811 08:14:24.939314 4762 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.129@KRBTEST.COM'} at 127.20.158.129:47751
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
I20260811 08:14:24.956920 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:0
--local_ip_for_outbound_sockets=127.20.158.130
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:45247
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:44383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:14:25.041751 5052 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:14:25.042030 5052 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:14:25.042073 5052 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:14:25.043268 5052 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:14:25.043349 5052 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:14:25.043392 5052 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:14:25.044906 5052 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:44383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:45247
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5052
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:14:25.045207 5052 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:14:25.045470 5052 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:14:25.050700 5063 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:25.050817 5052 server_base.cc:1034] running on GCE node
W20260811 08:14:25.050711 5065 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:25.050906 5068 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:25.051174 5052 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:14:25.051468 5052 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:14:25.052651 5052 hybrid_clock.cc:648] HybridClock initialized: now 1786436065052626 us; error 38 us; skew 500 ppm
Aug 11 08:14:25 dist-test-slave-gkw7 krb5kdc[4688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436065, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:14:25.055437 5052 init.cc:377] Logged in from keytab as kudu/127.20.158.130@KRBTEST.COM (short username kudu)
I20260811 08:14:25.055917 5052 webserver.cc:460] Webserver started at http://127.20.158.130:34879/ using document root <none> and password file <none>
I20260811 08:14:25.056185 5052 fs_manager.cc:359] Metadata directory not provided
I20260811 08:14:25.056257 5052 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:14:25.056416 5052 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:14:25.057503 5052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/data/instance:
uuid: "ea8c76b5c55b479e9b14e27780b1c534"
format_stamp: "Formatted at 2026-08-11 08:14:25 on dist-test-slave-gkw7"
server_key: "aeb02cb97e9720fe56d73a3eca320feb"
server_key_iv: "c2ed7fc50e2d6c153fcf4bcaef756c72"
server_key_version: "encryptionkey@0"
I20260811 08:14:25.057960 5052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance:
uuid: "ea8c76b5c55b479e9b14e27780b1c534"
format_stamp: "Formatted at 2026-08-11 08:14:25 on dist-test-slave-gkw7"
server_key: "aeb02cb97e9720fe56d73a3eca320feb"
server_key_iv: "c2ed7fc50e2d6c153fcf4bcaef756c72"
server_key_version: "encryptionkey@0"
I20260811 08:14:25.059362 5052 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:14:25.060192 5077 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:25.060403 5052 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:14:25.060505 5052 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "ea8c76b5c55b479e9b14e27780b1c534"
format_stamp: "Formatted at 2026-08-11 08:14:25 on dist-test-slave-gkw7"
server_key: "aeb02cb97e9720fe56d73a3eca320feb"
server_key_iv: "c2ed7fc50e2d6c153fcf4bcaef756c72"
server_key_version: "encryptionkey@0"
I20260811 08:14:25.060587 5052 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:14:25.079100 5052 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:14:25.081777 5052 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:14:25.081975 5052 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:14:25.082245 5052 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:14:25.082639 5052 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:14:25.082702 5052 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:25.082741 5052 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:14:25.082768 5052 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:25.088914 5052 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:39161
I20260811 08:14:25.088999 5244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:39161 every 8 connection(s)
I20260811 08:14:25.089344 5052 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
I20260811 08:14:25.092875 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 5052
I20260811 08:14:25.092995 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance
I20260811 08:14:25.093271 21114 external_mini_cluster.cc:1428] Setting key 849a069354bd0ad47cfd1014e01825c1
Aug 11 08:14:25 dist-test-slave-gkw7 krb5kdc[4688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436065, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:14:25.100322 4824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:25.090128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:60195 (local address 127.20.158.190:45247)
0811 08:14:25.090223 (+ 95us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:25.090226 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:25.090444 (+ 218us) server_negotiation.cc:407] Connection header received
0811 08:14:25.090964 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:25.090966 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:25.090978 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:25.091033 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:25.092016 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.092530 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.094132 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.094330 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.094386 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:25.097219 (+ 2833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:25.097221 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:25.097221 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:14:25.097229 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:25.098687 (+ 1458us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:25.099262 (+ 575us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:25.099263 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:25.099263 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:25.099315 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:25.099630 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:25.099630 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:25.099631 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:25.099747 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:25.099802 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:25.100177 (+ 375us) server_negotiation.cc:299] Negotiation successful
0811 08:14:25.100254 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 08:14:25.100673 5247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:25.090102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:45247 (local address 127.20.158.130:60195)
0811 08:14:25.090312 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:25.090354 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:25.090869 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:25.091090 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:25.091094 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:25.091723 (+ 629us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:25.091928 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:25.091932 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.092627 (+ 695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.092649 (+ 22us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:25.094034 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:25.094053 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.094418 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.094419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:25.094570 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:25.095119 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:25.095131 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:25.097045 (+ 1914us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:14:25.098810 (+ 1765us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:14:25.098819 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:14:25.098821 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:14:25.099164 (+ 343us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:14:25.099383 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:14:25.099384 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:14:25.099385 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:14:25.099548 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:14:25.099822 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:14:25.099830 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:14:25.100020 (+ 190us) client_negotiation.cc:769] Sending connection context
0811 08:14:25.100158 (+ 138us) client_negotiation.cc:240] Negotiation successful
0811 08:14:25.100370 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":121,"threads_started":1}
I20260811 08:14:25.101245 5245 heartbeater.cc:347] Connected to a master server at 127.20.158.190:45247
I20260811 08:14:25.101368 5245 heartbeater.cc:464] Registering TS with master...
I20260811 08:14:25.101599 5245 heartbeater.cc:511] Master 127.20.158.190:45247 requested a full tablet report, sending...
I20260811 08:14:25.102025 4762 ts_manager.cc:194] Registered new tserver with Master: ea8c76b5c55b479e9b14e27780b1c534 (127.20.158.130:39161)
I20260811 08:14:25.102421 4762 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.130@KRBTEST.COM'} at 127.20.158.130:60195
WARNING: no policy specified for kudu/127.20.158.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
I20260811 08:14:25.126039 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:0
--local_ip_for_outbound_sockets=127.20.158.131
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:45247
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:44383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:14:25.216424 5256 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:14:25.216645 5256 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:14:25.216670 5256 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:14:25.217957 5256 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:14:25.218005 5256 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:14:25.218034 5256 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:14:25.219722 5256 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:44383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:45247
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5256
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:14:25.219985 5256 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:14:25.220252 5256 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:14:25.225680 5263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:14:25.225690 5262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:25.225708 5256 server_base.cc:1034] running on GCE node
W20260811 08:14:25.225690 5265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:14:25.226059 5256 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:14:25.226291 5256 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:14:25.227489 5256 hybrid_clock.cc:648] HybridClock initialized: now 1786436065227470 us; error 53 us; skew 500 ppm
Aug 11 08:14:25 dist-test-slave-gkw7 krb5kdc[4688](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436065, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:14:25.230216 5256 init.cc:377] Logged in from keytab as kudu/127.20.158.131@KRBTEST.COM (short username kudu)
I20260811 08:14:25.230723 5256 webserver.cc:460] Webserver started at http://127.20.158.131:36593/ using document root <none> and password file <none>
I20260811 08:14:25.230962 5256 fs_manager.cc:359] Metadata directory not provided
I20260811 08:14:25.231033 5256 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:14:25.231194 5256 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:14:25.232326 5256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/data/instance:
uuid: "f8d13603ceda43a896fc67abe4b365a5"
format_stamp: "Formatted at 2026-08-11 08:14:25 on dist-test-slave-gkw7"
server_key: "5a160e0265728cc26f81db34d01a71dc"
server_key_iv: "deb7623d82110fa6aa660dc9cc3a708a"
server_key_version: "encryptionkey@0"
I20260811 08:14:25.232721 5256 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance:
uuid: "f8d13603ceda43a896fc67abe4b365a5"
format_stamp: "Formatted at 2026-08-11 08:14:25 on dist-test-slave-gkw7"
server_key: "5a160e0265728cc26f81db34d01a71dc"
server_key_iv: "deb7623d82110fa6aa660dc9cc3a708a"
server_key_version: "encryptionkey@0"
I20260811 08:14:25.234176 5256 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:14:25.235176 5282 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:25.235386 5256 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:14:25.235498 5256 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "f8d13603ceda43a896fc67abe4b365a5"
format_stamp: "Formatted at 2026-08-11 08:14:25 on dist-test-slave-gkw7"
server_key: "5a160e0265728cc26f81db34d01a71dc"
server_key_iv: "deb7623d82110fa6aa660dc9cc3a708a"
server_key_version: "encryptionkey@0"
I20260811 08:14:25.235574 5256 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:14:25.264034 5256 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:14:25.266289 5256 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:14:25.266470 5256 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:14:25.266731 5256 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:14:25.267059 5256 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:14:25.267115 5256 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:25.267153 5256 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:14:25.267200 5256 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:14:25.274134 5256 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:40995
I20260811 08:14:25.274235 5460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:40995 every 8 connection(s)
I20260811 08:14:25.274626 5256 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
Aug 11 08:14:25 dist-test-slave-gkw7 krb5kdc[4688](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436065, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:14:25.282649 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 5256
I20260811 08:14:25.282763 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance
I20260811 08:14:25.282986 21114 external_mini_cluster.cc:1428] Setting key 703c24284f58a6e845abf11efa305bf6
I20260811 08:14:25.285719 4824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:25.275459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:43621 (local address 127.20.158.190:45247)
0811 08:14:25.275519 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:25.275521 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:25.275786 (+ 265us) server_negotiation.cc:407] Connection header received
0811 08:14:25.276320 (+ 534us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:25.276321 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:25.276334 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:25.276393 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:25.277413 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.278213 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.279610 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.279964 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.280058 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:25.282573 (+ 2515us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:25.282575 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:25.282576 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:14:25.282584 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:25.284282 (+ 1698us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:25.284793 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:25.284794 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:25.284794 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:25.284857 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:25.285102 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:25.285103 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:25.285103 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:25.285217 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:25.285273 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:25.285516 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 08:14:25.285645 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 08:14:25.286000 5468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:25.275456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:45247 (local address 127.20.158.131:43621)
0811 08:14:25.275625 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:25.275677 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:25.276208 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:25.276467 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:25.276471 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:25.277097 (+ 626us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:14:25.277306 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:25.277310 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.278311 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.278313 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:25.279466 (+ 1153us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:25.279469 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.280081 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.280082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:25.280250 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:25.280866 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:14:25.280898 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:14:25.282464 (+ 1566us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:14:25.284442 (+ 1978us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:14:25.284449 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:14:25.284452 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:14:25.284686 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:14:25.284929 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:14:25.284929 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:14:25.284930 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:14:25.285038 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:14:25.285277 (+ 239us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:14:25.285281 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:14:25.285402 (+ 121us) client_negotiation.cc:769] Sending connection context
0811 08:14:25.285488 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 08:14:25.285712 (+ 224us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":96,"threads_started":1}
I20260811 08:14:25.286543 5463 heartbeater.cc:347] Connected to a master server at 127.20.158.190:45247
I20260811 08:14:25.286669 5463 heartbeater.cc:464] Registering TS with master...
I20260811 08:14:25.286836 5463 heartbeater.cc:511] Master 127.20.158.190:45247 requested a full tablet report, sending...
I20260811 08:14:25.287314 4762 ts_manager.cc:194] Registered new tserver with Master: f8d13603ceda43a896fc67abe4b365a5 (127.20.158.131:40995)
I20260811 08:14:25.287703 4762 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.131@KRBTEST.COM'} at 127.20.158.131:43621
I20260811 08:14:25.295192 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:14:25.302755 4824 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:25.296604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40276 (local address 127.20.158.190:45247)
0811 08:14:25.296675 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:25.296677 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:25.296800 (+ 123us) server_negotiation.cc:407] Connection header received
0811 08:14:25.296841 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:25.296842 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:25.296851 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:25.296902 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:14:25.297463 (+ 561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.298035 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.298734 (+ 699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.298917 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.298970 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:25.300113 (+ 1143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:14:25.300115 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:14:25.300115 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:14:25.300122 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:14:25.301702 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:25.302026 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:25.302027 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:25.302027 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:25.302080 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:14:25.302257 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:14:25.302258 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:14:25.302258 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:14:25.302406 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:14:25.302483 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:25.302622 (+ 139us) server_negotiation.cc:299] Negotiation successful
0811 08:14:25.302681 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 08:14:25.304731 4762 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40276:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:14:25.306427 4762 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:14:25.313318 5485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:25.308865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:39161 (local address 127.0.0.1:58332)
0811 08:14:25.309154 (+ 289us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:25.309198 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:25.309269 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:25.309631 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:25.309634 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:25.309638 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:14:25.309730 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:25.309733 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.310858 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.310859 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:25.311966 (+ 1107us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:25.311969 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.312996 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.312997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:25.313089 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:25.313103 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 08:14:25.313185 (+ 82us) client_negotiation.cc:240] Negotiation successful
0811 08:14:25.313241 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":253,"thread_start_us":90,"threads_started":1}
I20260811 08:14:25.313681 5486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:25.309083 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58332 (local address 127.20.158.130:39161)
0811 08:14:25.309339 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:25.309344 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:25.309356 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:14:25.309401 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:25.309402 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:25.309415 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:25.309517 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:14:25.309819 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.310746 (+ 927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.312062 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.312821 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.312899 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:25.312961 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:25.313554 (+ 593us) server_negotiation.cc:299] Negotiation successful
0811 08:14:25.313597 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":216,"thread_start_us":138,"threads_started":1}
I20260811 08:14:25.313793 5483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:25.308866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:40995 (local address 127.0.0.1:49952)
0811 08:14:25.309379 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:25.309390 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:25.309430 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:25.309962 (+ 532us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:25.309962 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:25.309963 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:14:25.310000 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:25.310001 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.311286 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.311287 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:25.312313 (+ 1026us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:25.312316 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.313358 (+ 1042us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.313359 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:25.313443 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:25.313447 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:14:25.313642 (+ 195us) client_negotiation.cc:240] Negotiation successful
0811 08:14:25.313691 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"mutex_wait_us":2,"thread_start_us":73,"threads_started":1}
I20260811 08:14:25.314245 5482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:25.308876 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:43905 (local address 127.0.0.1:59424)
0811 08:14:25.309864 (+ 988us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:25.309879 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:25.309922 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:25.310180 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:25.310181 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:25.310183 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:14:25.310222 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:25.310224 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.311477 (+ 1253us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.311478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:25.312411 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:25.312414 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.314006 (+ 1592us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.314008 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:25.314075 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:25.314079 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:14:25.314133 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 08:14:25.314179 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":976,"thread_start_us":92,"threads_started":1}
I20260811 08:14:25.314287 5487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:25.309154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59424 (local address 127.20.158.129:43905)
0811 08:14:25.309644 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:25.309648 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:25.309963 (+ 315us) server_negotiation.cc:407] Connection header received
0811 08:14:25.310008 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:25.310010 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:25.310027 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:25.310098 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:14:25.310315 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.311373 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.312487 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.313842 (+ 1355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.313916 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:25.313967 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:25.314150 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 08:14:25.314207 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":71,"threads_started":1}
I20260811 08:14:25.314477 5152 tablet_service.cc:1467] Processing CreateTablet for tablet f865df9c55c04fc0af71842c04ca7149 (DEFAULT_TABLE table=test-table [id=f436e3925d6c42fb93ecc65148ab1d29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:14:25.314878 5152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f865df9c55c04fc0af71842c04ca7149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:14:25.317492 5489 tablet_bootstrap.cc:492] T f865df9c55c04fc0af71842c04ca7149 P ea8c76b5c55b479e9b14e27780b1c534: Bootstrap starting.
I20260811 08:14:25.317912 5488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:25.309333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49952 (local address 127.20.158.131:40995)
0811 08:14:25.309614 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:25.309619 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:25.309630 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:14:25.309667 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:25.309669 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:25.309684 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:25.309777 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:14:25.310069 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.311171 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.312438 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.313169 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.313255 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:25.313315 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:25.317778 (+ 4463us) server_negotiation.cc:299] Negotiation successful
0811 08:14:25.317830 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":248,"thread_start_us":132,"threads_started":1}
I20260811 08:14:25.318080 4950 tablet_service.cc:1467] Processing CreateTablet for tablet f865df9c55c04fc0af71842c04ca7149 (DEFAULT_TABLE table=test-table [id=f436e3925d6c42fb93ecc65148ab1d29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:14:25.318270 5489 tablet_bootstrap.cc:654] T f865df9c55c04fc0af71842c04ca7149 P ea8c76b5c55b479e9b14e27780b1c534: Neither blocks nor log segments found. Creating new log.
I20260811 08:14:25.318456 4950 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f865df9c55c04fc0af71842c04ca7149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:14:25.318599 5355 tablet_service.cc:1467] Processing CreateTablet for tablet f865df9c55c04fc0af71842c04ca7149 (DEFAULT_TABLE table=test-table [id=f436e3925d6c42fb93ecc65148ab1d29]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:14:25.318956 5355 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f865df9c55c04fc0af71842c04ca7149. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:14:25.318936 5489 log.cc:824] T f865df9c55c04fc0af71842c04ca7149 P ea8c76b5c55b479e9b14e27780b1c534: Log is configured to *not* fsync() on all Append() calls
I20260811 08:14:25.319974 5489 tablet_bootstrap.cc:492] T f865df9c55c04fc0af71842c04ca7149 P ea8c76b5c55b479e9b14e27780b1c534: No bootstrap required, opened a new log
I20260811 08:14:25.320055 5489 ts_tablet_manager.cc:1397] T f865df9c55c04fc0af71842c04ca7149 P ea8c76b5c55b479e9b14e27780b1c534: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 08:14:25.321424 5494 tablet_bootstrap.cc:492] T f865df9c55c04fc0af71842c04ca7149 P 1112a4d85b0f4293a095d13b251a170e: Bootstrap starting.
I20260811 08:14:25.322091 5494 tablet_bootstrap.cc:654] T f865df9c55c04fc0af71842c04ca7149 P 1112a4d85b0f4293a095d13b251a170e: Neither blocks nor log segments found. Creating new log.
I20260811 08:14:25.322206 5489 raft_consensus.cc:348] T f865df9c55c04fc0af71842c04ca7149 P ea8c76b5c55b479e9b14e27780b1c534 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d13603ceda43a896fc67abe4b365a5" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 40995 } } peers { permanent_uuid: "ea8c76b5c55b479e9b14e27780b1c534" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 39161 } } peers { permanent_uuid: "1112a4d85b0f4293a095d13b251a170e" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 43905 } }
I20260811 08:14:25.322389 5489 raft_consensus.cc:374] T f865df9c55c04fc0af71842c04ca7149 P ea8c76b5c55b479e9b14e27780b1c534 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:14:25.322432 5489 raft_consensus.cc:729] T f865df9c55c04fc0af71842c04ca7149 P ea8c76b5c55b479e9b14e27780b1c534 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea8c76b5c55b479e9b14e27780b1c534, State: Initialized, Role: FOLLOWER
I20260811 08:14:25.322542 5489 consensus_queue.cc:260] T f865df9c55c04fc0af71842c04ca7149 P ea8c76b5c55b479e9b14e27780b1c534 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d13603ceda43a896fc67abe4b365a5" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 40995 } } peers { permanent_uuid: "ea8c76b5c55b479e9b14e27780b1c534" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 39161 } } peers { permanent_uuid: "1112a4d85b0f4293a095d13b251a170e" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 43905 } }
I20260811 08:14:25.322803 5494 log.cc:824] T f865df9c55c04fc0af71842c04ca7149 P 1112a4d85b0f4293a095d13b251a170e: Log is configured to *not* fsync() on all Append() calls
I20260811 08:14:25.322836 5489 ts_tablet_manager.cc:1428] T f865df9c55c04fc0af71842c04ca7149 P ea8c76b5c55b479e9b14e27780b1c534: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:14:25.322863 5245 heartbeater.cc:503] Master 127.20.158.190:45247 was elected leader, sending a full tablet report...
I20260811 08:14:25.323024 5498 tablet_bootstrap.cc:492] T f865df9c55c04fc0af71842c04ca7149 P f8d13603ceda43a896fc67abe4b365a5: Bootstrap starting.
I20260811 08:14:25.323662 5498 tablet_bootstrap.cc:654] T f865df9c55c04fc0af71842c04ca7149 P f8d13603ceda43a896fc67abe4b365a5: Neither blocks nor log segments found. Creating new log.
I20260811 08:14:25.323868 5494 tablet_bootstrap.cc:492] T f865df9c55c04fc0af71842c04ca7149 P 1112a4d85b0f4293a095d13b251a170e: No bootstrap required, opened a new log
I20260811 08:14:25.323962 5494 ts_tablet_manager.cc:1397] T f865df9c55c04fc0af71842c04ca7149 P 1112a4d85b0f4293a095d13b251a170e: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 08:14:25.324232 5498 log.cc:824] T f865df9c55c04fc0af71842c04ca7149 P f8d13603ceda43a896fc67abe4b365a5: Log is configured to *not* fsync() on all Append() calls
I20260811 08:14:25.324958 5498 tablet_bootstrap.cc:492] T f865df9c55c04fc0af71842c04ca7149 P f8d13603ceda43a896fc67abe4b365a5: No bootstrap required, opened a new log
I20260811 08:14:25.325043 5498 ts_tablet_manager.cc:1397] T f865df9c55c04fc0af71842c04ca7149 P f8d13603ceda43a896fc67abe4b365a5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:14:25.325699 5494 raft_consensus.cc:348] T f865df9c55c04fc0af71842c04ca7149 P 1112a4d85b0f4293a095d13b251a170e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d13603ceda43a896fc67abe4b365a5" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 40995 } } peers { permanent_uuid: "ea8c76b5c55b479e9b14e27780b1c534" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 39161 } } peers { permanent_uuid: "1112a4d85b0f4293a095d13b251a170e" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 43905 } }
I20260811 08:14:25.325851 5494 raft_consensus.cc:374] T f865df9c55c04fc0af71842c04ca7149 P 1112a4d85b0f4293a095d13b251a170e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:14:25.325896 5494 raft_consensus.cc:729] T f865df9c55c04fc0af71842c04ca7149 P 1112a4d85b0f4293a095d13b251a170e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1112a4d85b0f4293a095d13b251a170e, State: Initialized, Role: FOLLOWER
I20260811 08:14:25.326017 5494 consensus_queue.cc:260] T f865df9c55c04fc0af71842c04ca7149 P 1112a4d85b0f4293a095d13b251a170e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d13603ceda43a896fc67abe4b365a5" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 40995 } } peers { permanent_uuid: "ea8c76b5c55b479e9b14e27780b1c534" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 39161 } } peers { permanent_uuid: "1112a4d85b0f4293a095d13b251a170e" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 43905 } }
I20260811 08:14:25.326346 5494 ts_tablet_manager.cc:1428] T f865df9c55c04fc0af71842c04ca7149 P 1112a4d85b0f4293a095d13b251a170e: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 08:14:25.326359 5044 heartbeater.cc:503] Master 127.20.158.190:45247 was elected leader, sending a full tablet report...
I20260811 08:14:25.326890 5498 raft_consensus.cc:348] T f865df9c55c04fc0af71842c04ca7149 P f8d13603ceda43a896fc67abe4b365a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d13603ceda43a896fc67abe4b365a5" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 40995 } } peers { permanent_uuid: "ea8c76b5c55b479e9b14e27780b1c534" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 39161 } } peers { permanent_uuid: "1112a4d85b0f4293a095d13b251a170e" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 43905 } }
I20260811 08:14:25.327064 5498 raft_consensus.cc:374] T f865df9c55c04fc0af71842c04ca7149 P f8d13603ceda43a896fc67abe4b365a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:14:25.327099 5498 raft_consensus.cc:729] T f865df9c55c04fc0af71842c04ca7149 P f8d13603ceda43a896fc67abe4b365a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8d13603ceda43a896fc67abe4b365a5, State: Initialized, Role: FOLLOWER
I20260811 08:14:25.327209 5498 consensus_queue.cc:260] T f865df9c55c04fc0af71842c04ca7149 P f8d13603ceda43a896fc67abe4b365a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d13603ceda43a896fc67abe4b365a5" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 40995 } } peers { permanent_uuid: "ea8c76b5c55b479e9b14e27780b1c534" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 39161 } } peers { permanent_uuid: "1112a4d85b0f4293a095d13b251a170e" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 43905 } }
I20260811 08:14:25.327491 5498 ts_tablet_manager.cc:1428] T f865df9c55c04fc0af71842c04ca7149 P f8d13603ceda43a896fc67abe4b365a5: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 08:14:25.327520 5463 heartbeater.cc:503] Master 127.20.158.190:45247 was elected leader, sending a full tablet report...
W20260811 08:14:25.339995 5246 tablet.cc:2369] T f865df9c55c04fc0af71842c04ca7149 P ea8c76b5c55b479e9b14e27780b1c534: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:14:25.426591 5045 tablet.cc:2369] T f865df9c55c04fc0af71842c04ca7149 P 1112a4d85b0f4293a095d13b251a170e: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:14:25.497753 5504 raft_consensus.cc:482] T f865df9c55c04fc0af71842c04ca7149 P 1112a4d85b0f4293a095d13b251a170e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:14:25.497884 5504 raft_consensus.cc:504] T f865df9c55c04fc0af71842c04ca7149 P 1112a4d85b0f4293a095d13b251a170e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d13603ceda43a896fc67abe4b365a5" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 40995 } } peers { permanent_uuid: "ea8c76b5c55b479e9b14e27780b1c534" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 39161 } } peers { permanent_uuid: "1112a4d85b0f4293a095d13b251a170e" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 43905 } }
I20260811 08:14:25.498332 5504 leader_election.cc:288] T f865df9c55c04fc0af71842c04ca7149 P 1112a4d85b0f4293a095d13b251a170e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f8d13603ceda43a896fc67abe4b365a5 (127.20.158.131:40995), ea8c76b5c55b479e9b14e27780b1c534 (127.20.158.130:39161)
I20260811 08:14:25.501305 5488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:25.498627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:47769 (local address 127.20.158.131:40995)
0811 08:14:25.498677 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:25.498679 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:25.498733 (+ 54us) server_negotiation.cc:407] Connection header received
0811 08:14:25.498811 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:25.498812 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:25.498823 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:25.498898 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:14:25.499073 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.499561 (+ 488us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.500540 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.500927 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.501027 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:25.501036 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:25.501184 (+ 148us) server_negotiation.cc:299] Negotiation successful
0811 08:14:25.501222 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:14:25.501322 5486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:25.498636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:58023 (local address 127.20.158.130:39161)
0811 08:14:25.498691 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:25.498693 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:25.498777 (+ 84us) server_negotiation.cc:407] Connection header received
0811 08:14:25.498878 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:25.498879 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:25.498889 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:25.498972 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:14:25.499170 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.499630 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.500573 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.500955 (+ 382us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.501046 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:25.501055 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:25.501215 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 08:14:25.501251 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260811 08:14:25.501583 5510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:25.498555 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:39161 (local address 127.20.158.129:58023)
0811 08:14:25.498697 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:25.498708 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:25.498795 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:25.498974 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:25.498975 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:25.498977 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:14:25.499069 (+ 92us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:25.499071 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.499720 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.499721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:25.500481 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:25.500482 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.501046 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.501047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:25.501125 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:25.501129 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:14:25.501205 (+ 76us) client_negotiation.cc:240] Negotiation successful
0811 08:14:25.501248 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":76,"threads_started":1}
I20260811 08:14:25.501587 5509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:25.498503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:40995 (local address 127.20.158.129:47769)
0811 08:14:25.498666 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:25.498679 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:14:25.498745 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:14:25.498902 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:14:25.498903 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:14:25.498905 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:14:25.498986 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:25.498988 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.499657 (+ 669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.499658 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:25.500441 (+ 783us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:14:25.500443 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.501027 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.501028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:14:25.501105 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:25.501109 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:14:25.501178 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 08:14:25.501228 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":68,"threads_started":1}
I20260811 08:14:25.502009 5388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f865df9c55c04fc0af71842c04ca7149" candidate_uuid: "1112a4d85b0f4293a095d13b251a170e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d13603ceda43a896fc67abe4b365a5" is_pre_election: true
I20260811 08:14:25.502008 5175 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f865df9c55c04fc0af71842c04ca7149" candidate_uuid: "1112a4d85b0f4293a095d13b251a170e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea8c76b5c55b479e9b14e27780b1c534" is_pre_election: true
I20260811 08:14:25.502194 5175 raft_consensus.cc:2454] T f865df9c55c04fc0af71842c04ca7149 P ea8c76b5c55b479e9b14e27780b1c534 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1112a4d85b0f4293a095d13b251a170e in term 0.
I20260811 08:14:25.502194 5388 raft_consensus.cc:2454] T f865df9c55c04fc0af71842c04ca7149 P f8d13603ceda43a896fc67abe4b365a5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1112a4d85b0f4293a095d13b251a170e in term 0.
I20260811 08:14:25.502451 4877 leader_election.cc:302] T f865df9c55c04fc0af71842c04ca7149 P 1112a4d85b0f4293a095d13b251a170e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1112a4d85b0f4293a095d13b251a170e, ea8c76b5c55b479e9b14e27780b1c534; no voters:
I20260811 08:14:25.502589 5504 raft_consensus.cc:2781] T f865df9c55c04fc0af71842c04ca7149 P 1112a4d85b0f4293a095d13b251a170e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:14:25.502656 5504 raft_consensus.cc:482] T f865df9c55c04fc0af71842c04ca7149 P 1112a4d85b0f4293a095d13b251a170e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:14:25.502693 5504 raft_consensus.cc:3037] T f865df9c55c04fc0af71842c04ca7149 P 1112a4d85b0f4293a095d13b251a170e [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:14:25.503438 5504 raft_consensus.cc:504] T f865df9c55c04fc0af71842c04ca7149 P 1112a4d85b0f4293a095d13b251a170e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d13603ceda43a896fc67abe4b365a5" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 40995 } } peers { permanent_uuid: "ea8c76b5c55b479e9b14e27780b1c534" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 39161 } } peers { permanent_uuid: "1112a4d85b0f4293a095d13b251a170e" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 43905 } }
I20260811 08:14:25.503624 5504 leader_election.cc:288] T f865df9c55c04fc0af71842c04ca7149 P 1112a4d85b0f4293a095d13b251a170e [CANDIDATE]: Term 1 election: Requested vote from peers f8d13603ceda43a896fc67abe4b365a5 (127.20.158.131:40995), ea8c76b5c55b479e9b14e27780b1c534 (127.20.158.130:39161)
I20260811 08:14:25.503742 5388 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f865df9c55c04fc0af71842c04ca7149" candidate_uuid: "1112a4d85b0f4293a095d13b251a170e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8d13603ceda43a896fc67abe4b365a5"
I20260811 08:14:25.503767 5175 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f865df9c55c04fc0af71842c04ca7149" candidate_uuid: "1112a4d85b0f4293a095d13b251a170e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea8c76b5c55b479e9b14e27780b1c534"
I20260811 08:14:25.503834 5175 raft_consensus.cc:3037] T f865df9c55c04fc0af71842c04ca7149 P ea8c76b5c55b479e9b14e27780b1c534 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:14:25.503831 5388 raft_consensus.cc:3037] T f865df9c55c04fc0af71842c04ca7149 P f8d13603ceda43a896fc67abe4b365a5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:14:25.504770 5175 raft_consensus.cc:2454] T f865df9c55c04fc0af71842c04ca7149 P ea8c76b5c55b479e9b14e27780b1c534 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1112a4d85b0f4293a095d13b251a170e in term 1.
I20260811 08:14:25.504770 5388 raft_consensus.cc:2454] T f865df9c55c04fc0af71842c04ca7149 P f8d13603ceda43a896fc67abe4b365a5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1112a4d85b0f4293a095d13b251a170e in term 1.
I20260811 08:14:25.504989 4877 leader_election.cc:302] T f865df9c55c04fc0af71842c04ca7149 P 1112a4d85b0f4293a095d13b251a170e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1112a4d85b0f4293a095d13b251a170e, ea8c76b5c55b479e9b14e27780b1c534; no voters:
I20260811 08:14:25.505101 5504 raft_consensus.cc:2781] T f865df9c55c04fc0af71842c04ca7149 P 1112a4d85b0f4293a095d13b251a170e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:14:25.505255 5504 raft_consensus.cc:686] T f865df9c55c04fc0af71842c04ca7149 P 1112a4d85b0f4293a095d13b251a170e [term 1 LEADER]: Becoming Leader. State: Replica: 1112a4d85b0f4293a095d13b251a170e, State: Running, Role: LEADER
I20260811 08:14:25.505370 5504 consensus_queue.cc:237] T f865df9c55c04fc0af71842c04ca7149 P 1112a4d85b0f4293a095d13b251a170e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d13603ceda43a896fc67abe4b365a5" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 40995 } } peers { permanent_uuid: "ea8c76b5c55b479e9b14e27780b1c534" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 39161 } } peers { permanent_uuid: "1112a4d85b0f4293a095d13b251a170e" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 43905 } }
I20260811 08:14:25.506323 4762 catalog_manager.cc:5495] T f865df9c55c04fc0af71842c04ca7149 P 1112a4d85b0f4293a095d13b251a170e reported cstate change: term changed from 0 to 1, leader changed from <none> to 1112a4d85b0f4293a095d13b251a170e (127.20.158.129). New cstate: current_term: 1 leader_uuid: "1112a4d85b0f4293a095d13b251a170e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f8d13603ceda43a896fc67abe4b365a5" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 40995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea8c76b5c55b479e9b14e27780b1c534" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 39161 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1112a4d85b0f4293a095d13b251a170e" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 43905 } health_report { overall_health: HEALTHY } } }
W20260811 08:14:25.525321 5467 tablet.cc:2369] T f865df9c55c04fc0af71842c04ca7149 P f8d13603ceda43a896fc67abe4b365a5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:14:25.546474 5487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:25.543704 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59436 (local address 127.20.158.129:43905)
0811 08:14:25.543790 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 08:14:25.543792 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:14:25.543800 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:14:25.543840 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:14:25.543841 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:14:25.543862 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:14:25.543927 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:14:25.544096 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.544717 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.545612 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:14:25.545815 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:14:25.545876 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:14:25.546062 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:14:25.546173 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:14:25.546239 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 08:14:25.546332 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 08:14:25.546351 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 08:14:25.548631 5388 raft_consensus.cc:1261] T f865df9c55c04fc0af71842c04ca7149 P f8d13603ceda43a896fc67abe4b365a5 [term 1 FOLLOWER]: Refusing update from remote peer 1112a4d85b0f4293a095d13b251a170e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:14:25.548631 5175 raft_consensus.cc:1261] T f865df9c55c04fc0af71842c04ca7149 P ea8c76b5c55b479e9b14e27780b1c534 [term 1 FOLLOWER]: Refusing update from remote peer 1112a4d85b0f4293a095d13b251a170e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:14:25.549103 5513 consensus_queue.cc:1035] T f865df9c55c04fc0af71842c04ca7149 P 1112a4d85b0f4293a095d13b251a170e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea8c76b5c55b479e9b14e27780b1c534" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 39161 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:14:25.549285 5504 consensus_queue.cc:1035] T f865df9c55c04fc0af71842c04ca7149 P 1112a4d85b0f4293a095d13b251a170e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8d13603ceda43a896fc67abe4b365a5" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 40995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:14:25.552001 5517 mvcc.cc:205] Tried to move back new op lower bound from 7317242124483731456 to 7317242124310831104. Current Snapshot: MvccSnapshot[applied={T|T < 7317242124483731456}]
I20260811 08:14:25.552901 5518 mvcc.cc:205] Tried to move back new op lower bound from 7317242124483731456 to 7317242124310831104. Current Snapshot: MvccSnapshot[applied={T|T < 7317242124483731456 or (T in {7317242124483731456})}]
I20260811 08:14:25.554527 4761 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40276:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:14:25.554625 4761 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40276:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:14:25.555378 4761 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 129d497e5fbc4a38a93ca0c68a94aa30: Sending DeleteTablet for 3 replicas of tablet f865df9c55c04fc0af71842c04ca7149
I20260811 08:14:25.555738 4950 tablet_service.cc:1514] Processing DeleteTablet for tablet f865df9c55c04fc0af71842c04ca7149 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:14:25 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:59424
I20260811 08:14:25.555751 5152 tablet_service.cc:1514] Processing DeleteTablet for tablet f865df9c55c04fc0af71842c04ca7149 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:14:25 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:58332
I20260811 08:14:25.555752 5355 tablet_service.cc:1514] Processing DeleteTablet for tablet f865df9c55c04fc0af71842c04ca7149 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:14:25 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:49952
I20260811 08:14:25.556069 5534 tablet_replica.cc:330] T f865df9c55c04fc0af71842c04ca7149 P f8d13603ceda43a896fc67abe4b365a5: stopping tablet replica
I20260811 08:14:25.556183 5534 raft_consensus.cc:2229] T f865df9c55c04fc0af71842c04ca7149 P f8d13603ceda43a896fc67abe4b365a5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:14:25.556294 5534 raft_consensus.cc:2258] T f865df9c55c04fc0af71842c04ca7149 P f8d13603ceda43a896fc67abe4b365a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:14:25.556325 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 4856
I20260811 08:14:25.556998 5535 tablet_replica.cc:330] T f865df9c55c04fc0af71842c04ca7149 P ea8c76b5c55b479e9b14e27780b1c534: stopping tablet replica
I20260811 08:14:25.557123 5535 raft_consensus.cc:2229] T f865df9c55c04fc0af71842c04ca7149 P ea8c76b5c55b479e9b14e27780b1c534 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:14:25.557228 5535 raft_consensus.cc:2258] T f865df9c55c04fc0af71842c04ca7149 P ea8c76b5c55b479e9b14e27780b1c534 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:14:25.559366 5535 ts_tablet_manager.cc:1905] T f865df9c55c04fc0af71842c04ca7149 P ea8c76b5c55b479e9b14e27780b1c534: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:14:25.559438 5534 ts_tablet_manager.cc:1905] T f865df9c55c04fc0af71842c04ca7149 P f8d13603ceda43a896fc67abe4b365a5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:14:25.560953 5535 ts_tablet_manager.cc:1918] T f865df9c55c04fc0af71842c04ca7149 P ea8c76b5c55b479e9b14e27780b1c534: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:14:25.561048 5535 log.cc:1196] T f865df9c55c04fc0af71842c04ca7149 P ea8c76b5c55b479e9b14e27780b1c534: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-1/wal/wals/f865df9c55c04fc0af71842c04ca7149
I20260811 08:14:25.561291 5535 ts_tablet_manager.cc:1939] T f865df9c55c04fc0af71842c04ca7149 P ea8c76b5c55b479e9b14e27780b1c534: Deleting consensus metadata
I20260811 08:14:25.561621 5534 ts_tablet_manager.cc:1918] T f865df9c55c04fc0af71842c04ca7149 P f8d13603ceda43a896fc67abe4b365a5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:14:25.561733 5534 log.cc:1196] T f865df9c55c04fc0af71842c04ca7149 P f8d13603ceda43a896fc67abe4b365a5: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786436003833085-21114-0/minicluster-data/ts-2/wal/wals/f865df9c55c04fc0af71842c04ca7149
I20260811 08:14:25.561765 4737 catalog_manager.cc:4841] TS ea8c76b5c55b479e9b14e27780b1c534 (127.20.158.130:39161): tablet f865df9c55c04fc0af71842c04ca7149 (table test-table [id=f436e3925d6c42fb93ecc65148ab1d29]) successfully deleted
I20260811 08:14:25.562091 5534 ts_tablet_manager.cc:1939] T f865df9c55c04fc0af71842c04ca7149 P f8d13603ceda43a896fc67abe4b365a5: Deleting consensus metadata
I20260811 08:14:25.562530 4739 catalog_manager.cc:4841] TS f8d13603ceda43a896fc67abe4b365a5 (127.20.158.131:40995): tablet f865df9c55c04fc0af71842c04ca7149 (table test-table [id=f436e3925d6c42fb93ecc65148ab1d29]) successfully deleted
W20260811 08:14:25.569900 4740 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.158.129:43905 (error 108)
I20260811 08:14:25.570204 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 5052
I20260811 08:14:25.572455 5482 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:14:25.570376 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:43905 (local address 127.0.0.1:59438)
0811 08:14:25.572350 (+ 1974us) negotiation.cc:107] Waiting for socket to connect
0811 08:14:25.572406 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.129:43905: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1947}
W20260811 08:14:25.575415 4740 catalog_manager.cc:4584] TS 1112a4d85b0f4293a095d13b251a170e (127.20.158.129:43905): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f865df9c55c04fc0af71842c04ca7149: Network error: Client connection negotiation failed: client connection to 127.20.158.129:43905: connect: Connection refused (error 111)
I20260811 08:14:25.580547 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 5256
I20260811 08:14:25.593572 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 4711
2026-08-11T08:14:25Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2375 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:14:25 dist-test-slave-gkw7 krb5kdc[5543](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:14:25 dist-test-slave-gkw7 krb5kdc[5543](info): set up 2 sockets
Aug 11 08:14:25 dist-test-slave-gkw7 krb5kdc[5543](info): commencing operation
krb5kdc: starting...
W20260811 08:14:26.837997 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.221s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:14:26 dist-test-slave-gkw7 krb5kdc[5543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436066, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:14:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:14:26Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.20.158.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.20.158.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.20.158.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/rangeradmin_127.20.158.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.20.158.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/rangeradmin_127.20.158.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.20.158.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.20.158.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.20.158.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/rangerlookup_127.20.158.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.20.158.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/rangerlookup_127.20.158.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.158.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.20.158.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.158.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/HTTP_127.20.158.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.158.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/HTTP_127.20.158.148@KRBTEST.COM.keytab.
I20260811 08:14:27.018782 21114 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskgBR4MD/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/postgres -l logfile start
2026-08-11 08:14:29.624 UTC [5591] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 08:14:29.624 UTC [5591] LOG: listening on IPv4 address "127.20.158.148", port 40827
2026-08-11 08:14:29.627 UTC [5591] LOG: listening on Unix socket "/tmp/.s.PGSQL.40827"
2026-08-11 08:14:29.664 UTC [5595] LOG: database system was shut down at 2026-08-11 08:14:28 UTC
2026-08-11 08:14:29.668 UTC [5591] LOG: database system is ready to accept connections
I20260811 08:14:30.830808 21114 mini_postgres.cc:96] Postgres bound to 40827
2026-08-11 08:14:30.838 UTC [5606] FATAL: database "slave" does not exist
127.20.158.148:40827 - accepting connections
I20260811 08:14:30.839444 21114 mini_ranger.cc:161] Starting Ranger...
I20260811 08:14:30.855185 21114 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 08:14:31.395287 21114 mini_ranger.cc:87] Created ranger Postgres database
I20260811 08:14:31.395382 21114 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ranger-admin
2026-08-11 08:14:31,661 [I] DB FLAVOR :POSTGRES
2026-08-11 08:14:31,662 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 08:14:31,662 [I] Checking connection..
2026-08-11 08:14:31,662 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:40827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 08:14:31,925 [I] Checking connection passed.
2026-08-11 08:14:31,925 [I] --------- Verifying version history table ---------
2026-08-11 08:14:31,925 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:40827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 08:14:32,181 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 08:14:32,182 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:40827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 08:14:32,441 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 08:14:32,441 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 08:14:32,442 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:40827/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 08:14:32.689 UTC [5708] WARNING: there is no transaction in progress
2026-08-11 08:14:32,699 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 08:14:32,699 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:40827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 08:14:32,953 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 08:14:32,953 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 08:14:32,954 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:40827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 08:14:33,204 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:40827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 08:14:33,458 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:40827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-gkw7.c.gcp-upstream.internal','N') ;"
2026-08-11 08:14:33,713 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:40827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 08:14:34,013 [I] Table x_portal_user does not exist in database ranger
2026-08-11 08:14:34,014 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:40827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 08:14:34,285 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 08:14:34,286 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:40827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 08:14:34,561 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:40827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 08:14:34,820 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 08:14:34,820 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:40827/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 08:14:35.804 UTC [5864] WARNING: there is no transaction in progress
2026-08-11 08:14:35.821 UTC [5864] WARNING: there is no transaction in progress
2026-08-11 08:14:35.838 UTC [5864] WARNING: there is no transaction in progress
2026-08-11 08:14:35.853 UTC [5864] WARNING: there is no transaction in progress
2026-08-11 08:14:35.870 UTC [5864] WARNING: there is no transaction in progress
2026-08-11 08:14:35.888 UTC [5864] WARNING: there is no transaction in progress
2026-08-11 08:14:35.944 UTC [5864] WARNING: there is no transaction in progress
2026-08-11 08:14:35.951 UTC [5864] WARNING: there is no transaction in progress
2026-08-11 08:14:35.965 UTC [5864] WARNING: there is no transaction in progress
2026-08-11 08:14:35.976 UTC [5864] WARNING: there is no transaction in progress
2026-08-11 08:14:35.986 UTC [5864] WARNING: there is no transaction in progress
2026-08-11 08:14:36.000 UTC [5864] WARNING: there is no transaction in progress
2026-08-11 08:14:36.009 UTC [5864] WARNING: there is no transaction in progress
2026-08-11 08:14:36.016 UTC [5864] WARNING: there is no transaction in progress
2026-08-11 08:14:36.023 UTC [5864] WARNING: there is no transaction in progress
2026-08-11 08:14:36.029 UTC [5864] WARNING: there is no transaction in progress
2026-08-11 08:14:36,700 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 08:14:36,701 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:40827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 08:14:36,939 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 08:14:36,940 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:40827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 08:14:37,181 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 08:14:37,181 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:40827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 08:14:37,448 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 08:14:37,448 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:40827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 08:14:37,719 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:40827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 08:14:37,986 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:40827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-gkw7.c.gcp-upstream.internal';"
2026-08-11 08:14:38,249 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 08:14:38,250 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:40827/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 08:14:38,504 [I] DB_PATCHES have already been applied
I20260811 08:14:38.510507 21114 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ranger-admin:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskgBR4MD/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 08:14:38.510573 21114 mini_ranger.cc:193] Using host: 127.20.158.148
I20260811 08:14:38.514734 21114 mini_ranger.cc:227] Ranger admin URL: http://127.20.158.148:55567
Aug 11, 2026 8:14:38 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 8:14:38 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 8:14:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 8:14:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 8:14:38 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 8:14:39 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 8:14:39 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 08:14:39.973358 21114 mini_ranger.cc:160] Time spent starting Ranger: real 9.134s user 0.002s sys 0.010s
Aug 11, 2026 8:15:00 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 8:15:00 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 11, 2026 8:15:00 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 8:15:00 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 8:15:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 8:15:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 8:15:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 8:15:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 8:15:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 8:15:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 8:15:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 8:15:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 8:15:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 8:15:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 8:15:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 8:15:00 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 8:15:00 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 8:15:01 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 08:15:02.151845 21114 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.20.158.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.20.158.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.20.158.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/rangerkms_127.20.158.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.20.158.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/rangerkms_127.20.158.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.158.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.20.158.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.158.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/HTTP_127.20.158.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.158.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/HTTP_127.20.158.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 08:15:02 dist-test-slave-gkw7 krb5kdc[5543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436102, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 08:15:02.242362 21114 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 08:15:02.253690 21114 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 08:15:03.153244 21114 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 08:15:03.153321 21114 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ranger-kms
I20260811 08:15:03.153334 21114 mini_ranger_kms.cc:227] Using postgres at 127.20.158.148:40827
2026-08-11 08:15:03,431 [I] DB FLAVOR :POSTGRES
2026-08-11 08:15:03,432 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 08:15:03,432 [I] Checking connection
2026-08-11 08:15:03,432 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:40827/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 08:15:03,688 [I] connection success
2026-08-11 08:15:03,688 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 08:15:03,688 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 08:15:03,688 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:40827/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 08:15:03,953 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 08:15:03,953 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 08:15:03,953 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 08:15:03,953 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:40827/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 08:15:04,241 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 08:15:04.745244 21114 mini_ranger_kms.cc:310] Created kms service
I20260811 08:15:04.959312 21114 mini_ranger_kms.cc:326] Created kudu user
I20260811 08:15:05.006639 21114 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 08:15:05 dist-test-slave-gkw7 krb5kdc[5543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436102, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.20.158.148@KRBTEST.COM
I20260811 08:15:05.445498 21114 mini_ranger_kms.cc:384] Added ranger policy
I20260811 08:15:05.445660 21114 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ranger-kms:/tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 08:15:05.445688 21114 mini_ranger_kms.cc:240] Using host: 127.20.158.148
I20260811 08:15:05.450150 21114 mini_ranger_kms.cc:276] Ranger KMS PID: 6160
I20260811 08:15:05.450304 21114 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.20.158.148:56155
Aug 11, 2026 8:15:06 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 8:15:06 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 8:15:06 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 8:15:06 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 8:15:07 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 8:15:07 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 08:15:07 dist-test-slave-gkw7 krb5kdc[5543](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786436107, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.158.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:15:08.291941 21114 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.050s user 0.019s sys 0.237s
I20260811 08:15:08.292052 21114 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 08:15:08.292131 21114 mini_ranger_kms.cc:401] 127.20.158.148:56155/kms/v1/keys
Aug 11 08:15:08 dist-test-slave-gkw7 krb5kdc[5543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436107, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.158.148@KRBTEST.COM for HTTP/127.20.158.148@KRBTEST.COM
Aug 11 08:15:08 dist-test-slave-gkw7 krb5kdc[5543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436107, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.158.148@KRBTEST.COM for HTTP/127.20.158.148@KRBTEST.COM
Aug 11 08:15:11 dist-test-slave-gkw7 krb5kdc[5543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436111, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:15:11.210472 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:35717
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:33047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:35717
--ranger_config_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.158.148:56155/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:15:11.301328 6236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:15:11.301592 6236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:15:11.301633 6236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:15:11.302847 6236 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:15:11.302917 6236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:15:11.302943 6236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:15:11.302974 6236 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:15:11.303000 6236 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:15:11.304621 6236 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:33047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/master-0/wal
--ranger_kms_url=127.20.158.148:56155/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:35717
--ranger_config_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:35717
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6236
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:15:11.304893 6236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:15:11.305131 6236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:15:11.311277 6243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:15:11.311305 6242 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:15:11.311517 6236 server_base.cc:1034] running on GCE node
W20260811 08:15:11.311618 6245 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:15:11.311865 6236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:15:11.312240 6236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:15:11.313408 6236 hybrid_clock.cc:648] HybridClock initialized: now 1786436111313384 us; error 40 us; skew 500 ppm
Aug 11 08:15:11 dist-test-slave-gkw7 krb5kdc[5543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436111, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:15:11.330235 6236 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:15:11.330860 6236 webserver.cc:460] Webserver started at http://127.20.158.190:46325/ using document root <none> and password file <none>
I20260811 08:15:11.331139 6236 fs_manager.cc:359] Metadata directory not provided
I20260811 08:15:11.331182 6236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:15:11.331332 6236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 08:15:11 dist-test-slave-gkw7 krb5kdc[5543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436111, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for HTTP/127.20.158.148@KRBTEST.COM
I20260811 08:15:11.394172 6236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "cd90e399a1104500bdd4fea053ff73ec"
format_stamp: "Formatted at 2026-08-11 08:15:11 on dist-test-slave-gkw7"
server_key: "9f746cf6b9673a8ad50105a0ce557829"
server_key_iv: "2e60f09dd01331c4912817e83e67fff0"
server_key_version: "kuduclusterkey@0"
I20260811 08:15:11.394666 6236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "cd90e399a1104500bdd4fea053ff73ec"
format_stamp: "Formatted at 2026-08-11 08:15:11 on dist-test-slave-gkw7"
server_key: "9f746cf6b9673a8ad50105a0ce557829"
server_key_iv: "2e60f09dd01331c4912817e83e67fff0"
server_key_version: "kuduclusterkey@0"
I20260811 08:15:11.396340 6236 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:15:11.411624 6258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:15:11.411806 6236 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:15:11.411906 6236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "cd90e399a1104500bdd4fea053ff73ec"
format_stamp: "Formatted at 2026-08-11 08:15:11 on dist-test-slave-gkw7"
server_key: "9f746cf6b9673a8ad50105a0ce557829"
server_key_iv: "2e60f09dd01331c4912817e83e67fff0"
server_key_version: "kuduclusterkey@0"
I20260811 08:15:11.412004 6236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:15:11.429255 6236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:15:11.431373 6236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:15:11.431577 6236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:15:11.437696 6236 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:35717
I20260811 08:15:11.437716 6338 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:35717 every 8 connection(s)
I20260811 08:15:11.438153 6236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:15:11.438920 6340 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:15:11.441361 6340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd90e399a1104500bdd4fea053ff73ec: Bootstrap starting.
I20260811 08:15:11.442018 6340 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd90e399a1104500bdd4fea053ff73ec: Neither blocks nor log segments found. Creating new log.
I20260811 08:15:11.442414 6340 log.cc:824] T 00000000000000000000000000000000 P cd90e399a1104500bdd4fea053ff73ec: Log is configured to *not* fsync() on all Append() calls
I20260811 08:15:11.443174 6340 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd90e399a1104500bdd4fea053ff73ec: No bootstrap required, opened a new log
I20260811 08:15:11.445243 6340 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd90e399a1104500bdd4fea053ff73ec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd90e399a1104500bdd4fea053ff73ec" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 35717 } }
I20260811 08:15:11.445389 6340 raft_consensus.cc:374] T 00000000000000000000000000000000 P cd90e399a1104500bdd4fea053ff73ec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:15:11.445413 6340 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd90e399a1104500bdd4fea053ff73ec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd90e399a1104500bdd4fea053ff73ec, State: Initialized, Role: FOLLOWER
I20260811 08:15:11.445593 6340 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd90e399a1104500bdd4fea053ff73ec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd90e399a1104500bdd4fea053ff73ec" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 35717 } }
I20260811 08:15:11.445674 6340 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd90e399a1104500bdd4fea053ff73ec [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:15:11.445703 6340 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd90e399a1104500bdd4fea053ff73ec [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:15:11.445745 6340 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd90e399a1104500bdd4fea053ff73ec [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:15:11.446439 6340 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd90e399a1104500bdd4fea053ff73ec [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd90e399a1104500bdd4fea053ff73ec" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 35717 } }
I20260811 08:15:11.446549 6340 leader_election.cc:302] T 00000000000000000000000000000000 P cd90e399a1104500bdd4fea053ff73ec [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd90e399a1104500bdd4fea053ff73ec; no voters:
I20260811 08:15:11.446709 6340 leader_election.cc:288] T 00000000000000000000000000000000 P cd90e399a1104500bdd4fea053ff73ec [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:15:11.446771 6345 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd90e399a1104500bdd4fea053ff73ec [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:15:11.446964 6345 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd90e399a1104500bdd4fea053ff73ec [term 1 LEADER]: Becoming Leader. State: Replica: cd90e399a1104500bdd4fea053ff73ec, State: Running, Role: LEADER
I20260811 08:15:11.447026 6340 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd90e399a1104500bdd4fea053ff73ec [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:15:11.447146 6345 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd90e399a1104500bdd4fea053ff73ec [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd90e399a1104500bdd4fea053ff73ec" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 35717 } }
I20260811 08:15:11.447532 6348 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd90e399a1104500bdd4fea053ff73ec [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd90e399a1104500bdd4fea053ff73ec. Latest consensus state: current_term: 1 leader_uuid: "cd90e399a1104500bdd4fea053ff73ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd90e399a1104500bdd4fea053ff73ec" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 35717 } } }
I20260811 08:15:11.447546 6346 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd90e399a1104500bdd4fea053ff73ec [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd90e399a1104500bdd4fea053ff73ec" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd90e399a1104500bdd4fea053ff73ec" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 35717 } } }
I20260811 08:15:11.447638 6348 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd90e399a1104500bdd4fea053ff73ec [sys.catalog]: This master's current role is: LEADER
I20260811 08:15:11.447880 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 6236
I20260811 08:15:11.447641 6346 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd90e399a1104500bdd4fea053ff73ec [sys.catalog]: This master's current role is: LEADER
I20260811 08:15:11.447986 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:15:11.448160 21114 external_mini_cluster.cc:1428] Setting key b55e46dc934d10a0ff2b2f8ae47f5203
I20260811 08:15:11.448767 6359 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:15:11.448918 6340 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 08:15:11.449455 6359 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:15:11.456389 6359 catalog_manager.cc:1347] Generated new cluster ID: 9e77068e4f2949cc9b55a992ff62fdc2
I20260811 08:15:11.456499 6359 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:15:11 dist-test-slave-gkw7 krb5kdc[5543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436111, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:15:11.466213 6376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:15:11.448816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54680 (local address 127.20.158.190:35717)
0811 08:15:11.452290 (+ 3474us) server_negotiation.cc:206] Beginning negotiation
0811 08:15:11.452316 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0811 08:15:11.452376 (+ 60us) server_negotiation.cc:407] Connection header received
0811 08:15:11.452651 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:15:11.452659 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:15:11.452747 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:15:11.452952 (+ 205us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:15:11.453795 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:15:11.455698 (+ 1903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:15:11.456816 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:15:11.457553 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:15:11.459459 (+ 1906us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:15:11.460582 (+ 1123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:15:11.460589 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:15:11.460590 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:15:11.460603 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:15:11.463871 (+ 3268us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:15:11.464312 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:15:11.464316 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:15:11.464316 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:15:11.464434 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:15:11.464641 (+ 207us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:15:11.464642 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:15:11.464642 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:15:11.465000 (+ 358us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:15:11.465654 (+ 654us) server_negotiation.cc:1035] Waiting for connection context
0811 08:15:11.465736 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 08:15:11.465893 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3349,"thread_start_us":81,"threads_started":1}
I20260811 08:15:11.480573 6359 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:15:11.481480 6359 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:15:11.486213 6359 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cd90e399a1104500bdd4fea053ff73ec: Generated new TSK 0
I20260811 08:15:11.486486 6359 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.158.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
I20260811 08:15:12.285950 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.158.148:56155/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:0
--local_ip_for_outbound_sockets=127.20.158.129
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:35717
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:33047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:15:12.408260 6425 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:15:12.408526 6425 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:15:12.408569 6425 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:15:12.409915 6425 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:15:12.409981 6425 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:15:12.410032 6425 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:15:12.411685 6425 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:33047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.20.158.148:56155/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:35717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6425
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:15:12.411972 6425 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:15:12.412240 6425 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:15:12.419092 6431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:15:12.419106 6432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:15:12.419265 6425 server_base.cc:1034] running on GCE node
W20260811 08:15:12.419443 6434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:15:12.419662 6425 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:15:12.419957 6425 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:15:12.421135 6425 hybrid_clock.cc:648] HybridClock initialized: now 1786436112421115 us; error 38 us; skew 500 ppm
Aug 11 08:15:12 dist-test-slave-gkw7 krb5kdc[5543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436112, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:15:12.424542 6425 init.cc:377] Logged in from keytab as kudu/127.20.158.129@KRBTEST.COM (short username kudu)
I20260811 08:15:12.425138 6425 webserver.cc:460] Webserver started at http://127.20.158.129:32825/ using document root <none> and password file <none>
I20260811 08:15:12.425400 6425 fs_manager.cc:359] Metadata directory not provided
I20260811 08:15:12.425462 6425 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:15:12.425609 6425 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 08:15:12 dist-test-slave-gkw7 krb5kdc[5543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436112, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for HTTP/127.20.158.148@KRBTEST.COM
I20260811 08:15:12.444573 6425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-0/data/instance:
uuid: "cdf4dceffb564b78ad2d6a99a44a40b4"
format_stamp: "Formatted at 2026-08-11 08:15:12 on dist-test-slave-gkw7"
server_key: "c8693eaa432f1c15625d7c96878ff92f"
server_key_iv: "40522c3efaa6f79614751464893da22a"
server_key_version: "kuduclusterkey@0"
I20260811 08:15:12.445060 6425 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance:
uuid: "cdf4dceffb564b78ad2d6a99a44a40b4"
format_stamp: "Formatted at 2026-08-11 08:15:12 on dist-test-slave-gkw7"
server_key: "c8693eaa432f1c15625d7c96878ff92f"
server_key_iv: "40522c3efaa6f79614751464893da22a"
server_key_version: "kuduclusterkey@0"
I20260811 08:15:12.446991 6425 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.002s
I20260811 08:15:12.464203 6445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:15:12.464567 6425 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:15:12.464784 6425 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "cdf4dceffb564b78ad2d6a99a44a40b4"
format_stamp: "Formatted at 2026-08-11 08:15:12 on dist-test-slave-gkw7"
server_key: "c8693eaa432f1c15625d7c96878ff92f"
server_key_iv: "40522c3efaa6f79614751464893da22a"
server_key_version: "kuduclusterkey@0"
I20260811 08:15:12.464905 6425 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:15:12.490183 6425 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:15:12.492705 6425 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:15:12.492913 6425 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:15:12.493177 6425 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:15:12.493618 6425 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:15:12.493712 6425 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:15:12.493813 6425 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:15:12.493883 6425 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:15:12.500912 6425 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:42833
I20260811 08:15:12.503818 6632 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:42833 every 8 connection(s)
I20260811 08:15:12.504048 6425 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:15:12.504334 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 6425
I20260811 08:15:12.504454 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance
I20260811 08:15:12.504709 21114 external_mini_cluster.cc:1428] Setting key e24314806905363f487756bcada5d305
Aug 11 08:15:12 dist-test-slave-gkw7 krb5kdc[5543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436112, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:15:12.516425 6640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:15:12.505344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:58033 (local address 127.20.158.190:35717)
0811 08:15:12.506274 (+ 930us) server_negotiation.cc:206] Beginning negotiation
0811 08:15:12.506276 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:15:12.506284 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:15:12.506309 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:15:12.506310 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:15:12.506323 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:15:12.506400 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:15:12.507213 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:15:12.508019 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:15:12.509633 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:15:12.509935 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:15:12.510011 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:15:12.512850 (+ 2839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:15:12.512851 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:15:12.512851 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:15:12.512859 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:15:12.514824 (+ 1965us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:15:12.515337 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:15:12.515338 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:15:12.515339 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:15:12.515404 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:15:12.515703 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:15:12.515704 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:15:12.515704 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:15:12.515843 (+ 139us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:15:12.515946 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 08:15:12.516240 (+ 294us) server_negotiation.cc:299] Negotiation successful
0811 08:15:12.516325 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":905,"thread_start_us":58,"threads_started":1}
I20260811 08:15:12.516635 6639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:15:12.504976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:35717 (local address 127.20.158.129:58033)
0811 08:15:12.505312 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0811 08:15:12.505359 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 08:15:12.506074 (+ 715us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:15:12.506530 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:15:12.506536 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:15:12.506810 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:15:12.507100 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:15:12.507106 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:15:12.508127 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:15:12.508128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:15:12.509495 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:15:12.509498 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:15:12.510032 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:15:12.510033 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:15:12.510260 (+ 227us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:15:12.510922 (+ 662us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:15:12.510933 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:15:12.512739 (+ 1806us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:15:12.514929 (+ 2190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:15:12.514936 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:15:12.514938 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:15:12.515244 (+ 306us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:15:12.515482 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:15:12.515482 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:15:12.515483 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:15:12.515646 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:15:12.515933 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:15:12.515940 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:15:12.516089 (+ 149us) client_negotiation.cc:769] Sending connection context
0811 08:15:12.516219 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 08:15:12.516371 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":290,"thread_start_us":86,"threads_started":1}
I20260811 08:15:12.517416 6634 heartbeater.cc:347] Connected to a master server at 127.20.158.190:35717
I20260811 08:15:12.517558 6634 heartbeater.cc:464] Registering TS with master...
I20260811 08:15:12.517758 6634 heartbeater.cc:511] Master 127.20.158.190:35717 requested a full tablet report, sending...
I20260811 08:15:12.518326 6281 ts_manager.cc:194] Registered new tserver with Master: cdf4dceffb564b78ad2d6a99a44a40b4 (127.20.158.129:42833)
I20260811 08:15:12.518931 6281 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.129@KRBTEST.COM'} at 127.20.158.129:58033
WARNING: no policy specified for kudu/127.20.158.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
I20260811 08:15:12.544827 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.158.148:56155/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:0
--local_ip_for_outbound_sockets=127.20.158.130
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:35717
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:33047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:15:12.669977 6644 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:15:12.670337 6644 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:15:12.670413 6644 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:15:12.672520 6644 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:15:12.672613 6644 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:15:12.672668 6644 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:15:12.674870 6644 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:33047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.20.158.148:56155/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:35717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6644
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:15:12.675267 6644 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:15:12.675560 6644 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:15:12.682247 6658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:15:12.682411 6662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:15:12.682232 6657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:15:12.683040 6644 server_base.cc:1034] running on GCE node
I20260811 08:15:12.683283 6644 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:15:12.683598 6644 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:15:12.684782 6644 hybrid_clock.cc:648] HybridClock initialized: now 1786436112684759 us; error 37 us; skew 500 ppm
Aug 11 08:15:12 dist-test-slave-gkw7 krb5kdc[5543](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786436112, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 11 08:15:12 dist-test-slave-gkw7 krb5kdc[5543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436112, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:15:12.688222 6644 init.cc:377] Logged in from keytab as kudu/127.20.158.130@KRBTEST.COM (short username kudu)
I20260811 08:15:12.688804 6644 webserver.cc:460] Webserver started at http://127.20.158.130:35845/ using document root <none> and password file <none>
I20260811 08:15:12.689096 6644 fs_manager.cc:359] Metadata directory not provided
I20260811 08:15:12.689165 6644 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:15:12.689368 6644 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 08:15:12 dist-test-slave-gkw7 krb5kdc[5543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436112, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for HTTP/127.20.158.148@KRBTEST.COM
I20260811 08:15:12.704224 6644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-1/data/instance:
uuid: "e01b2acf67f5486ab178001b1dd7af9d"
format_stamp: "Formatted at 2026-08-11 08:15:12 on dist-test-slave-gkw7"
server_key: "3023b6562cf75f1eb8a5d1e832e5a1ce"
server_key_iv: "5cb1441457543cddbc2e248477b499ab"
server_key_version: "kuduclusterkey@0"
I20260811 08:15:12.704803 6644 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance:
uuid: "e01b2acf67f5486ab178001b1dd7af9d"
format_stamp: "Formatted at 2026-08-11 08:15:12 on dist-test-slave-gkw7"
server_key: "3023b6562cf75f1eb8a5d1e832e5a1ce"
server_key_iv: "5cb1441457543cddbc2e248477b499ab"
server_key_version: "kuduclusterkey@0"
I20260811 08:15:12.716137 6644 fs_manager.cc:691] Time spent creating directory manager: real 0.011s user 0.000s sys 0.002s
I20260811 08:15:12.742347 6673 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:15:12.742632 6644 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:15:12.742744 6644 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "e01b2acf67f5486ab178001b1dd7af9d"
format_stamp: "Formatted at 2026-08-11 08:15:12 on dist-test-slave-gkw7"
server_key: "3023b6562cf75f1eb8a5d1e832e5a1ce"
server_key_iv: "5cb1441457543cddbc2e248477b499ab"
server_key_version: "kuduclusterkey@0"
I20260811 08:15:12.742854 6644 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:15:12.764122 6644 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:15:12.766686 6644 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:15:12.766855 6644 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:15:12.767105 6644 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:15:12.767501 6644 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:15:12.767556 6644 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:15:12.767601 6644 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:15:12.767630 6644 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:15:12.776358 6644 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:39961
I20260811 08:15:12.776448 6855 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:39961 every 8 connection(s)
I20260811 08:15:12.776897 6644 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
I20260811 08:15:12.777758 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 6644
I20260811 08:15:12.777884 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance
I20260811 08:15:12.778105 21114 external_mini_cluster.cc:1428] Setting key 1a099c7c06dd7534928ffbc218cf8be4
Aug 11 08:15:12 dist-test-slave-gkw7 krb5kdc[5543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436112, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.158.131@KRBTEST.COM; defaulting to no policy
I20260811 08:15:12.789732 6640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:15:12.777786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:55315 (local address 127.20.158.190:35717)
0811 08:15:12.777840 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 08:15:12.777843 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:15:12.778262 (+ 419us) server_negotiation.cc:407] Connection header received
0811 08:15:12.778921 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:15:12.778922 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:15:12.778937 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:15:12.778984 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:15:12.779695 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:15:12.780523 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:15:12.782167 (+ 1644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:15:12.782471 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:15:12.782516 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:15:12.786128 (+ 3612us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:15:12.786130 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:15:12.786131 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:15:12.786138 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:15:12.787930 (+ 1792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:15:12.788450 (+ 520us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:15:12.788452 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:15:12.788452 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:15:12.788515 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:15:12.788866 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:15:12.788867 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:15:12.788868 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:15:12.789014 (+ 146us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:15:12.789062 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 08:15:12.789446 (+ 384us) server_negotiation.cc:299] Negotiation successful
0811 08:15:12.789616 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:15:12.790247 6860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:15:12.777745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:35717 (local address 127.20.158.130:55315)
0811 08:15:12.778113 (+ 368us) negotiation.cc:107] Waiting for socket to connect
0811 08:15:12.778166 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 08:15:12.778817 (+ 651us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:15:12.779060 (+ 243us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:15:12.779066 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:15:12.779310 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:15:12.779594 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:15:12.779600 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:15:12.780645 (+ 1045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:15:12.780646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:15:12.782059 (+ 1413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:15:12.782063 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:15:12.782627 (+ 564us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:15:12.782628 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:15:12.782774 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:15:12.784198 (+ 1424us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:15:12.784209 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:15:12.786006 (+ 1797us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:15:12.788037 (+ 2031us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:15:12.788044 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:15:12.788046 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:15:12.788351 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:15:12.788605 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:15:12.788606 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:15:12.788606 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:15:12.788774 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:15:12.789116 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:15:12.789122 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:15:12.789291 (+ 169us) client_negotiation.cc:769] Sending connection context
0811 08:15:12.789841 (+ 550us) client_negotiation.cc:240] Negotiation successful
0811 08:15:12.790014 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":93,"threads_started":1}
I20260811 08:15:12.790836 6857 heartbeater.cc:347] Connected to a master server at 127.20.158.190:35717
I20260811 08:15:12.790948 6857 heartbeater.cc:464] Registering TS with master...
I20260811 08:15:12.791149 6857 heartbeater.cc:511] Master 127.20.158.190:35717 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.131@KRBTEST.COM" created.
I20260811 08:15:12.791566 6281 ts_manager.cc:194] Registered new tserver with Master: e01b2acf67f5486ab178001b1dd7af9d (127.20.158.130:39961)
I20260811 08:15:12.792089 6281 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.130@KRBTEST.COM'} at 127.20.158.130:55315
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
I20260811 08:15:12.810925 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.158.148:56155/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:0
--local_ip_for_outbound_sockets=127.20.158.131
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:35717
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:33047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:15:12.932339 6865 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:15:12.932706 6865 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:15:12.932843 6865 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:15:12.934470 6865 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:15:12.934554 6865 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:15:12.934600 6865 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:15:12.936077 6865 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:33047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.20.158.148:56155/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:35717
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6865
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:15:12.936360 6865 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:15:12.936609 6865 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:15:12.943135 6877 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:15:12.943256 6879 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:15:12.943135 6875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:15:12.943800 6865 server_base.cc:1034] running on GCE node
I20260811 08:15:12.944036 6865 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:15:12.944288 6865 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:15:12.945458 6865 hybrid_clock.cc:648] HybridClock initialized: now 1786436112945433 us; error 42 us; skew 500 ppm
Aug 11 08:15:12 dist-test-slave-gkw7 krb5kdc[5543](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436112, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:15:12.948342 6865 init.cc:377] Logged in from keytab as kudu/127.20.158.131@KRBTEST.COM (short username kudu)
I20260811 08:15:12.948871 6865 webserver.cc:460] Webserver started at http://127.20.158.131:45399/ using document root <none> and password file <none>
I20260811 08:15:12.949115 6865 fs_manager.cc:359] Metadata directory not provided
I20260811 08:15:12.949160 6865 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:15:12.949303 6865 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 08:15:12 dist-test-slave-gkw7 krb5kdc[5543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436112, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for HTTP/127.20.158.148@KRBTEST.COM
I20260811 08:15:12.964337 6865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-2/data/instance:
uuid: "1029c438accf4e30840206fad3b83740"
format_stamp: "Formatted at 2026-08-11 08:15:12 on dist-test-slave-gkw7"
server_key: "1fe72d4f24c9ef9c0bcf55aa8d4afd2d"
server_key_iv: "a29f498f60d62b9e5b5c213d7d9a247c"
server_key_version: "kuduclusterkey@0"
I20260811 08:15:12.965273 6865 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance:
uuid: "1029c438accf4e30840206fad3b83740"
format_stamp: "Formatted at 2026-08-11 08:15:12 on dist-test-slave-gkw7"
server_key: "1fe72d4f24c9ef9c0bcf55aa8d4afd2d"
server_key_iv: "a29f498f60d62b9e5b5c213d7d9a247c"
server_key_version: "kuduclusterkey@0"
I20260811 08:15:12.968209 6865 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.002s
I20260811 08:15:12.988723 6890 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:15:12.988961 6865 fs_manager.cc:725] Time spent opening block manager: real 0.006s user 0.001s sys 0.000s
I20260811 08:15:12.989059 6865 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "1029c438accf4e30840206fad3b83740"
format_stamp: "Formatted at 2026-08-11 08:15:12 on dist-test-slave-gkw7"
server_key: "1fe72d4f24c9ef9c0bcf55aa8d4afd2d"
server_key_iv: "a29f498f60d62b9e5b5c213d7d9a247c"
server_key_version: "kuduclusterkey@0"
I20260811 08:15:12.989154 6865 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:15:13.002202 6865 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:15:13.004355 6865 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:15:13.004549 6865 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:15:13.004859 6865 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:15:13.005234 6865 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:15:13.005301 6865 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:15:13.005352 6865 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:15:13.005393 6865 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:15:13.013854 6865 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:44751
I20260811 08:15:13.014397 6865 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
I20260811 08:15:13.022075 7049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:44751 every 8 connection(s)
I20260811 08:15:13.022279 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 6865
I20260811 08:15:13.022387 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance
I20260811 08:15:13.022578 21114 external_mini_cluster.cc:1428] Setting key 35cd07650ee3c5b621e57f80a760d707
Aug 11 08:15:13 dist-test-slave-gkw7 krb5kdc[5543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436112, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:15:13.033236 6640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:15:13.023531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:51627 (local address 127.20.158.190:35717)
0811 08:15:13.023624 (+ 93us) server_negotiation.cc:206] Beginning negotiation
0811 08:15:13.023626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:15:13.024080 (+ 454us) server_negotiation.cc:407] Connection header received
0811 08:15:13.024597 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:15:13.024598 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:15:13.024609 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:15:13.024674 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:15:13.025260 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.025878 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.027362 (+ 1484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.027588 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.027679 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:15:13.030099 (+ 2420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:15:13.030101 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:15:13.030101 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:15:13.030109 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:15:13.031709 (+ 1600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:15:13.032223 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:15:13.032225 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:15:13.032225 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:15:13.032288 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:15:13.032563 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:15:13.032564 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:15:13.032564 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:15:13.032690 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:15:13.032766 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 08:15:13.033050 (+ 284us) server_negotiation.cc:299] Negotiation successful
0811 08:15:13.033143 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 08:15:13.033435 7054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:15:13.023758 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:35717 (local address 127.20.158.131:51627)
0811 08:15:13.023943 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0811 08:15:13.023986 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 08:15:13.024491 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:15:13.024753 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:15:13.024756 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:15:13.024951 (+ 195us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:15:13.025159 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:15:13.025164 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.025987 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.025989 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:15:13.027253 (+ 1264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:15:13.027256 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.027779 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.027780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:15:13.027887 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:15:13.028455 (+ 568us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:15:13.028466 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:15:13.029981 (+ 1515us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:15:13.031807 (+ 1826us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:15:13.031814 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:15:13.031817 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:15:13.032112 (+ 295us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:15:13.032365 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:15:13.032365 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:15:13.032366 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:15:13.032479 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:15:13.032768 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:15:13.032776 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:15:13.032908 (+ 132us) client_negotiation.cc:769] Sending connection context
0811 08:15:13.033016 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 08:15:13.033178 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":109,"threads_started":1}
I20260811 08:15:13.034000 7052 heartbeater.cc:347] Connected to a master server at 127.20.158.190:35717
I20260811 08:15:13.034102 7052 heartbeater.cc:464] Registering TS with master...
I20260811 08:15:13.034775 7052 heartbeater.cc:511] Master 127.20.158.190:35717 requested a full tablet report, sending...
I20260811 08:15:13.035202 6281 ts_manager.cc:194] Registered new tserver with Master: 1029c438accf4e30840206fad3b83740 (127.20.158.131:44751)
I20260811 08:15:13.035571 6281 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.131@KRBTEST.COM'} at 127.20.158.131:51627
I20260811 08:15:13.045595 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:15:13.055073 6640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:15:13.047259 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54694 (local address 127.20.158.190:35717)
0811 08:15:13.047317 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 08:15:13.047319 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:15:13.047539 (+ 220us) server_negotiation.cc:407] Connection header received
0811 08:15:13.047611 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:15:13.047613 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:15:13.047625 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:15:13.047670 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:15:13.048971 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.049808 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.050641 (+ 833us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.050852 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.050932 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:15:13.052232 (+ 1300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:15:13.052234 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:15:13.052234 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:15:13.052242 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:15:13.053872 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:15:13.054248 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:15:13.054249 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:15:13.054250 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:15:13.054315 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:15:13.054529 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:15:13.054530 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:15:13.054530 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:15:13.054654 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:15:13.054761 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 08:15:13.054877 (+ 116us) server_negotiation.cc:299] Negotiation successful
0811 08:15:13.054960 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 08:15:13.056990 6281 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54694:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:15:13.059140 6281 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:15:13.069979 7073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:15:13.063460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:42833 (local address 127.0.0.1:58288)
0811 08:15:13.064715 (+ 1255us) negotiation.cc:107] Waiting for socket to connect
0811 08:15:13.064765 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 08:15:13.064866 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:15:13.065144 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:15:13.065148 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:15:13.065150 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:15:13.065226 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:15:13.065230 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.066929 (+ 1699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.066930 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:15:13.068315 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:15:13.068318 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.069690 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.069691 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:15:13.069766 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:15:13.069778 (+ 12us) client_negotiation.cc:769] Sending connection context
0811 08:15:13.069842 (+ 64us) client_negotiation.cc:240] Negotiation successful
0811 08:15:13.069889 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1224,"thread_start_us":104,"threads_started":1}
I20260811 08:15:13.070770 7074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:15:13.063872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58288 (local address 127.20.158.129:42833)
0811 08:15:13.064546 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0811 08:15:13.064552 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 08:15:13.064846 (+ 294us) server_negotiation.cc:407] Connection header received
0811 08:15:13.064949 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:15:13.064952 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:15:13.064972 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:15:13.065051 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:15:13.065311 (+ 260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.066828 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.068709 (+ 1881us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.069501 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.069599 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:15:13.069658 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 08:15:13.070649 (+ 991us) server_negotiation.cc:299] Negotiation successful
0811 08:15:13.070692 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":633,"thread_start_us":72,"threads_started":1}
I20260811 08:15:13.071565 6532 tablet_service.cc:1467] Processing CreateTablet for tablet 7d6ccff8b1d34758b1d462034acaade7 (DEFAULT_TABLE table=test-table [id=b223691cf49b4633b00664a11eed7f55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:15:13.071982 6532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d6ccff8b1d34758b1d462034acaade7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:15:13.078701 7071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:15:13.063462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:44751 (local address 127.0.0.1:55450)
0811 08:15:13.065099 (+ 1637us) negotiation.cc:107] Waiting for socket to connect
0811 08:15:13.065110 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:15:13.065158 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:15:13.065428 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:15:13.065429 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:15:13.065431 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:15:13.065463 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:15:13.065465 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.068756 (+ 3291us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.068757 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:15:13.069965 (+ 1208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:15:13.069968 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.078445 (+ 8477us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.078446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:15:13.078516 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:15:13.078520 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:15:13.078572 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 08:15:13.078615 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1612,"mutex_wait_us":4,"spinlock_wait_cycles":896,"thread_start_us":101,"threads_started":1}
I20260811 08:15:13.079866 7079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:15:13.064041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55450 (local address 127.20.158.131:44751)
0811 08:15:13.064669 (+ 628us) server_negotiation.cc:206] Beginning negotiation
0811 08:15:13.064673 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:15:13.065216 (+ 543us) server_negotiation.cc:407] Connection header received
0811 08:15:13.065263 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:15:13.065265 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:15:13.065283 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:15:13.065359 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:15:13.067077 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.068673 (+ 1596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.070523 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.074599 (+ 4076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.078342 (+ 3743us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:15:13.078418 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 08:15:13.079727 (+ 1309us) server_negotiation.cc:299] Negotiation successful
0811 08:15:13.079780 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":588,"thread_start_us":80,"threads_started":1}
I20260811 08:15:13.080659 7073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:15:13.063731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:39961 (local address 127.0.0.1:53034)
0811 08:15:13.070231 (+ 6500us) negotiation.cc:107] Waiting for socket to connect
0811 08:15:13.070241 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:15:13.070278 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:15:13.076349 (+ 6071us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:15:13.076350 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:15:13.076352 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:15:13.076393 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:15:13.076394 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.077773 (+ 1379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.077774 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:15:13.078811 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:15:13.078815 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.080416 (+ 1601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.080417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:15:13.080481 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:15:13.080486 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:15:13.080538 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 08:15:13.080579 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6489,"thread_start_us":76,"threads_started":1}
I20260811 08:15:13.080811 6957 tablet_service.cc:1467] Processing CreateTablet for tablet 7d6ccff8b1d34758b1d462034acaade7 (DEFAULT_TABLE table=test-table [id=b223691cf49b4633b00664a11eed7f55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:15:13.080941 7076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:15:13.063956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53034 (local address 127.20.158.130:39961)
0811 08:15:13.065035 (+ 1079us) server_negotiation.cc:206] Beginning negotiation
0811 08:15:13.065040 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:15:13.070337 (+ 5297us) server_negotiation.cc:407] Connection header received
0811 08:15:13.070387 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:15:13.070390 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:15:13.070408 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:15:13.070528 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:15:13.076491 (+ 5963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.077666 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.078927 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.080012 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.080102 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:15:13.080381 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0811 08:15:13.080820 (+ 439us) server_negotiation.cc:299] Negotiation successful
0811 08:15:13.080865 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1035,"thread_start_us":76,"threads_started":1}
I20260811 08:15:13.081211 6957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d6ccff8b1d34758b1d462034acaade7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:15:13.081557 6743 tablet_service.cc:1467] Processing CreateTablet for tablet 7d6ccff8b1d34758b1d462034acaade7 (DEFAULT_TABLE table=test-table [id=b223691cf49b4633b00664a11eed7f55]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:15:13.081946 6743 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d6ccff8b1d34758b1d462034acaade7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:15:13.086027 7085 tablet_bootstrap.cc:492] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d: Bootstrap starting.
I20260811 08:15:13.086334 7080 tablet_bootstrap.cc:492] T 7d6ccff8b1d34758b1d462034acaade7 P cdf4dceffb564b78ad2d6a99a44a40b4: Bootstrap starting.
I20260811 08:15:13.087312 7080 tablet_bootstrap.cc:654] T 7d6ccff8b1d34758b1d462034acaade7 P cdf4dceffb564b78ad2d6a99a44a40b4: Neither blocks nor log segments found. Creating new log.
I20260811 08:15:13.087550 7085 tablet_bootstrap.cc:654] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d: Neither blocks nor log segments found. Creating new log.
I20260811 08:15:13.087695 7080 log.cc:824] T 7d6ccff8b1d34758b1d462034acaade7 P cdf4dceffb564b78ad2d6a99a44a40b4: Log is configured to *not* fsync() on all Append() calls
I20260811 08:15:13.088104 7084 tablet_bootstrap.cc:492] T 7d6ccff8b1d34758b1d462034acaade7 P 1029c438accf4e30840206fad3b83740: Bootstrap starting.
I20260811 08:15:13.088094 7085 log.cc:824] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d: Log is configured to *not* fsync() on all Append() calls
I20260811 08:15:13.089037 7085 tablet_bootstrap.cc:492] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d: No bootstrap required, opened a new log
I20260811 08:15:13.089123 7085 ts_tablet_manager.cc:1397] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 08:15:13.089231 7084 tablet_bootstrap.cc:654] T 7d6ccff8b1d34758b1d462034acaade7 P 1029c438accf4e30840206fad3b83740: Neither blocks nor log segments found. Creating new log.
I20260811 08:15:13.089732 7084 log.cc:824] T 7d6ccff8b1d34758b1d462034acaade7 P 1029c438accf4e30840206fad3b83740: Log is configured to *not* fsync() on all Append() calls
I20260811 08:15:13.090544 7080 tablet_bootstrap.cc:492] T 7d6ccff8b1d34758b1d462034acaade7 P cdf4dceffb564b78ad2d6a99a44a40b4: No bootstrap required, opened a new log
I20260811 08:15:13.090617 7080 ts_tablet_manager.cc:1397] T 7d6ccff8b1d34758b1d462034acaade7 P cdf4dceffb564b78ad2d6a99a44a40b4: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260811 08:15:13.091786 7085 raft_consensus.cc:348] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf4dceffb564b78ad2d6a99a44a40b4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42833 } } peers { permanent_uuid: "1029c438accf4e30840206fad3b83740" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44751 } } peers { permanent_uuid: "e01b2acf67f5486ab178001b1dd7af9d" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 39961 } }
I20260811 08:15:13.091974 7085 raft_consensus.cc:374] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:15:13.092010 7085 raft_consensus.cc:729] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e01b2acf67f5486ab178001b1dd7af9d, State: Initialized, Role: FOLLOWER
I20260811 08:15:13.092751 7085 consensus_queue.cc:260] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf4dceffb564b78ad2d6a99a44a40b4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42833 } } peers { permanent_uuid: "1029c438accf4e30840206fad3b83740" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44751 } } peers { permanent_uuid: "e01b2acf67f5486ab178001b1dd7af9d" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 39961 } }
I20260811 08:15:13.093205 7085 ts_tablet_manager.cc:1428] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260811 08:15:13.093411 6857 heartbeater.cc:503] Master 127.20.158.190:35717 was elected leader, sending a full tablet report...
I20260811 08:15:13.093967 7080 raft_consensus.cc:348] T 7d6ccff8b1d34758b1d462034acaade7 P cdf4dceffb564b78ad2d6a99a44a40b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf4dceffb564b78ad2d6a99a44a40b4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42833 } } peers { permanent_uuid: "1029c438accf4e30840206fad3b83740" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44751 } } peers { permanent_uuid: "e01b2acf67f5486ab178001b1dd7af9d" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 39961 } }
I20260811 08:15:13.094123 7080 raft_consensus.cc:374] T 7d6ccff8b1d34758b1d462034acaade7 P cdf4dceffb564b78ad2d6a99a44a40b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:15:13.094161 7080 raft_consensus.cc:729] T 7d6ccff8b1d34758b1d462034acaade7 P cdf4dceffb564b78ad2d6a99a44a40b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdf4dceffb564b78ad2d6a99a44a40b4, State: Initialized, Role: FOLLOWER
I20260811 08:15:13.094292 7080 consensus_queue.cc:260] T 7d6ccff8b1d34758b1d462034acaade7 P cdf4dceffb564b78ad2d6a99a44a40b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf4dceffb564b78ad2d6a99a44a40b4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42833 } } peers { permanent_uuid: "1029c438accf4e30840206fad3b83740" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44751 } } peers { permanent_uuid: "e01b2acf67f5486ab178001b1dd7af9d" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 39961 } }
I20260811 08:15:13.094683 7080 ts_tablet_manager.cc:1428] T 7d6ccff8b1d34758b1d462034acaade7 P cdf4dceffb564b78ad2d6a99a44a40b4: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260811 08:15:13.094805 6634 heartbeater.cc:503] Master 127.20.158.190:35717 was elected leader, sending a full tablet report...
I20260811 08:15:13.095950 7084 tablet_bootstrap.cc:492] T 7d6ccff8b1d34758b1d462034acaade7 P 1029c438accf4e30840206fad3b83740: No bootstrap required, opened a new log
I20260811 08:15:13.096052 7084 ts_tablet_manager.cc:1397] T 7d6ccff8b1d34758b1d462034acaade7 P 1029c438accf4e30840206fad3b83740: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.000s
I20260811 08:15:13.097970 7084 raft_consensus.cc:348] T 7d6ccff8b1d34758b1d462034acaade7 P 1029c438accf4e30840206fad3b83740 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf4dceffb564b78ad2d6a99a44a40b4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42833 } } peers { permanent_uuid: "1029c438accf4e30840206fad3b83740" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44751 } } peers { permanent_uuid: "e01b2acf67f5486ab178001b1dd7af9d" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 39961 } }
I20260811 08:15:13.098201 7084 raft_consensus.cc:374] T 7d6ccff8b1d34758b1d462034acaade7 P 1029c438accf4e30840206fad3b83740 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:15:13.098258 7084 raft_consensus.cc:729] T 7d6ccff8b1d34758b1d462034acaade7 P 1029c438accf4e30840206fad3b83740 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1029c438accf4e30840206fad3b83740, State: Initialized, Role: FOLLOWER
I20260811 08:15:13.098376 7084 consensus_queue.cc:260] T 7d6ccff8b1d34758b1d462034acaade7 P 1029c438accf4e30840206fad3b83740 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf4dceffb564b78ad2d6a99a44a40b4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42833 } } peers { permanent_uuid: "1029c438accf4e30840206fad3b83740" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44751 } } peers { permanent_uuid: "e01b2acf67f5486ab178001b1dd7af9d" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 39961 } }
I20260811 08:15:13.098703 7084 ts_tablet_manager.cc:1428] T 7d6ccff8b1d34758b1d462034acaade7 P 1029c438accf4e30840206fad3b83740: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260811 08:15:13.098949 7052 heartbeater.cc:503] Master 127.20.158.190:35717 was elected leader, sending a full tablet report...
Aug 11 08:15:13 dist-test-slave-gkw7 krb5kdc[5543](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436112, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for HTTP/127.20.158.148@KRBTEST.COM
I20260811 08:15:13.187752 7093 raft_consensus.cc:482] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:15:13.187927 7093 raft_consensus.cc:504] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf4dceffb564b78ad2d6a99a44a40b4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42833 } } peers { permanent_uuid: "1029c438accf4e30840206fad3b83740" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44751 } } peers { permanent_uuid: "e01b2acf67f5486ab178001b1dd7af9d" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 39961 } }
I20260811 08:15:13.188488 7093 leader_election.cc:288] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdf4dceffb564b78ad2d6a99a44a40b4 (127.20.158.129:42833), 1029c438accf4e30840206fad3b83740 (127.20.158.131:44751)
I20260811 08:15:13.193316 6860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:15:13.188777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:44751 (local address 127.20.158.130:59835)
0811 08:15:13.188838 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 08:15:13.188856 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 08:15:13.188920 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:15:13.189605 (+ 685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:15:13.189606 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:15:13.189609 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:15:13.189682 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:15:13.189684 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.190663 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.190664 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:15:13.191991 (+ 1327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:15:13.191995 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.192955 (+ 960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.192956 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:15:13.193120 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:15:13.193125 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:15:13.193183 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 08:15:13.193237 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260811 08:15:13.194000 7079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:15:13.189018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:59835 (local address 127.20.158.131:44751)
0811 08:15:13.189062 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:15:13.189064 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:15:13.189073 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:15:13.189101 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:15:13.189102 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:15:13.189114 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:15:13.189180 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:15:13.189780 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.190539 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.192247 (+ 1708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.192832 (+ 585us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.192906 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:15:13.192916 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:15:13.193876 (+ 960us) server_negotiation.cc:299] Negotiation successful
0811 08:15:13.193928 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:15:13.194315 6990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d6ccff8b1d34758b1d462034acaade7" candidate_uuid: "e01b2acf67f5486ab178001b1dd7af9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1029c438accf4e30840206fad3b83740" is_pre_election: true
I20260811 08:15:13.194495 6990 raft_consensus.cc:2454] T 7d6ccff8b1d34758b1d462034acaade7 P 1029c438accf4e30840206fad3b83740 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e01b2acf67f5486ab178001b1dd7af9d in term 0.
I20260811 08:15:13.195039 6677 leader_election.cc:302] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1029c438accf4e30840206fad3b83740, e01b2acf67f5486ab178001b1dd7af9d; no voters:
I20260811 08:15:13.195269 7093 raft_consensus.cc:2781] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:15:13.195325 7093 raft_consensus.cc:482] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:15:13.195349 7093 raft_consensus.cc:3037] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:15:13.196605 7093 raft_consensus.cc:504] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf4dceffb564b78ad2d6a99a44a40b4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42833 } } peers { permanent_uuid: "1029c438accf4e30840206fad3b83740" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44751 } } peers { permanent_uuid: "e01b2acf67f5486ab178001b1dd7af9d" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 39961 } }
I20260811 08:15:13.196756 7093 leader_election.cc:288] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d [CANDIDATE]: Term 1 election: Requested vote from peers cdf4dceffb564b78ad2d6a99a44a40b4 (127.20.158.129:42833), 1029c438accf4e30840206fad3b83740 (127.20.158.131:44751)
I20260811 08:15:13.196768 7074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:15:13.189575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:51963 (local address 127.20.158.129:42833)
0811 08:15:13.189621 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 08:15:13.189623 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:15:13.193457 (+ 3834us) server_negotiation.cc:407] Connection header received
0811 08:15:13.193518 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:15:13.193520 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:15:13.193532 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:15:13.193604 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:15:13.193767 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.194429 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.195681 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.196334 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.196410 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:15:13.196421 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 08:15:13.196640 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 08:15:13.196685 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:15:13.197199 6860 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:15:13.189339 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:42833 (local address 127.20.158.130:51963)
0811 08:15:13.193397 (+ 4058us) negotiation.cc:107] Waiting for socket to connect
0811 08:15:13.193409 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:15:13.193463 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:15:13.193657 (+ 194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:15:13.193658 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:15:13.193659 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:15:13.193690 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:15:13.193691 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.194529 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.194530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:15:13.195552 (+ 1022us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:15:13.195555 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.196455 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.196456 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:15:13.196518 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:15:13.196522 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:15:13.196571 (+ 49us) client_negotiation.cc:240] Negotiation successful
0811 08:15:13.196608 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4046,"thread_start_us":116,"threads_started":1}
I20260811 08:15:13.197201 6990 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d6ccff8b1d34758b1d462034acaade7" candidate_uuid: "e01b2acf67f5486ab178001b1dd7af9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1029c438accf4e30840206fad3b83740"
I20260811 08:15:13.197285 6990 raft_consensus.cc:3037] T 7d6ccff8b1d34758b1d462034acaade7 P 1029c438accf4e30840206fad3b83740 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:15:13.198268 6990 raft_consensus.cc:2454] T 7d6ccff8b1d34758b1d462034acaade7 P 1029c438accf4e30840206fad3b83740 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e01b2acf67f5486ab178001b1dd7af9d in term 1.
I20260811 08:15:13.198495 6556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d6ccff8b1d34758b1d462034acaade7" candidate_uuid: "e01b2acf67f5486ab178001b1dd7af9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf4dceffb564b78ad2d6a99a44a40b4" is_pre_election: true
I20260811 08:15:13.198653 6556 raft_consensus.cc:2454] T 7d6ccff8b1d34758b1d462034acaade7 P cdf4dceffb564b78ad2d6a99a44a40b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e01b2acf67f5486ab178001b1dd7af9d in term 0.
I20260811 08:15:13.198752 6555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d6ccff8b1d34758b1d462034acaade7" candidate_uuid: "e01b2acf67f5486ab178001b1dd7af9d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdf4dceffb564b78ad2d6a99a44a40b4"
I20260811 08:15:13.198830 6555 raft_consensus.cc:3037] T 7d6ccff8b1d34758b1d462034acaade7 P cdf4dceffb564b78ad2d6a99a44a40b4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:15:13.199628 6555 raft_consensus.cc:2454] T 7d6ccff8b1d34758b1d462034acaade7 P cdf4dceffb564b78ad2d6a99a44a40b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e01b2acf67f5486ab178001b1dd7af9d in term 1.
I20260811 08:15:13.199859 6679 leader_election.cc:302] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cdf4dceffb564b78ad2d6a99a44a40b4, e01b2acf67f5486ab178001b1dd7af9d; no voters:
I20260811 08:15:13.199949 7093 raft_consensus.cc:2781] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:15:13.200119 7093 raft_consensus.cc:686] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d [term 1 LEADER]: Becoming Leader. State: Replica: e01b2acf67f5486ab178001b1dd7af9d, State: Running, Role: LEADER
I20260811 08:15:13.200219 7093 consensus_queue.cc:237] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf4dceffb564b78ad2d6a99a44a40b4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42833 } } peers { permanent_uuid: "1029c438accf4e30840206fad3b83740" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44751 } } peers { permanent_uuid: "e01b2acf67f5486ab178001b1dd7af9d" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 39961 } }
I20260811 08:15:13.201176 6281 catalog_manager.cc:5495] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d reported cstate change: term changed from 0 to 1, leader changed from <none> to e01b2acf67f5486ab178001b1dd7af9d (127.20.158.130). New cstate: current_term: 1 leader_uuid: "e01b2acf67f5486ab178001b1dd7af9d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cdf4dceffb564b78ad2d6a99a44a40b4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42833 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1029c438accf4e30840206fad3b83740" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44751 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e01b2acf67f5486ab178001b1dd7af9d" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 39961 } health_report { overall_health: HEALTHY } } }
I20260811 08:15:13.221844 7076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:15:13.217980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53038 (local address 127.20.158.130:39961)
0811 08:15:13.218031 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:15:13.218033 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:15:13.218069 (+ 36us) server_negotiation.cc:407] Connection header received
0811 08:15:13.218112 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:15:13.218113 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:15:13.218138 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:15:13.218208 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:15:13.218570 (+ 362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.219289 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.220426 (+ 1137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:15:13.220822 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:15:13.220913 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:15:13.221161 (+ 248us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:15:13.221308 (+ 147us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:15:13.221417 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0811 08:15:13.221657 (+ 240us) server_negotiation.cc:299] Negotiation successful
0811 08:15:13.221681 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:15:13.224339 6990 raft_consensus.cc:1261] T 7d6ccff8b1d34758b1d462034acaade7 P 1029c438accf4e30840206fad3b83740 [term 1 FOLLOWER]: Refusing update from remote peer e01b2acf67f5486ab178001b1dd7af9d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:15:13.224340 6555 raft_consensus.cc:1261] T 7d6ccff8b1d34758b1d462034acaade7 P cdf4dceffb564b78ad2d6a99a44a40b4 [term 1 FOLLOWER]: Refusing update from remote peer e01b2acf67f5486ab178001b1dd7af9d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:15:13.224709 7093 consensus_queue.cc:1035] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdf4dceffb564b78ad2d6a99a44a40b4" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 42833 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:15:13.224890 7101 consensus_queue.cc:1035] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1029c438accf4e30840206fad3b83740" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:15:13.231076 7106 mvcc.cc:205] Tried to move back new op lower bound from 7317242319763128320 to 7317242319668645888. Current Snapshot: MvccSnapshot[applied={T|T < 7317242319763128320}]
I20260811 08:15:13.234012 7112 mvcc.cc:205] Tried to move back new op lower bound from 7317242319763128320 to 7317242319668645888. Current Snapshot: MvccSnapshot[applied={T|T < 7317242319763128320}]
I20260811 08:15:13.235106 7111 mvcc.cc:205] Tried to move back new op lower bound from 7317242319763128320 to 7317242319668645888. Current Snapshot: MvccSnapshot[applied={T|T < 7317242319763128320}]
I20260811 08:15:13.236284 6280 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54694:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:15:13.236379 6280 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54694:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:15:13.237165 6280 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cd90e399a1104500bdd4fea053ff73ec: Sending DeleteTablet for 3 replicas of tablet 7d6ccff8b1d34758b1d462034acaade7
I20260811 08:15:13.237548 6532 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d6ccff8b1d34758b1d462034acaade7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:15:13 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:58288
I20260811 08:15:13.237799 6957 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d6ccff8b1d34758b1d462034acaade7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:15:13 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:55450
I20260811 08:15:13.238039 6743 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d6ccff8b1d34758b1d462034acaade7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:15:13 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:53034
I20260811 08:15:13.238618 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 6425
I20260811 08:15:13.246436 7130 tablet_replica.cc:330] T 7d6ccff8b1d34758b1d462034acaade7 P 1029c438accf4e30840206fad3b83740: stopping tablet replica
I20260811 08:15:13.246577 7130 raft_consensus.cc:2229] T 7d6ccff8b1d34758b1d462034acaade7 P 1029c438accf4e30840206fad3b83740 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:15:13.246701 7130 raft_consensus.cc:2258] T 7d6ccff8b1d34758b1d462034acaade7 P 1029c438accf4e30840206fad3b83740 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:15:13.247399 7130 ts_tablet_manager.cc:1905] T 7d6ccff8b1d34758b1d462034acaade7 P 1029c438accf4e30840206fad3b83740: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:15:13.249243 7130 ts_tablet_manager.cc:1918] T 7d6ccff8b1d34758b1d462034acaade7 P 1029c438accf4e30840206fad3b83740: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:15:13.249334 7130 log.cc:1196] T 7d6ccff8b1d34758b1d462034acaade7 P 1029c438accf4e30840206fad3b83740: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-2/wal/wals/7d6ccff8b1d34758b1d462034acaade7
I20260811 08:15:13.250022 7130 ts_tablet_manager.cc:1939] T 7d6ccff8b1d34758b1d462034acaade7 P 1029c438accf4e30840206fad3b83740: Deleting consensus metadata
I20260811 08:15:13.250556 6261 catalog_manager.cc:4841] TS 1029c438accf4e30840206fad3b83740 (127.20.158.131:44751): tablet 7d6ccff8b1d34758b1d462034acaade7 (table test-table [id=b223691cf49b4633b00664a11eed7f55]) successfully deleted
I20260811 08:15:13.253657 7131 tablet_replica.cc:330] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d: stopping tablet replica
I20260811 08:15:13.253824 7131 raft_consensus.cc:2229] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:15:13.254009 7131 raft_consensus.cc:2258] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:15:13.254519 7131 ts_tablet_manager.cc:1905] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:15:13.256090 7131 ts_tablet_manager.cc:1918] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
W20260811 08:15:13.257427 6263 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.158.129:42833 (error 108)
I20260811 08:15:13.258308 7131 log.cc:1196] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786436003833085-21114-0/minicluster-data/ts-1/wal/wals/7d6ccff8b1d34758b1d462034acaade7
I20260811 08:15:13.258688 7131 ts_tablet_manager.cc:1939] T 7d6ccff8b1d34758b1d462034acaade7 P e01b2acf67f5486ab178001b1dd7af9d: Deleting consensus metadata
I20260811 08:15:13.258862 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 6644
I20260811 08:15:13.266250 7073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:15:13.266075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:42833 (local address 127.0.0.1:58292)
0811 08:15:13.266142 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 08:15:13.266190 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.129:42833: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260811 08:15:13.266485 6263 catalog_manager.cc:4584] TS cdf4dceffb564b78ad2d6a99a44a40b4 (127.20.158.129:42833): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7d6ccff8b1d34758b1d462034acaade7: Network error: Client connection negotiation failed: client connection to 127.20.158.129:42833: connect: Connection refused (error 111)
W20260811 08:15:13.276396 7073 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:15:13.276120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:39961 (local address 127.0.0.1:53052)
0811 08:15:13.276169 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 08:15:13.276180 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:15:13.276221 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:15:13.276338 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.130:39961: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 08:15:13.277014 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 6865
I20260811 08:15:13.295905 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 6236
I20260811 08:15:13.310715 21114 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 08:15:13.655344 21114 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 08:15:13.655457 21114 mini_ranger.cc:66] Stopping Ranger...
I20260811 08:15:14.000970 21114 mini_ranger.cc:68] Stopped Ranger
2026-08-11 08:15:14.001 UTC [5591] LOG: received smart shutdown request
2026-08-11 08:15:14.005 UTC [5591] LOG: background worker "logical replication launcher" (PID 5604) exited with exit code 1
2026-08-11 08:15:14.005 UTC [5596] LOG: shutting down
2026-08-11 08:15:14.174 UTC [5591] LOG: database system is shut down
2026-08-11T08:15:14Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (48695 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:15:14 dist-test-slave-gkw7 krb5kdc[7142](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:15:14 dist-test-slave-gkw7 krb5kdc[7142](info): set up 2 sockets
Aug 11 08:15:14 dist-test-slave-gkw7 krb5kdc[7142](info): commencing operation
krb5kdc: starting...
W20260811 08:15:15.549594 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.236s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:15:15 dist-test-slave-gkw7 krb5kdc[7142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436115, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:15:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:15:15Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.20.158.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.20.158.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.20.158.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/rangeradmin_127.20.158.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.20.158.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/rangeradmin_127.20.158.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.20.158.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.20.158.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.20.158.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/rangerlookup_127.20.158.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.20.158.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/rangerlookup_127.20.158.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.158.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.20.158.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.158.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/HTTP_127.20.158.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.158.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/HTTP_127.20.158.148@KRBTEST.COM.keytab.
I20260811 08:15:15.727792 21114 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskgBR4MD/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/postgres -l logfile start
2026-08-11 08:15:18.352 UTC [7185] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-11 08:15:18.353 UTC [7185] LOG: listening on IPv4 address "127.20.158.148", port 58465
2026-08-11 08:15:18.356 UTC [7185] LOG: listening on Unix socket "/tmp/.s.PGSQL.58465"
2026-08-11 08:15:18.378 UTC [7193] LOG: database system was shut down at 2026-08-11 08:15:16 UTC
2026-08-11 08:15:18.381 UTC [7185] LOG: database system is ready to accept connections
I20260811 08:15:19.544003 21114 mini_postgres.cc:96] Postgres bound to 58465
2026-08-11 08:15:19.551 UTC [7203] FATAL: database "slave" does not exist
127.20.158.148:58465 - accepting connections
I20260811 08:15:19.552017 21114 mini_ranger.cc:161] Starting Ranger...
I20260811 08:15:19.568732 21114 mini_ranger.cc:84] Created miniranger Postgres user
I20260811 08:15:20.084563 21114 mini_ranger.cc:87] Created ranger Postgres database
I20260811 08:15:20.084679 21114 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ranger-admin
2026-08-11 08:15:20,369 [I] DB FLAVOR :POSTGRES
2026-08-11 08:15:20,369 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 08:15:20,370 [I] Checking connection..
2026-08-11 08:15:20,370 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:58465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-11 08:15:20,641 [I] Checking connection passed.
2026-08-11 08:15:20,641 [I] --------- Verifying version history table ---------
2026-08-11 08:15:20,642 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:58465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 08:15:20,924 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 08:15:20,925 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:58465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 08:15:21,192 [I] Table x_db_version_h does not exist in database ranger
2026-08-11 08:15:21,193 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-11 08:15:21,193 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:58465/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-11 08:15:21.443 UTC [7316] WARNING: there is no transaction in progress
2026-08-11 08:15:21,453 [I] create_dbversion_catalog.sql file imported successfully
2026-08-11 08:15:21,453 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:58465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-11 08:15:21,725 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-11 08:15:21,726 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 08:15:21,726 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:58465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-11 08:15:21,972 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:58465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-11 08:15:22,225 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:58465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-gkw7.c.gcp-upstream.internal','N') ;"
2026-08-11 08:15:22,473 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:58465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 08:15:22,714 [I] Table x_portal_user does not exist in database ranger
2026-08-11 08:15:22,714 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:58465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 08:15:22,985 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-11 08:15:22,985 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:58465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 08:15:23,225 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:58465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 08:15:23,481 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-11 08:15:23,482 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:58465/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-11 08:15:24.527 UTC [7476] WARNING: there is no transaction in progress
2026-08-11 08:15:24.545 UTC [7476] WARNING: there is no transaction in progress
2026-08-11 08:15:24.563 UTC [7476] WARNING: there is no transaction in progress
2026-08-11 08:15:24.579 UTC [7476] WARNING: there is no transaction in progress
2026-08-11 08:15:24.599 UTC [7476] WARNING: there is no transaction in progress
2026-08-11 08:15:24.619 UTC [7476] WARNING: there is no transaction in progress
2026-08-11 08:15:24.680 UTC [7476] WARNING: there is no transaction in progress
2026-08-11 08:15:24.688 UTC [7476] WARNING: there is no transaction in progress
2026-08-11 08:15:24.704 UTC [7476] WARNING: there is no transaction in progress
2026-08-11 08:15:24.715 UTC [7476] WARNING: there is no transaction in progress
2026-08-11 08:15:24.726 UTC [7476] WARNING: there is no transaction in progress
2026-08-11 08:15:24.742 UTC [7476] WARNING: there is no transaction in progress
2026-08-11 08:15:24.753 UTC [7476] WARNING: there is no transaction in progress
2026-08-11 08:15:24.760 UTC [7476] WARNING: there is no transaction in progress
2026-08-11 08:15:24.767 UTC [7476] WARNING: there is no transaction in progress
2026-08-11 08:15:24.774 UTC [7476] WARNING: there is no transaction in progress
2026-08-11 08:15:25,460 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-11 08:15:25,460 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:58465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-11 08:15:25,736 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-11 08:15:25,736 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:58465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-11 08:15:25,993 [I] Table x_portal_user already exists in database 'ranger'
2026-08-11 08:15:25,993 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:58465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-11 08:15:26,264 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-11 08:15:26,265 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:58465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-11 08:15:26,519 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:58465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-11 08:15:26,789 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:58465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-gkw7.c.gcp-upstream.internal';"
2026-08-11 08:15:27,043 [I] CORE_DB_SCHEMA import status has been updated
2026-08-11 08:15:27,044 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:58465/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-11 08:15:27,276 [I] DB_PATCHES have already been applied
I20260811 08:15:27.284128 21114 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ranger-admin:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskgBR4MD/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260811 08:15:27.284194 21114 mini_ranger.cc:193] Using host: 127.20.158.148
I20260811 08:15:27.288161 21114 mini_ranger.cc:227] Ranger admin URL: http://127.20.158.148:40379
Aug 11, 2026 8:15:27 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 8:15:27 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 8:15:27 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ranger-admin/ews/webapp
Aug 11, 2026 8:15:27 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 11, 2026 8:15:27 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 11, 2026 8:15:28 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ranger-admin/ews/webapp].
Aug 11, 2026 8:15:28 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260811 08:15:28.640365 21114 mini_ranger.cc:160] Time spent starting Ranger: real 9.088s user 0.003s sys 0.008s
Aug 11, 2026 8:15:48 AM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 11, 2026 8:15:48 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 11, 2026 8:15:48 AM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 11, 2026 8:15:48 AM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 11, 2026 8:15:48 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 11, 2026 8:15:48 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 11, 2026 8:15:48 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 11, 2026 8:15:48 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 11, 2026 8:15:48 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 11, 2026 8:15:48 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 11, 2026 8:15:48 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 11, 2026 8:15:48 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 11, 2026 8:15:48 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 11, 2026 8:15:48 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 11, 2026 8:15:48 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 11, 2026 8:15:48 AM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 11, 2026 8:15:48 AM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 11, 2026 8:15:49 AM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260811 08:15:50.032475 21114 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.20.158.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.20.158.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.20.158.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/rangerkms_127.20.158.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.20.158.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/rangerkms_127.20.158.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.20.158.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.20.158.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.20.158.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/HTTP_127.20.158.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.20.158.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/HTTP_127.20.158.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 11 08:15:50 dist-test-slave-gkw7 krb5kdc[7142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436150, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260811 08:15:50.118249 21114 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260811 08:15:50.128147 21114 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260811 08:15:51.011194 21114 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260811 08:15:51.011291 21114 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ranger-kms
I20260811 08:15:51.011314 21114 mini_ranger_kms.cc:227] Using postgres at 127.20.158.148:58465
2026-08-11 08:15:51,184 [I] DB FLAVOR :POSTGRES
2026-08-11 08:15:51,184 [I] --------- Verifying Ranger DB connection ---------
2026-08-11 08:15:51,184 [I] Checking connection
2026-08-11 08:15:51,184 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:58465/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-11 08:15:51,459 [I] connection success
2026-08-11 08:15:51,459 [I] --------- Verifying Ranger DB tables ---------
2026-08-11 08:15:51,460 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-11 08:15:51,460 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:58465/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-11 08:15:51,706 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-11 08:15:51,707 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-11 08:15:51,707 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-11 08:15:51,707 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.20.158.148:58465/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-11 08:15:52,008 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260811 08:15:52.469744 21114 mini_ranger_kms.cc:310] Created kms service
I20260811 08:15:52.666162 21114 mini_ranger_kms.cc:326] Created kudu user
I20260811 08:15:52.709426 21114 mini_ranger_kms.cc:343] Created rangerkms user
Aug 11 08:15:52 dist-test-slave-gkw7 krb5kdc[7142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436150, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.20.158.148@KRBTEST.COM
I20260811 08:15:53.111999 21114 mini_ranger_kms.cc:384] Added ranger policy
I20260811 08:15:53.112277 21114 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ranger-kms:/tmp/dist-test-taskgBR4MD/build/release/bin/postgresql.jar:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskgBR4MD/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260811 08:15:53.112313 21114 mini_ranger_kms.cc:240] Using host: 127.20.158.148
I20260811 08:15:53.117764 21114 mini_ranger_kms.cc:276] Ranger KMS PID: 7750
I20260811 08:15:53.117858 21114 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.20.158.148:46203
Aug 11, 2026 8:15:54 AM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 11, 2026 8:15:54 AM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 11, 2026 8:15:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 11, 2026 8:15:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 11, 2026 8:15:54 AM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ranger-kms/ews/webapp].
Aug 11, 2026 8:15:54 AM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 11 08:15:55 dist-test-slave-gkw7 krb5kdc[7142](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786436155, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.158.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:15:55.973877 21114 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.856s user 0.005s sys 0.151s
I20260811 08:15:55.973994 21114 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260811 08:15:55.974053 21114 mini_ranger_kms.cc:401] 127.20.158.148:46203/kms/v1/keys
Aug 11 08:15:56 dist-test-slave-gkw7 krb5kdc[7142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436155, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.158.148@KRBTEST.COM for HTTP/127.20.158.148@KRBTEST.COM
Aug 11 08:15:56 dist-test-slave-gkw7 krb5kdc[7142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436155, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.20.158.148@KRBTEST.COM for HTTP/127.20.158.148@KRBTEST.COM
Aug 11 08:15:58 dist-test-slave-gkw7 krb5kdc[7142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436158, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:15:58.980662 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:44975
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:43427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:44975
--ranger_config_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.158.148:46203/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:15:59.065845 7831 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:15:59.066052 7831 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:15:59.066074 7831 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:15:59.067257 7831 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:15:59.067303 7831 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:15:59.067318 7831 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:15:59.067330 7831 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:15:59.067343 7831 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:15:59.068909 7831 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:43427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/wal
--ranger_kms_url=127.20.158.148:46203/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:44975
--ranger_config_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:44975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7831
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:15:59.069157 7831 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:15:59.069414 7831 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:15:59.074832 7831 server_base.cc:1034] running on GCE node
W20260811 08:15:59.074797 7838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:15:59.074788 7839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:15:59.074816 7846 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:15:59.075439 7831 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:15:59.075791 7831 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:15:59.076951 7831 hybrid_clock.cc:648] HybridClock initialized: now 1786436159076927 us; error 37 us; skew 500 ppm
Aug 11 08:15:59 dist-test-slave-gkw7 krb5kdc[7142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436159, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:15:59.084033 7831 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:15:59.084574 7831 webserver.cc:460] Webserver started at http://127.20.158.190:42695/ using document root <none> and password file <none>
I20260811 08:15:59.084856 7831 fs_manager.cc:359] Metadata directory not provided
I20260811 08:15:59.084923 7831 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:15:59.085091 7831 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 08:15:59 dist-test-slave-gkw7 krb5kdc[7142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436159, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for HTTP/127.20.158.148@KRBTEST.COM
I20260811 08:15:59.148751 7831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "6cc8533c340f4003b309b7276cd76d57"
format_stamp: "Formatted at 2026-08-11 08:15:59 on dist-test-slave-gkw7"
server_key: "c2bdec842316d0dca1db5a2581475e5a"
server_key_iv: "a522339d39a62595dcf5495ee817a9c6"
server_key_version: "kuduclusterkey@0"
I20260811 08:15:59.149189 7831 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "6cc8533c340f4003b309b7276cd76d57"
format_stamp: "Formatted at 2026-08-11 08:15:59 on dist-test-slave-gkw7"
server_key: "c2bdec842316d0dca1db5a2581475e5a"
server_key_iv: "a522339d39a62595dcf5495ee817a9c6"
server_key_version: "kuduclusterkey@0"
I20260811 08:15:59.150770 7831 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260811 08:15:59.165033 7859 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:15:59.165232 7831 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:15:59.165341 7831 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "6cc8533c340f4003b309b7276cd76d57"
format_stamp: "Formatted at 2026-08-11 08:15:59 on dist-test-slave-gkw7"
server_key: "c2bdec842316d0dca1db5a2581475e5a"
server_key_iv: "a522339d39a62595dcf5495ee817a9c6"
server_key_version: "kuduclusterkey@0"
I20260811 08:15:59.165465 7831 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:15:59.179354 7831 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:15:59.181607 7831 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:15:59.181810 7831 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:15:59.186793 7831 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:44975
I20260811 08:15:59.186821 7937 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:44975 every 8 connection(s)
I20260811 08:15:59.187227 7831 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:15:59.187784 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 7831
I20260811 08:15:59.187916 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:15:59.188108 21114 external_mini_cluster.cc:1428] Setting key e897c6ae093cfaf68bf1700fab6d7470
I20260811 08:15:59.188100 7938 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:15:59.191728 7938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57: Bootstrap starting.
I20260811 08:15:59.192485 7938 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57: Neither blocks nor log segments found. Creating new log.
I20260811 08:15:59.192828 7938 log.cc:824] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57: Log is configured to *not* fsync() on all Append() calls
I20260811 08:15:59.193693 7938 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57: No bootstrap required, opened a new log
Aug 11 08:15:59 dist-test-slave-gkw7 krb5kdc[7142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436158, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:15:59.196060 7938 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc8533c340f4003b309b7276cd76d57" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 44975 } }
I20260811 08:15:59.196260 7938 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:15:59.196305 7938 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc8533c340f4003b309b7276cd76d57, State: Initialized, Role: FOLLOWER
I20260811 08:15:59.196492 7938 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc8533c340f4003b309b7276cd76d57" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 44975 } }
I20260811 08:15:59.196637 7938 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:15:59.196707 7938 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:15:59.196762 7938 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:15:59.197592 7938 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc8533c340f4003b309b7276cd76d57" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 44975 } }
I20260811 08:15:59.197726 7938 leader_election.cc:302] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6cc8533c340f4003b309b7276cd76d57; no voters:
I20260811 08:15:59.197926 7938 leader_election.cc:288] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:15:59.197993 7945 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:15:59.198230 7945 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [term 1 LEADER]: Becoming Leader. State: Replica: 6cc8533c340f4003b309b7276cd76d57, State: Running, Role: LEADER
I20260811 08:15:59.198284 7938 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:15:59.198376 7945 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc8533c340f4003b309b7276cd76d57" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 44975 } }
I20260811 08:15:59.199249 7947 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6cc8533c340f4003b309b7276cd76d57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc8533c340f4003b309b7276cd76d57" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 44975 } } }
I20260811 08:15:59.199359 7947 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [sys.catalog]: This master's current role is: LEADER
I20260811 08:15:59.199958 7938 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 08:15:59.200199 7941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:15:59.188690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41250 (local address 127.20.158.190:44975)
0811 08:15:59.188894 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 08:15:59.188905 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:15:59.188939 (+ 34us) server_negotiation.cc:407] Connection header received
0811 08:15:59.189712 (+ 773us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:15:59.189720 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:15:59.189772 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:15:59.189929 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:15:59.190577 (+ 648us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:15:59.191488 (+ 911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:15:59.192368 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:15:59.192857 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:15:59.192986 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:15:59.196072 (+ 3086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:15:59.196077 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:15:59.196077 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:15:59.196093 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:15:59.198377 (+ 2284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:15:59.198809 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:15:59.198813 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:15:59.198813 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:15:59.198932 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:15:59.199202 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:15:59.199203 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:15:59.199203 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:15:59.199553 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:15:59.199740 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0811 08:15:59.199847 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 08:15:59.199980 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":84,"threads_started":1}
I20260811 08:15:59.203045 7961 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:15:59.204277 7961 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:15:59.199200 7945 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cc8533c340f4003b309b7276cd76d57. Latest consensus state: current_term: 1 leader_uuid: "6cc8533c340f4003b309b7276cd76d57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc8533c340f4003b309b7276cd76d57" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 44975 } } }
I20260811 08:15:59.204550 7945 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [sys.catalog]: This master's current role is: LEADER
I20260811 08:15:59.209618 7969 mvcc.cc:205] Tried to move back new op lower bound from 7317242508109115392 to 7317242508078788608. Current Snapshot: MvccSnapshot[applied={T|T < 7317242508109115392}]
I20260811 08:15:59.210336 7961 catalog_manager.cc:1347] Generated new cluster ID: b573c3e6030d4b358630bc128e5c9d9b
I20260811 08:15:59.210448 7961 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:15:59.232365 7961 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:15:59.233927 7961 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:15:59.238125 7961 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57: Generated new TSK 0
I20260811 08:15:59.238446 7961 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.158.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
I20260811 08:16:00.006747 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.158.148:46203/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:0
--local_ip_for_outbound_sockets=127.20.158.129
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:44975
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:43427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:16:00.141431 8009 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:00.141739 8009 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:00.141776 8009 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:00.142920 8009 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:00.142961 8009 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:00.142985 8009 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:16:00.144582 8009 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:43427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.20.158.148:46203/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:44975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8009
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:00.144861 8009 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:00.145113 8009 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:00.151932 8016 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:00.152108 8014 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:00.152395 8018 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:00.152721 8009 server_base.cc:1034] running on GCE node
I20260811 08:16:00.152930 8009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:00.153203 8009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:00.154409 8009 hybrid_clock.cc:648] HybridClock initialized: now 1786436160154378 us; error 49 us; skew 500 ppm
Aug 11 08:16:00 dist-test-slave-gkw7 krb5kdc[7142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436160, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:00.157301 8009 init.cc:377] Logged in from keytab as kudu/127.20.158.129@KRBTEST.COM (short username kudu)
I20260811 08:16:00.157887 8009 webserver.cc:460] Webserver started at http://127.20.158.129:43255/ using document root <none> and password file <none>
I20260811 08:16:00.158195 8009 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:00.158268 8009 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:16:00.158425 8009 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 08:16:00 dist-test-slave-gkw7 krb5kdc[7142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436160, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for HTTP/127.20.158.148@KRBTEST.COM
I20260811 08:16:00.171232 8009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/data/instance:
uuid: "5d9a14f01b054d28a49401228ad6a8cb"
format_stamp: "Formatted at 2026-08-11 08:16:00 on dist-test-slave-gkw7"
server_key: "73df7ebecd1a96544af8ffac1ecd3c2f"
server_key_iv: "9fba643a294fdb2c358e90702c1f942c"
server_key_version: "kuduclusterkey@0"
I20260811 08:16:00.171700 8009 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance:
uuid: "5d9a14f01b054d28a49401228ad6a8cb"
format_stamp: "Formatted at 2026-08-11 08:16:00 on dist-test-slave-gkw7"
server_key: "73df7ebecd1a96544af8ffac1ecd3c2f"
server_key_iv: "9fba643a294fdb2c358e90702c1f942c"
server_key_version: "kuduclusterkey@0"
I20260811 08:16:00.174467 8009 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 08:16:00.189745 8031 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:00.189931 8009 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260811 08:16:00.190042 8009 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "5d9a14f01b054d28a49401228ad6a8cb"
format_stamp: "Formatted at 2026-08-11 08:16:00 on dist-test-slave-gkw7"
server_key: "73df7ebecd1a96544af8ffac1ecd3c2f"
server_key_iv: "9fba643a294fdb2c358e90702c1f942c"
server_key_version: "kuduclusterkey@0"
I20260811 08:16:00.190151 8009 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:00.203106 8009 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:00.205766 8009 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:00.205956 8009 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:00.206197 8009 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:16:00.206576 8009 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:16:00.206616 8009 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:00.206647 8009 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:16:00.206666 8009 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:00.213752 8009 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:35195
I20260811 08:16:00.213873 8201 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:35195 every 8 connection(s)
I20260811 08:16:00.214219 8009 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:16:00.217525 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 8009
I20260811 08:16:00.217696 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance
I20260811 08:16:00.217905 21114 external_mini_cluster.cc:1428] Setting key 59f55494e730bc7e60d2d58634e71605
Aug 11 08:16:00 dist-test-slave-gkw7 krb5kdc[7142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436160, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:16:00.227912 8208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:00.215127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:51385 (local address 127.20.158.190:44975)
0811 08:16:00.217668 (+ 2541us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:00.217671 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:00.217683 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:16:00.217713 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:00.217714 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:00.217728 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:00.217814 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:00.218559 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:00.219290 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:00.220861 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:00.221059 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:00.221143 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:00.223952 (+ 2809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:00.223953 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:00.223953 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:00.223962 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:00.226061 (+ 2099us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:00.226625 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:00.226626 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:00.226627 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:00.226696 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:00.227069 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:00.227070 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:00.227071 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:00.227225 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:00.227271 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:00.227675 (+ 404us) server_negotiation.cc:299] Negotiation successful
0811 08:16:00.227790 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2506,"thread_start_us":83,"threads_started":1}
I20260811 08:16:00.228713 8205 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:00.215031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:44975 (local address 127.20.158.129:51385)
0811 08:16:00.215268 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:00.215321 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:00.216022 (+ 701us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:00.217927 (+ 1905us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:00.217932 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:00.218180 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:00.218460 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:00.218465 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:00.219408 (+ 943us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:00.219409 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:00.220752 (+ 1343us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:00.220755 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:00.221165 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:00.221166 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:00.221320 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:00.222010 (+ 690us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:00.222022 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:00.223836 (+ 1814us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:00.226172 (+ 2336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:00.226180 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:00.226182 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:00.226523 (+ 341us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:00.226805 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:00.226806 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:00.226807 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:00.226982 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:00.227324 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:00.227332 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:00.227511 (+ 179us) client_negotiation.cc:769] Sending connection context
0811 08:16:00.228276 (+ 765us) client_negotiation.cc:240] Negotiation successful
0811 08:16:00.228453 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":118,"threads_started":1}
I20260811 08:16:00.229668 8203 heartbeater.cc:347] Connected to a master server at 127.20.158.190:44975
I20260811 08:16:00.229763 8203 heartbeater.cc:464] Registering TS with master...
I20260811 08:16:00.229970 8203 heartbeater.cc:511] Master 127.20.158.190:44975 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.20.158.130@KRBTEST.COM; defaulting to no policy
I20260811 08:16:00.230640 7888 ts_manager.cc:194] Registered new tserver with Master: 5d9a14f01b054d28a49401228ad6a8cb (127.20.158.129:35195)
I20260811 08:16:00.231431 7888 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.129@KRBTEST.COM'} at 127.20.158.129:51385
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
I20260811 08:16:00.250778 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.158.148:46203/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:0
--local_ip_for_outbound_sockets=127.20.158.130
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:44975
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:43427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:16:00.359089 8214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:00.359350 8214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:00.359395 8214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:00.360574 8214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:00.360644 8214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:00.360690 8214 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:16:00.362291 8214 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:43427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.20.158.148:46203/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:44975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:00.362562 8214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:00.362843 8214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:00.368096 8229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:00.368322 8224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:00.368656 8225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:00.368906 8214 server_base.cc:1034] running on GCE node
I20260811 08:16:00.369156 8214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:00.369351 8214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:00.370500 8214 hybrid_clock.cc:648] HybridClock initialized: now 1786436160370478 us; error 42 us; skew 500 ppm
Aug 11 08:16:00 dist-test-slave-gkw7 krb5kdc[7142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436160, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:00.373169 8214 init.cc:377] Logged in from keytab as kudu/127.20.158.130@KRBTEST.COM (short username kudu)
I20260811 08:16:00.373764 8214 webserver.cc:460] Webserver started at http://127.20.158.130:42639/ using document root <none> and password file <none>
I20260811 08:16:00.373999 8214 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:00.374068 8214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:16:00.374213 8214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 08:16:00 dist-test-slave-gkw7 krb5kdc[7142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436160, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for HTTP/127.20.158.148@KRBTEST.COM
I20260811 08:16:00.386489 8214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/data/instance:
uuid: "90463fafd4554dda86919806cf51e6a4"
format_stamp: "Formatted at 2026-08-11 08:16:00 on dist-test-slave-gkw7"
server_key: "94aee1d03d62f60dfa283ec69214a112"
server_key_iv: "59e1aa48cde4a1c78b00e415c9f949e5"
server_key_version: "kuduclusterkey@0"
I20260811 08:16:00.386914 8214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance:
uuid: "90463fafd4554dda86919806cf51e6a4"
format_stamp: "Formatted at 2026-08-11 08:16:00 on dist-test-slave-gkw7"
server_key: "94aee1d03d62f60dfa283ec69214a112"
server_key_iv: "59e1aa48cde4a1c78b00e415c9f949e5"
server_key_version: "kuduclusterkey@0"
I20260811 08:16:00.388383 8214 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:16:00.409557 8239 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:00.410452 8214 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260811 08:16:00.410590 8214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "90463fafd4554dda86919806cf51e6a4"
format_stamp: "Formatted at 2026-08-11 08:16:00 on dist-test-slave-gkw7"
server_key: "94aee1d03d62f60dfa283ec69214a112"
server_key_iv: "59e1aa48cde4a1c78b00e415c9f949e5"
server_key_version: "kuduclusterkey@0"
I20260811 08:16:00.410701 8214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 11 08:16:00 dist-test-slave-gkw7 krb5kdc[7142](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786436160, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:00.436822 8214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:00.439553 8214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:00.439805 8214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:00.440147 8214 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:16:00.440630 8214 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:16:00.440743 8214 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:00.440831 8214 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:16:00.440898 8214 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:00.448793 8214 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:38111
I20260811 08:16:00.449321 8214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
I20260811 08:16:00.451071 8411 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:38111 every 8 connection(s)
I20260811 08:16:00.455217 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 8214
I20260811 08:16:00.455330 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance
I20260811 08:16:00.455524 21114 external_mini_cluster.cc:1428] Setting key be84cbfa1748dc27d00214ecb83e8b38
Aug 11 08:16:00 dist-test-slave-gkw7 krb5kdc[7142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436160, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:16:00.461896 8208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:00.450871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:36945 (local address 127.20.158.190:44975)
0811 08:16:00.450919 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:00.450921 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:00.451128 (+ 207us) server_negotiation.cc:407] Connection header received
0811 08:16:00.451839 (+ 711us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:00.451841 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:00.451860 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:00.451951 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:00.452708 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:00.453568 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:00.455184 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:00.455492 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:00.455544 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:00.458363 (+ 2819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:00.458365 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:00.458365 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:00.458373 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:00.460150 (+ 1777us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:00.460685 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:00.460687 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:00.460687 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:00.460754 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:00.461084 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:00.461085 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:00.461086 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:00.461221 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:00.461316 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:00.461679 (+ 363us) server_negotiation.cc:299] Negotiation successful
0811 08:16:00.461779 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:16:00.462100 8414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:00.450593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:44975 (local address 127.20.158.130:36945)
0811 08:16:00.451003 (+ 410us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:00.451048 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:00.451699 (+ 651us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:00.452053 (+ 354us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:00.452058 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:00.452304 (+ 246us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:00.452583 (+ 279us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:00.452588 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:00.453703 (+ 1115us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:00.453704 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:00.455061 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:00.455065 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:00.455675 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:00.455676 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:00.455821 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:00.456442 (+ 621us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:00.456453 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:00.458232 (+ 1779us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:00.460258 (+ 2026us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:00.460265 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:00.460268 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:00.460581 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:00.460843 (+ 262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:00.460844 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:00.460844 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:00.460995 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:00.461305 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:00.461313 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:00.461465 (+ 152us) client_negotiation.cc:769] Sending connection context
0811 08:16:00.461653 (+ 188us) client_negotiation.cc:240] Negotiation successful
0811 08:16:00.461830 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":79,"threads_started":1}
I20260811 08:16:00.462651 8412 heartbeater.cc:347] Connected to a master server at 127.20.158.190:44975
I20260811 08:16:00.462785 8412 heartbeater.cc:464] Registering TS with master...
I20260811 08:16:00.463025 8412 heartbeater.cc:511] Master 127.20.158.190:44975 requested a full tablet report, sending...
I20260811 08:16:00.463425 7888 ts_manager.cc:194] Registered new tserver with Master: 90463fafd4554dda86919806cf51e6a4 (127.20.158.130:38111)
I20260811 08:16:00.463822 7888 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.130@KRBTEST.COM'} at 127.20.158.130:36945
WARNING: no policy specified for kudu/127.20.158.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
I20260811 08:16:00.496307 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.158.148:46203/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:0
--local_ip_for_outbound_sockets=127.20.158.131
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:44975
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:43427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:16:00.616263 8422 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:00.616539 8422 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:00.616575 8422 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:00.618214 8422 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:00.618289 8422 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:00.618330 8422 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:16:00.620456 8422 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:43427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.20.158.148:46203/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:44975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8422
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:00.620726 8422 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:00.621083 8422 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:00.627995 8432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:00.628283 8438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:00.629057 8422 server_base.cc:1034] running on GCE node
W20260811 08:16:00.629724 8430 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:00.630013 8422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:00.630416 8422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:00.631611 8422 hybrid_clock.cc:648] HybridClock initialized: now 1786436160631574 us; error 51 us; skew 500 ppm
Aug 11 08:16:00 dist-test-slave-gkw7 krb5kdc[7142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436160, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:00.635152 8422 init.cc:377] Logged in from keytab as kudu/127.20.158.131@KRBTEST.COM (short username kudu)
I20260811 08:16:00.635782 8422 webserver.cc:460] Webserver started at http://127.20.158.131:39217/ using document root <none> and password file <none>
I20260811 08:16:00.636147 8422 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:00.636255 8422 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:16:00.636449 8422 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 11 08:16:00 dist-test-slave-gkw7 krb5kdc[7142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436160, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for HTTP/127.20.158.148@KRBTEST.COM
I20260811 08:16:00.651748 8422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/data/instance:
uuid: "b374d1783a084b80ad772173c99bc6c2"
format_stamp: "Formatted at 2026-08-11 08:16:00 on dist-test-slave-gkw7"
server_key: "731d0e4ea3891524861f64c5060396fa"
server_key_iv: "5527913658c9b0938e41b4ff0349967e"
server_key_version: "kuduclusterkey@0"
I20260811 08:16:00.652469 8422 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance:
uuid: "b374d1783a084b80ad772173c99bc6c2"
format_stamp: "Formatted at 2026-08-11 08:16:00 on dist-test-slave-gkw7"
server_key: "731d0e4ea3891524861f64c5060396fa"
server_key_iv: "5527913658c9b0938e41b4ff0349967e"
server_key_version: "kuduclusterkey@0"
I20260811 08:16:00.654631 8422 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260811 08:16:00.669070 8447 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:00.669288 8422 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:00.669376 8422 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "b374d1783a084b80ad772173c99bc6c2"
format_stamp: "Formatted at 2026-08-11 08:16:00 on dist-test-slave-gkw7"
server_key: "731d0e4ea3891524861f64c5060396fa"
server_key_iv: "5527913658c9b0938e41b4ff0349967e"
server_key_version: "kuduclusterkey@0"
I20260811 08:16:00.669456 8422 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:00.681403 8422 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:00.683902 8422 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:00.684056 8422 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:00.684337 8422 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:16:00.684772 8422 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:16:00.684852 8422 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:00.684913 8422 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:16:00.684958 8422 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:00.693317 8422 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:35461
I20260811 08:16:00.693360 8625 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:35461 every 8 connection(s)
I20260811 08:16:00.693941 8422 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
I20260811 08:16:00.694156 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 8422
I20260811 08:16:00.694293 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance
I20260811 08:16:00.694515 21114 external_mini_cluster.cc:1428] Setting key 5937246489a33f0eac354eef2c29bcd0
Aug 11 08:16:00 dist-test-slave-gkw7 krb5kdc[7142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436160, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:16:00.706909 8208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:00.695342 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:57289 (local address 127.20.158.190:44975)
0811 08:16:00.695394 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:00.695396 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:00.695837 (+ 441us) server_negotiation.cc:407] Connection header received
0811 08:16:00.696655 (+ 818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:00.696656 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:00.696667 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:00.696708 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:00.697636 (+ 928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:00.698258 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:00.699758 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:00.700060 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:00.700105 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:00.702949 (+ 2844us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:00.702950 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:00.702951 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:00.702959 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:00.704716 (+ 1757us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:00.705218 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:00.705220 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:00.705220 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:00.705300 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:00.705642 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:00.705643 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:00.705643 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:00.705786 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:00.705833 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:00.706730 (+ 897us) server_negotiation.cc:299] Negotiation successful
0811 08:16:00.706816 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:16:00.707705 8631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:00.695322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:44975 (local address 127.20.158.131:57289)
0811 08:16:00.695686 (+ 364us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:00.695745 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:00.696524 (+ 779us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:00.696810 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:00.696816 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:00.697111 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:00.697471 (+ 360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:00.697479 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:00.698353 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:00.698354 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:00.699649 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:00.699652 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:00.700225 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:00.700226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:00.700383 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:00.701042 (+ 659us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:00.701052 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:00.702825 (+ 1773us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:00.704818 (+ 1993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:00.704825 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:00.704830 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:00.705122 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:00.705378 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:00.705378 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:00.705379 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:00.705519 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:00.705884 (+ 365us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:00.705891 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:00.706069 (+ 178us) client_negotiation.cc:769] Sending connection context
0811 08:16:00.707294 (+ 1225us) client_negotiation.cc:240] Negotiation successful
0811 08:16:00.707467 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":309,"thread_start_us":92,"threads_started":1}
I20260811 08:16:00.708379 8626 heartbeater.cc:347] Connected to a master server at 127.20.158.190:44975
I20260811 08:16:00.708525 8626 heartbeater.cc:464] Registering TS with master...
I20260811 08:16:00.708767 8626 heartbeater.cc:511] Master 127.20.158.190:44975 requested a full tablet report, sending...
I20260811 08:16:00.709162 7888 ts_manager.cc:194] Registered new tserver with Master: b374d1783a084b80ad772173c99bc6c2 (127.20.158.131:35461)
I20260811 08:16:00.709698 7888 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.131@KRBTEST.COM'} at 127.20.158.131:57289
I20260811 08:16:00.717464 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:16:00.718492 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 8009
I20260811 08:16:00.746824 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 8214
I20260811 08:16:00.769423 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 8422
I20260811 08:16:00.782429 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 7831
I20260811 08:16:00.804777 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:44975
--webserver_interface=127.20.158.190
--webserver_port=42695
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:43427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:44975
--ranger_config_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.158.148:46203/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.158.148:46203/kms with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:16:00.887583 8633 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:00.887873 8633 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:00.887912 8633 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:00.889094 8633 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:16:00.889199 8633 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:00.889225 8633 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:00.889245 8633 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:16:00.889302 8633 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:16:00.890959 8633 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:43427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.158.148:46203/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:44975
--ranger_config_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:44975
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=42695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8633
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:00.891260 8633 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:00.891501 8633 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:00.896747 8640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:00.896777 8641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:00.896747 8643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:00.897069 8633 server_base.cc:1034] running on GCE node
I20260811 08:16:00.897326 8633 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:00.897672 8633 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:00.898839 8633 hybrid_clock.cc:648] HybridClock initialized: now 1786436160898829 us; error 27 us; skew 500 ppm
Aug 11 08:16:00 dist-test-slave-gkw7 krb5kdc[7142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436160, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:00.901435 8633 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:16:00.901907 8633 webserver.cc:460] Webserver started at http://127.20.158.190:42695/ using document root <none> and password file <none>
I20260811 08:16:00.902093 8633 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:00.902156 8633 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 08:16:00 dist-test-slave-gkw7 krb5kdc[7142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436160, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for HTTP/127.20.158.148@KRBTEST.COM
I20260811 08:16:00.982021 8633 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:00.982808 8654 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:00.983014 8633 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:00.983134 8633 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "6cc8533c340f4003b309b7276cd76d57"
format_stamp: "Formatted at 2026-08-11 08:15:59 on dist-test-slave-gkw7"
server_key: "c2bdec842316d0dca1db5a2581475e5a"
server_key_iv: "a522339d39a62595dcf5495ee817a9c6"
server_key_version: "kuduclusterkey@0"
I20260811 08:16:00.983539 8633 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:01.025168 8633 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:01.027091 8633 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:01.027276 8633 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:01.031678 8633 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:44975
I20260811 08:16:01.031718 8736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:44975 every 8 connection(s)
I20260811 08:16:01.032099 8633 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:16:01.033329 8737 sys_catalog.cc:263] Verifying existing consensus state
I20260811 08:16:01.034112 8737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57: Bootstrap starting.
I20260811 08:16:01.042338 8737 log.cc:824] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57: Log is configured to *not* fsync() on all Append() calls
I20260811 08:16:01.042362 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 8633
I20260811 08:16:01.042701 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.158.148:46203/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:35195
--local_ip_for_outbound_sockets=127.20.158.129
--tserver_master_addrs=127.20.158.190:44975
--webserver_port=43255
--webserver_interface=127.20.158.129
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:43427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.158.148:46203/kms with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:16:01.044188 8737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:16:01.044497 8737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57: Bootstrap complete.
I20260811 08:16:01.047387 8737 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc8533c340f4003b309b7276cd76d57" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 44975 } }
I20260811 08:16:01.047731 8737 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6cc8533c340f4003b309b7276cd76d57, State: Initialized, Role: FOLLOWER
I20260811 08:16:01.047926 8737 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc8533c340f4003b309b7276cd76d57" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 44975 } }
I20260811 08:16:01.048007 8737 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:16:01.048060 8737 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:16:01.048108 8737 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [term 1 FOLLOWER]: Advancing to term 2
I20260811 08:16:01.049103 8737 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc8533c340f4003b309b7276cd76d57" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 44975 } }
I20260811 08:16:01.049227 8737 leader_election.cc:302] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6cc8533c340f4003b309b7276cd76d57; no voters:
I20260811 08:16:01.049435 8737 leader_election.cc:288] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 08:16:01.049472 8741 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 08:16:01.049602 8741 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [term 2 LEADER]: Becoming Leader. State: Replica: 6cc8533c340f4003b309b7276cd76d57, State: Running, Role: LEADER
I20260811 08:16:01.049757 8737 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:16:01.049769 8741 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc8533c340f4003b309b7276cd76d57" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 44975 } }
I20260811 08:16:01.050194 8743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6cc8533c340f4003b309b7276cd76d57. Latest consensus state: current_term: 2 leader_uuid: "6cc8533c340f4003b309b7276cd76d57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc8533c340f4003b309b7276cd76d57" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 44975 } } }
I20260811 08:16:01.050283 8743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [sys.catalog]: This master's current role is: LEADER
I20260811 08:16:01.050436 8742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6cc8533c340f4003b309b7276cd76d57" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6cc8533c340f4003b309b7276cd76d57" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 44975 } } }
I20260811 08:16:01.050655 8742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57 [sys.catalog]: This master's current role is: LEADER
I20260811 08:16:01.051539 8737 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260811 08:16:01.054112 8749 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:16:01.055372 8749 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:16:01.055672 8749 catalog_manager.cc:1259] Loaded cluster ID: b573c3e6030d4b358630bc128e5c9d9b
I20260811 08:16:01.055724 8749 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:16:01.057297 8749 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:16:01.057605 8749 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57: Loaded TSK: 0
I20260811 08:16:01.057941 8749 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 08:16:01.163578 8740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:01.163995 8740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:01.164100 8740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:01.165904 8740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:01.166025 8740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:01.166123 8740 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:16:01.168404 8740 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:43427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.158.148:46203/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:35195
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=43255
--tserver_master_addrs=127.20.158.190:44975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8740
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:01.168912 8740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:01.169287 8740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:01.176010 8786 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:01.176213 8788 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:01.176046 8792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:01.176777 8740 server_base.cc:1034] running on GCE node
I20260811 08:16:01.176985 8740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:01.177263 8740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:01.178453 8740 hybrid_clock.cc:648] HybridClock initialized: now 1786436161178432 us; error 35 us; skew 500 ppm
Aug 11 08:16:01 dist-test-slave-gkw7 krb5kdc[7142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436161, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:01.184938 8740 init.cc:377] Logged in from keytab as kudu/127.20.158.129@KRBTEST.COM (short username kudu)
I20260811 08:16:01.185650 8740 webserver.cc:460] Webserver started at http://127.20.158.129:43255/ using document root <none> and password file <none>
I20260811 08:16:01.186022 8740 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:01.186177 8740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 08:16:01 dist-test-slave-gkw7 krb5kdc[7142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436161, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for HTTP/127.20.158.148@KRBTEST.COM
I20260811 08:16:01.205086 8740 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:01.206144 8806 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:01.206342 8740 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:01.206447 8740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "5d9a14f01b054d28a49401228ad6a8cb"
format_stamp: "Formatted at 2026-08-11 08:16:00 on dist-test-slave-gkw7"
server_key: "73df7ebecd1a96544af8ffac1ecd3c2f"
server_key_iv: "9fba643a294fdb2c358e90702c1f942c"
server_key_version: "kuduclusterkey@0"
I20260811 08:16:01.206854 8740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:01.220222 8740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:01.222848 8740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:01.223080 8740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:01.223404 8740 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:16:01.223832 8740 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:16:01.223927 8740 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:01.224027 8740 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:16:01.224105 8740 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:01.232239 8740 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:35195
I20260811 08:16:01.232825 8740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:16:01.234396 8980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:35195 every 8 connection(s)
I20260811 08:16:01.239956 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 8740
I20260811 08:16:01.240302 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.158.148:46203/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:38111
--local_ip_for_outbound_sockets=127.20.158.130
--tserver_master_addrs=127.20.158.190:44975
--webserver_port=42639
--webserver_interface=127.20.158.130
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:43427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.158.148:46203/kms with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 08:16:01 dist-test-slave-gkw7 krb5kdc[7142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436161, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:16:01.254443 8984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:01.235360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:44975 (local address 127.20.158.129:35991)
0811 08:16:01.236237 (+ 877us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:01.236287 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:01.236962 (+ 675us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:01.237512 (+ 550us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:01.237516 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:01.237788 (+ 272us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:01.237997 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:01.238002 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:01.239253 (+ 1251us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:01.239254 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:01.243501 (+ 4247us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:01.243505 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:01.244623 (+ 1118us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:01.244625 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:01.244764 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:01.245583 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:01.245593 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:01.249835 (+ 4242us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:01.252342 (+ 2507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:01.252352 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:01.252354 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:01.252685 (+ 331us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:01.252974 (+ 289us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:01.252975 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:01.252975 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:01.253111 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:01.253706 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:01.253713 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:01.253883 (+ 170us) client_negotiation.cc:769] Sending connection context
0811 08:16:01.253990 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 08:16:01.254183 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":829,"thread_start_us":103,"threads_started":1}
I20260811 08:16:01.255396 8985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:01.235811 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:35991 (local address 127.20.158.190:44975)
0811 08:16:01.236843 (+ 1032us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:01.236853 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:01.236901 (+ 48us) server_negotiation.cc:407] Connection header received
0811 08:16:01.237267 (+ 366us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:01.237272 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:01.237319 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:01.237471 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:01.238125 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:01.239059 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:01.243623 (+ 4564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:01.244370 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:01.244501 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:01.250000 (+ 5499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:01.250007 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:01.250007 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:01.250022 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:01.252213 (+ 2191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:01.252786 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:01.252790 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:01.252790 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:01.252903 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:01.253200 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:01.253201 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:01.253201 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:01.253584 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:01.253675 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:01.255016 (+ 1341us) server_negotiation.cc:299] Negotiation successful
0811 08:16:01.255170 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":967,"thread_start_us":111,"threads_started":1}
I20260811 08:16:01.256664 8982 heartbeater.cc:347] Connected to a master server at 127.20.158.190:44975
I20260811 08:16:01.256771 8982 heartbeater.cc:464] Registering TS with master...
I20260811 08:16:01.256975 8982 heartbeater.cc:511] Master 127.20.158.190:44975 requested a full tablet report, sending...
W20260811 08:16:01.261291 8982 heartbeater.cc:644] Failed to heartbeat to 127.20.158.190:44975 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 08:16:01.261384 8982 heartbeater.cc:464] Registering TS with master...
I20260811 08:16:01.261468 8982 heartbeater.cc:511] Master 127.20.158.190:44975 requested a full tablet report, sending...
I20260811 08:16:01.262090 8982 heartbeater.cc:464] Registering TS with master...
I20260811 08:16:01.262184 8982 heartbeater.cc:511] Master 127.20.158.190:44975 requested a full tablet report, sending...
W20260811 08:16:01.262585 8982 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 08:16:01.365639 8986 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:01.365869 8986 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:01.365911 8986 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:01.367093 8986 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:01.367163 8986 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:01.367208 8986 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:16:01.368764 8986 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:43427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.158.148:46203/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:38111
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=42639
--tserver_master_addrs=127.20.158.190:44975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8986
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:01.369031 8986 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:01.369325 8986 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:01.374861 8999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:01.374877 8996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:01.374852 8997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:01.375425 8986 server_base.cc:1034] running on GCE node
I20260811 08:16:01.375689 8986 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:01.375967 8986 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:01.379264 8986 hybrid_clock.cc:648] HybridClock initialized: now 1786436161379224 us; error 52 us; skew 500 ppm
Aug 11 08:16:01 dist-test-slave-gkw7 krb5kdc[7142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436161, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:01.382277 8986 init.cc:377] Logged in from keytab as kudu/127.20.158.130@KRBTEST.COM (short username kudu)
I20260811 08:16:01.382800 8986 webserver.cc:460] Webserver started at http://127.20.158.130:42639/ using document root <none> and password file <none>
I20260811 08:16:01.383091 8986 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:01.383193 8986 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 08:16:01 dist-test-slave-gkw7 krb5kdc[7142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436161, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for HTTP/127.20.158.148@KRBTEST.COM
I20260811 08:16:01.402215 8986 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.001s
I20260811 08:16:01.403458 9010 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:01.403625 8986 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:16:01.403703 8986 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "90463fafd4554dda86919806cf51e6a4"
format_stamp: "Formatted at 2026-08-11 08:16:00 on dist-test-slave-gkw7"
server_key: "94aee1d03d62f60dfa283ec69214a112"
server_key_iv: "59e1aa48cde4a1c78b00e415c9f949e5"
server_key_version: "kuduclusterkey@0"
I20260811 08:16:01.404174 8986 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:01.425990 8986 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:01.428591 8986 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:01.428802 8986 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:01.429095 8986 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:16:01.429518 8986 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:16:01.429607 8986 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:01.429667 8986 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:16:01.429700 8986 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:01.437433 8986 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:38111
I20260811 08:16:01.437954 8986 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
I20260811 08:16:01.438926 9182 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:38111 every 8 connection(s)
I20260811 08:16:01.443956 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 8986
I20260811 08:16:01.444332 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.20.158.148:46203/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:35461
--local_ip_for_outbound_sockets=127.20.158.131
--tserver_master_addrs=127.20.158.190:44975
--webserver_port=39217
--webserver_interface=127.20.158.131
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:43427
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.20.158.148:46203/kms with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 11 08:16:01 dist-test-slave-gkw7 krb5kdc[7142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436161, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:16:01.448453 8985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:01.438900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:45473 (local address 127.20.158.190:44975)
0811 08:16:01.438964 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:01.438966 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:01.439424 (+ 458us) server_negotiation.cc:407] Connection header received
0811 08:16:01.439963 (+ 539us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:01.439965 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:01.439982 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:01.440041 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:01.440621 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:01.441145 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:01.442304 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:01.442539 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:01.442632 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:01.444952 (+ 2320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:01.444954 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:01.444955 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:01.444964 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:01.446839 (+ 1875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:01.447374 (+ 535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:01.447376 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:01.447376 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:01.447442 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:01.447751 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:01.447753 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:01.447753 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:01.447885 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:01.447961 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:01.448262 (+ 301us) server_negotiation.cc:299] Negotiation successful
0811 08:16:01.448360 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 08:16:01.448907 9190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:01.438915 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:44975 (local address 127.20.158.130:45473)
0811 08:16:01.439292 (+ 377us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:01.439325 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:01.439850 (+ 525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:01.440115 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:01.440120 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:01.440322 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:01.440524 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:01.440528 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:01.441263 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:01.441264 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:01.442207 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:01.442210 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:01.442665 (+ 455us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:01.442667 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:01.442790 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:01.443426 (+ 636us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:01.443436 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:01.444847 (+ 1411us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:01.446958 (+ 2111us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:01.446965 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:01.446968 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:01.447279 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:01.447519 (+ 240us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:01.447520 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:01.447520 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:01.447664 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:01.447963 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:01.447971 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:01.448125 (+ 154us) client_negotiation.cc:769] Sending connection context
0811 08:16:01.448243 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 08:16:01.448402 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":340,"thread_start_us":79,"threads_started":1}
I20260811 08:16:01.449678 9187 heartbeater.cc:347] Connected to a master server at 127.20.158.190:44975
I20260811 08:16:01.449813 9187 heartbeater.cc:464] Registering TS with master...
I20260811 08:16:01.450073 9187 heartbeater.cc:511] Master 127.20.158.190:44975 requested a full tablet report, sending...
W20260811 08:16:01.450819 9187 heartbeater.cc:644] Failed to heartbeat to 127.20.158.190:44975 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 08:16:01.450933 9187 heartbeater.cc:464] Registering TS with master...
I20260811 08:16:01.451013 9187 heartbeater.cc:511] Master 127.20.158.190:44975 requested a full tablet report, sending...
I20260811 08:16:01.451310 9187 heartbeater.cc:464] Registering TS with master...
I20260811 08:16:01.451387 9187 heartbeater.cc:511] Master 127.20.158.190:44975 requested a full tablet report, sending...
W20260811 08:16:01.451658 9187 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 08:16:01.579767 9192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:01.580070 9192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:01.580112 9192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:01.581924 9192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:01.581991 9192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:01.582034 9192 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:16:01.584275 9192 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:43427
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.20.158.148:46203/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:35461
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=39217
--tserver_master_addrs=127.20.158.190:44975
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9192
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:01.584550 9192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:01.584863 9192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:01.590659 9201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:01.590687 9199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:01.590909 9198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:01.591253 9192 server_base.cc:1034] running on GCE node
I20260811 08:16:01.591465 9192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:01.591743 9192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:01.592924 9192 hybrid_clock.cc:648] HybridClock initialized: now 1786436161592895 us; error 43 us; skew 500 ppm
Aug 11 08:16:01 dist-test-slave-gkw7 krb5kdc[7142](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436161, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:01.596007 9192 init.cc:377] Logged in from keytab as kudu/127.20.158.131@KRBTEST.COM (short username kudu)
I20260811 08:16:01.596472 9192 webserver.cc:460] Webserver started at http://127.20.158.131:39217/ using document root <none> and password file <none>
I20260811 08:16:01.596730 9192 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:01.596833 9192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 11 08:16:01 dist-test-slave-gkw7 krb5kdc[7142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436161, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for HTTP/127.20.158.148@KRBTEST.COM
I20260811 08:16:01.622327 9192 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s
I20260811 08:16:01.623472 9213 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:01.623651 9192 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:16:01.623741 9192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "b374d1783a084b80ad772173c99bc6c2"
format_stamp: "Formatted at 2026-08-11 08:16:00 on dist-test-slave-gkw7"
server_key: "731d0e4ea3891524861f64c5060396fa"
server_key_iv: "5527913658c9b0938e41b4ff0349967e"
server_key_version: "kuduclusterkey@0"
I20260811 08:16:01.624193 9192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:01.636253 9192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:01.640332 9192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:01.640563 9192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:01.640873 9192 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:16:01.641315 9192 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:16:01.641404 9192 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:01.641481 9192 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:16:01.641567 9192 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:01.649320 9192 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:35461
I20260811 08:16:01.649418 9390 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:35461 every 8 connection(s)
I20260811 08:16:01.649863 9192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
Aug 11 08:16:01 dist-test-slave-gkw7 krb5kdc[7142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436161, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:16:01.657310 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 9192
I20260811 08:16:01.665627 9394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:01.651270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:44975 (local address 127.20.158.131:39751)
0811 08:16:01.651433 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:01.651476 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:01.652092 (+ 616us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:01.652369 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:01.652372 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:01.652553 (+ 181us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:01.652803 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:01.652810 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:01.653799 (+ 989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:01.653799 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:01.654711 (+ 912us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:01.654714 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:01.655146 (+ 432us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:01.655148 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:01.655267 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:01.655815 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:01.655824 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:01.657414 (+ 1590us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:01.663846 (+ 6432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:01.663854 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:01.663857 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:01.664150 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:01.664401 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:01.664402 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:01.664402 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:01.664545 (+ 143us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:01.664844 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:01.664850 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:01.665016 (+ 166us) client_negotiation.cc:769] Sending connection context
0811 08:16:01.665124 (+ 108us) client_negotiation.cc:240] Negotiation successful
0811 08:16:01.665316 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":92,"threads_started":1}
I20260811 08:16:01.666630 8985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:01.651256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:39751 (local address 127.20.158.190:44975)
0811 08:16:01.651355 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:01.651358 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:01.651577 (+ 219us) server_negotiation.cc:407] Connection header received
0811 08:16:01.652211 (+ 634us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:01.652214 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:01.652228 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:01.652286 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:01.652927 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:01.653700 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:01.654800 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:01.655016 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:01.655113 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:01.657557 (+ 2444us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:01.657558 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:01.657559 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:01.657568 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:01.663750 (+ 6182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:01.664258 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:01.664260 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:01.664260 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:01.664323 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:01.664620 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:01.664621 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:01.664622 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:01.664752 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:01.664816 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:01.666460 (+ 1644us) server_negotiation.cc:299] Negotiation successful
0811 08:16:01.666540 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260811 08:16:01.670589 9399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:01.658137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41258 (local address 127.20.158.190:44975)
0811 08:16:01.658246 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:01.658248 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:01.658402 (+ 154us) server_negotiation.cc:407] Connection header received
0811 08:16:01.658484 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:01.658485 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:01.658497 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:01.658563 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:01.659137 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:01.659761 (+ 624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:01.660522 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:01.660792 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:01.660867 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:01.663521 (+ 2654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:01.663522 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:01.663523 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:01.663530 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:01.668756 (+ 5226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:01.669613 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:01.669614 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:01.669614 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:01.669682 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:01.669908 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:01.669909 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:01.669910 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:01.670029 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:01.670180 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:01.670406 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 08:16:01.670488 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":57,"threads_started":1}
I20260811 08:16:01.670702 9391 heartbeater.cc:347] Connected to a master server at 127.20.158.190:44975
I20260811 08:16:01.670912 9391 heartbeater.cc:464] Registering TS with master...
I20260811 08:16:01.671209 9391 heartbeater.cc:511] Master 127.20.158.190:44975 requested a full tablet report, sending...
W20260811 08:16:01.671908 9391 heartbeater.cc:644] Failed to heartbeat to 127.20.158.190:44975 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260811 08:16:01.671996 9391 heartbeater.cc:464] Registering TS with master...
I20260811 08:16:01.672071 9391 heartbeater.cc:511] Master 127.20.158.190:44975 requested a full tablet report, sending...
I20260811 08:16:01.672408 9391 heartbeater.cc:464] Registering TS with master...
I20260811 08:16:01.672487 9391 heartbeater.cc:511] Master 127.20.158.190:44975 requested a full tablet report, sending...
W20260811 08:16:01.672822 9391 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 11 08:16:02 dist-test-slave-gkw7 krb5kdc[7142](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786436162, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:02.262809 8982 heartbeater.cc:464] Registering TS with master...
I20260811 08:16:02.263006 8982 heartbeater.cc:511] Master 127.20.158.190:44975 requested a full tablet report, sending...
I20260811 08:16:02.263561 8674 ts_manager.cc:194] Registered new tserver with Master: 5d9a14f01b054d28a49401228ad6a8cb (127.20.158.129:35195)
I20260811 08:16:02.264608 8674 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.129@KRBTEST.COM'} at 127.20.158.129:35991
I20260811 08:16:02.451858 9187 heartbeater.cc:464] Registering TS with master...
I20260811 08:16:02.452067 9187 heartbeater.cc:511] Master 127.20.158.190:44975 requested a full tablet report, sending...
I20260811 08:16:02.452514 8674 ts_manager.cc:194] Registered new tserver with Master: 90463fafd4554dda86919806cf51e6a4 (127.20.158.130:38111)
I20260811 08:16:02.453169 8674 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.130@KRBTEST.COM'} at 127.20.158.130:45473
Aug 11 08:16:02 dist-test-slave-gkw7 krb5kdc[7142](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436162, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for HTTP/127.20.158.148@KRBTEST.COM
I20260811 08:16:02.673017 9391 heartbeater.cc:464] Registering TS with master...
I20260811 08:16:02.673257 9391 heartbeater.cc:511] Master 127.20.158.190:44975 requested a full tablet report, sending...
I20260811 08:16:02.673655 8674 ts_manager.cc:194] Registered new tserver with Master: b374d1783a084b80ad772173c99bc6c2 (127.20.158.131:35461)
I20260811 08:16:02.674069 8674 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.131@KRBTEST.COM'} at 127.20.158.131:39751
I20260811 08:16:02.676877 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:16:02.685120 9428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:02.677942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41274 (local address 127.20.158.190:44975)
0811 08:16:02.678074 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:02.678077 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:02.678139 (+ 62us) server_negotiation.cc:407] Connection header received
0811 08:16:02.678224 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:02.678225 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:02.678237 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:02.678300 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:02.678887 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:02.679415 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:02.680185 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:02.680407 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:02.680484 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:02.681875 (+ 1391us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:02.681877 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:02.681877 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:02.681885 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:02.683462 (+ 1577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:02.683883 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:02.683884 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:02.683885 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:02.683951 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:02.684173 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:02.684174 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:02.684175 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:02.684304 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:02.684419 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:02.684977 (+ 558us) server_negotiation.cc:299] Negotiation successful
0811 08:16:02.685048 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":75,"threads_started":1}
I20260811 08:16:02.687381 8674 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41274:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:16:02.689174 8674 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:16:02.697412 9439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:02.692076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:35195 (local address 127.0.0.1:48666)
0811 08:16:02.692610 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:02.692651 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:02.692868 (+ 217us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:02.693170 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:02.693174 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:02.693176 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:16:02.693250 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:02.693252 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:02.694695 (+ 1443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:02.694696 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:02.696060 (+ 1364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:02.696063 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:02.697098 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:02.697099 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:02.697177 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:02.697191 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 08:16:02.697262 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 08:16:02.697323 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":505,"mutex_wait_us":37,"thread_start_us":90,"threads_started":1}
I20260811 08:16:02.697674 9440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:02.692310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:35461 (local address 127.0.0.1:38032)
0811 08:16:02.693116 (+ 806us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:02.693123 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:02.693176 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:02.693446 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:02.693447 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:02.693448 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:16:02.693482 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:02.693484 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:02.694890 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:02.694890 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:02.696060 (+ 1170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:02.696063 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:02.697413 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:02.697414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:02.697473 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:02.697478 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:16:02.697566 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 08:16:02.697605 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":793,"mutex_wait_us":6,"thread_start_us":69,"threads_started":1}
I20260811 08:16:02.698348 9441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:02.692347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48666 (local address 127.20.158.129:35195)
0811 08:16:02.692540 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:02.692545 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:02.692776 (+ 231us) server_negotiation.cc:407] Connection header received
0811 08:16:02.692958 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:02.692961 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:02.692978 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:02.693058 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:16:02.693333 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:02.694461 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:02.696167 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:02.696934 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:02.696999 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:02.697064 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:02.698167 (+ 1103us) server_negotiation.cc:299] Negotiation successful
0811 08:16:02.698240 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":58,"threads_started":1}
I20260811 08:16:02.698957 9443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:02.692451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38032 (local address 127.20.158.131:35461)
0811 08:16:02.692589 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:02.692718 (+ 129us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:02.693231 (+ 513us) server_negotiation.cc:407] Connection header received
0811 08:16:02.693268 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:02.693271 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:02.693288 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:02.693361 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:16:02.693591 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:02.694578 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:02.696174 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:02.697272 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:02.697330 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:02.697380 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:02.697739 (+ 359us) server_negotiation.cc:299] Negotiation successful
0811 08:16:02.698849 (+ 1110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104,"thread_start_us":70,"threads_started":1}
I20260811 08:16:02.699250 8875 tablet_service.cc:1467] Processing CreateTablet for tablet 6c75353bdc70464b90d502c992140911 (DEFAULT_TABLE table=test-table [id=53cc5ad2d5e74453ac21c5ec26042980]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:16:02.699667 8875 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c75353bdc70464b90d502c992140911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:16:02.699728 9284 tablet_service.cc:1467] Processing CreateTablet for tablet 6c75353bdc70464b90d502c992140911 (DEFAULT_TABLE table=test-table [id=53cc5ad2d5e74453ac21c5ec26042980]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:16:02.700062 9284 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c75353bdc70464b90d502c992140911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:16:02.707362 9436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:02.692076 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:38111 (local address 127.0.0.1:33828)
0811 08:16:02.692991 (+ 915us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:02.693002 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:02.693041 (+ 39us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:02.704106 (+ 11065us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:02.704108 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:02.704111 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:16:02.704161 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:02.704163 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:02.705156 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:02.705157 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:02.706134 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:02.706137 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:02.706911 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:02.706912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:02.706973 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:02.706977 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:16:02.707129 (+ 152us) client_negotiation.cc:240] Negotiation successful
0811 08:16:02.707186 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":895,"mutex_wait_us":4,"thread_start_us":81,"threads_started":1}
I20260811 08:16:02.707693 9444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:02.692611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33828 (local address 127.20.158.130:38111)
0811 08:16:02.703932 (+ 11321us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:02.703937 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:02.703948 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:16:02.703989 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:02.703990 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:02.704005 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:02.704110 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:16:02.704257 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:02.705047 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:02.706273 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:02.706805 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:02.706913 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:02.706972 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:02.707565 (+ 593us) server_negotiation.cc:299] Negotiation successful
0811 08:16:02.707616 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11258,"thread_start_us":63,"threads_started":1}
I20260811 08:16:02.708344 9079 tablet_service.cc:1467] Processing CreateTablet for tablet 6c75353bdc70464b90d502c992140911 (DEFAULT_TABLE table=test-table [id=53cc5ad2d5e74453ac21c5ec26042980]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:16:02.708683 9079 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6c75353bdc70464b90d502c992140911. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:16:02.709693 9447 tablet_bootstrap.cc:492] T 6c75353bdc70464b90d502c992140911 P b374d1783a084b80ad772173c99bc6c2: Bootstrap starting.
I20260811 08:16:02.710399 9447 tablet_bootstrap.cc:654] T 6c75353bdc70464b90d502c992140911 P b374d1783a084b80ad772173c99bc6c2: Neither blocks nor log segments found. Creating new log.
I20260811 08:16:02.710748 9447 log.cc:824] T 6c75353bdc70464b90d502c992140911 P b374d1783a084b80ad772173c99bc6c2: Log is configured to *not* fsync() on all Append() calls
I20260811 08:16:02.711126 9446 tablet_bootstrap.cc:492] T 6c75353bdc70464b90d502c992140911 P 5d9a14f01b054d28a49401228ad6a8cb: Bootstrap starting.
I20260811 08:16:02.711846 9446 tablet_bootstrap.cc:654] T 6c75353bdc70464b90d502c992140911 P 5d9a14f01b054d28a49401228ad6a8cb: Neither blocks nor log segments found. Creating new log.
I20260811 08:16:02.712292 9447 tablet_bootstrap.cc:492] T 6c75353bdc70464b90d502c992140911 P b374d1783a084b80ad772173c99bc6c2: No bootstrap required, opened a new log
I20260811 08:16:02.712244 9449 tablet_bootstrap.cc:492] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4: Bootstrap starting.
I20260811 08:16:02.712532 9447 ts_tablet_manager.cc:1397] T 6c75353bdc70464b90d502c992140911 P b374d1783a084b80ad772173c99bc6c2: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 08:16:02.712993 9449 tablet_bootstrap.cc:654] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4: Neither blocks nor log segments found. Creating new log.
I20260811 08:16:02.713291 9449 log.cc:824] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4: Log is configured to *not* fsync() on all Append() calls
I20260811 08:16:02.714077 9449 tablet_bootstrap.cc:492] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4: No bootstrap required, opened a new log
I20260811 08:16:02.714159 9449 ts_tablet_manager.cc:1397] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:16:02.715337 9447 raft_consensus.cc:348] T 6c75353bdc70464b90d502c992140911 P b374d1783a084b80ad772173c99bc6c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90463fafd4554dda86919806cf51e6a4" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 38111 } } peers { permanent_uuid: "5d9a14f01b054d28a49401228ad6a8cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 35195 } } peers { permanent_uuid: "b374d1783a084b80ad772173c99bc6c2" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 35461 } }
I20260811 08:16:02.715524 9447 raft_consensus.cc:374] T 6c75353bdc70464b90d502c992140911 P b374d1783a084b80ad772173c99bc6c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:16:02.715559 9447 raft_consensus.cc:729] T 6c75353bdc70464b90d502c992140911 P b374d1783a084b80ad772173c99bc6c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b374d1783a084b80ad772173c99bc6c2, State: Initialized, Role: FOLLOWER
I20260811 08:16:02.716059 9449 raft_consensus.cc:348] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90463fafd4554dda86919806cf51e6a4" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 38111 } } peers { permanent_uuid: "5d9a14f01b054d28a49401228ad6a8cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 35195 } } peers { permanent_uuid: "b374d1783a084b80ad772173c99bc6c2" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 35461 } }
I20260811 08:16:02.716219 9449 raft_consensus.cc:374] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:16:02.716285 9449 raft_consensus.cc:729] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90463fafd4554dda86919806cf51e6a4, State: Initialized, Role: FOLLOWER
I20260811 08:16:02.716545 9449 consensus_queue.cc:260] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90463fafd4554dda86919806cf51e6a4" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 38111 } } peers { permanent_uuid: "5d9a14f01b054d28a49401228ad6a8cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 35195 } } peers { permanent_uuid: "b374d1783a084b80ad772173c99bc6c2" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 35461 } }
I20260811 08:16:02.717114 9449 ts_tablet_manager.cc:1428] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:16:02.717118 9187 heartbeater.cc:503] Master 127.20.158.190:44975 was elected leader, sending a full tablet report...
I20260811 08:16:02.717695 9447 consensus_queue.cc:260] T 6c75353bdc70464b90d502c992140911 P b374d1783a084b80ad772173c99bc6c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90463fafd4554dda86919806cf51e6a4" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 38111 } } peers { permanent_uuid: "5d9a14f01b054d28a49401228ad6a8cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 35195 } } peers { permanent_uuid: "b374d1783a084b80ad772173c99bc6c2" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 35461 } }
I20260811 08:16:02.718278 9446 log.cc:824] T 6c75353bdc70464b90d502c992140911 P 5d9a14f01b054d28a49401228ad6a8cb: Log is configured to *not* fsync() on all Append() calls
I20260811 08:16:02.718622 9447 ts_tablet_manager.cc:1428] T 6c75353bdc70464b90d502c992140911 P b374d1783a084b80ad772173c99bc6c2: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20260811 08:16:02.718781 9391 heartbeater.cc:503] Master 127.20.158.190:44975 was elected leader, sending a full tablet report...
I20260811 08:16:02.719837 9446 tablet_bootstrap.cc:492] T 6c75353bdc70464b90d502c992140911 P 5d9a14f01b054d28a49401228ad6a8cb: No bootstrap required, opened a new log
I20260811 08:16:02.719933 9446 ts_tablet_manager.cc:1397] T 6c75353bdc70464b90d502c992140911 P 5d9a14f01b054d28a49401228ad6a8cb: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20260811 08:16:02.721946 9446 raft_consensus.cc:348] T 6c75353bdc70464b90d502c992140911 P 5d9a14f01b054d28a49401228ad6a8cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90463fafd4554dda86919806cf51e6a4" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 38111 } } peers { permanent_uuid: "5d9a14f01b054d28a49401228ad6a8cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 35195 } } peers { permanent_uuid: "b374d1783a084b80ad772173c99bc6c2" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 35461 } }
I20260811 08:16:02.722102 9446 raft_consensus.cc:374] T 6c75353bdc70464b90d502c992140911 P 5d9a14f01b054d28a49401228ad6a8cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:16:02.722167 9446 raft_consensus.cc:729] T 6c75353bdc70464b90d502c992140911 P 5d9a14f01b054d28a49401228ad6a8cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5d9a14f01b054d28a49401228ad6a8cb, State: Initialized, Role: FOLLOWER
I20260811 08:16:02.722311 9446 consensus_queue.cc:260] T 6c75353bdc70464b90d502c992140911 P 5d9a14f01b054d28a49401228ad6a8cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90463fafd4554dda86919806cf51e6a4" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 38111 } } peers { permanent_uuid: "5d9a14f01b054d28a49401228ad6a8cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 35195 } } peers { permanent_uuid: "b374d1783a084b80ad772173c99bc6c2" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 35461 } }
I20260811 08:16:02.722599 8982 heartbeater.cc:503] Master 127.20.158.190:44975 was elected leader, sending a full tablet report...
I20260811 08:16:02.722595 9446 ts_tablet_manager.cc:1428] T 6c75353bdc70464b90d502c992140911 P 5d9a14f01b054d28a49401228ad6a8cb: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:16:02.723412 9451 raft_consensus.cc:482] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:16:02.723555 9451 raft_consensus.cc:504] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90463fafd4554dda86919806cf51e6a4" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 38111 } } peers { permanent_uuid: "5d9a14f01b054d28a49401228ad6a8cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 35195 } } peers { permanent_uuid: "b374d1783a084b80ad772173c99bc6c2" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 35461 } }
I20260811 08:16:02.724308 9451 leader_election.cc:288] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5d9a14f01b054d28a49401228ad6a8cb (127.20.158.129:35195), b374d1783a084b80ad772173c99bc6c2 (127.20.158.131:35461)
I20260811 08:16:02.729388 9441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:02.724226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:55049 (local address 127.20.158.129:35195)
0811 08:16:02.724268 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:02.724270 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:02.725726 (+ 1456us) server_negotiation.cc:407] Connection header received
0811 08:16:02.725837 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:02.725838 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:02.725847 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:02.725878 (+ 31us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:16:02.726094 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:02.726921 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:02.728369 (+ 1448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:02.728930 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:02.728978 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:02.728988 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:02.729263 (+ 275us) server_negotiation.cc:299] Negotiation successful
0811 08:16:02.729304 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 08:16:02.729517 9443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:02.724276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:40533 (local address 127.20.158.131:35461)
0811 08:16:02.724315 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:02.724317 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:02.726202 (+ 1885us) server_negotiation.cc:407] Connection header received
0811 08:16:02.726292 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:02.726293 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:02.726302 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:02.726332 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:16:02.726507 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:02.727204 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:02.728489 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:02.729063 (+ 574us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:02.729103 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:02.729110 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:02.729380 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 08:16:02.729443 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:16:02.729820 9458 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:02.724036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:35195 (local address 127.20.158.130:55049)
0811 08:16:02.725648 (+ 1612us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:02.725662 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:02.725757 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:02.725949 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:02.725950 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:02.725951 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:16:02.726033 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:02.726035 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:02.727011 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:02.727012 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:02.728274 (+ 1262us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:02.728277 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:02.729065 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:02.729067 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:02.729174 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:02.729180 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 08:16:02.729669 (+ 489us) client_negotiation.cc:240] Negotiation successful
0811 08:16:02.729727 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1590,"thread_start_us":90,"threads_started":1}
I20260811 08:16:02.730012 9461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:02.724037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:35461 (local address 127.20.158.130:40533)
0811 08:16:02.726149 (+ 2112us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:02.726158 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:02.726226 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:02.726384 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:02.726385 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:02.726386 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:16:02.726443 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:02.726445 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:02.727294 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:02.727295 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:02.728407 (+ 1112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:02.728409 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:02.729225 (+ 816us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:02.729226 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:02.729302 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:02.729305 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:16:02.729773 (+ 468us) client_negotiation.cc:240] Negotiation successful
0811 08:16:02.729809 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2086,"mutex_wait_us":2,"thread_start_us":92,"threads_started":1}
I20260811 08:16:02.730197 8906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c75353bdc70464b90d502c992140911" candidate_uuid: "90463fafd4554dda86919806cf51e6a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d9a14f01b054d28a49401228ad6a8cb" is_pre_election: true
I20260811 08:16:02.730331 8906 raft_consensus.cc:2454] T 6c75353bdc70464b90d502c992140911 P 5d9a14f01b054d28a49401228ad6a8cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90463fafd4554dda86919806cf51e6a4 in term 0.
I20260811 08:16:02.730520 9312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c75353bdc70464b90d502c992140911" candidate_uuid: "90463fafd4554dda86919806cf51e6a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b374d1783a084b80ad772173c99bc6c2" is_pre_election: true
I20260811 08:16:02.732131 9015 leader_election.cc:302] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5d9a14f01b054d28a49401228ad6a8cb, 90463fafd4554dda86919806cf51e6a4; no voters:
I20260811 08:16:02.732271 9451 raft_consensus.cc:2781] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:16:02.732332 9451 raft_consensus.cc:482] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:16:02.732370 9451 raft_consensus.cc:3037] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:16:02.730684 9312 raft_consensus.cc:2454] T 6c75353bdc70464b90d502c992140911 P b374d1783a084b80ad772173c99bc6c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90463fafd4554dda86919806cf51e6a4 in term 0.
I20260811 08:16:02.733165 9451 raft_consensus.cc:504] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90463fafd4554dda86919806cf51e6a4" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 38111 } } peers { permanent_uuid: "5d9a14f01b054d28a49401228ad6a8cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 35195 } } peers { permanent_uuid: "b374d1783a084b80ad772173c99bc6c2" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 35461 } }
I20260811 08:16:02.733302 9451 leader_election.cc:288] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4 [CANDIDATE]: Term 1 election: Requested vote from peers 5d9a14f01b054d28a49401228ad6a8cb (127.20.158.129:35195), b374d1783a084b80ad772173c99bc6c2 (127.20.158.131:35461)
I20260811 08:16:02.733551 9312 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c75353bdc70464b90d502c992140911" candidate_uuid: "90463fafd4554dda86919806cf51e6a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b374d1783a084b80ad772173c99bc6c2"
I20260811 08:16:02.733587 8906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6c75353bdc70464b90d502c992140911" candidate_uuid: "90463fafd4554dda86919806cf51e6a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5d9a14f01b054d28a49401228ad6a8cb"
I20260811 08:16:02.733628 9312 raft_consensus.cc:3037] T 6c75353bdc70464b90d502c992140911 P b374d1783a084b80ad772173c99bc6c2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:16:02.733657 8906 raft_consensus.cc:3037] T 6c75353bdc70464b90d502c992140911 P 5d9a14f01b054d28a49401228ad6a8cb [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:16:02.734465 9312 raft_consensus.cc:2454] T 6c75353bdc70464b90d502c992140911 P b374d1783a084b80ad772173c99bc6c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90463fafd4554dda86919806cf51e6a4 in term 1.
I20260811 08:16:02.734465 8906 raft_consensus.cc:2454] T 6c75353bdc70464b90d502c992140911 P 5d9a14f01b054d28a49401228ad6a8cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90463fafd4554dda86919806cf51e6a4 in term 1.
I20260811 08:16:02.734709 9013 leader_election.cc:302] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90463fafd4554dda86919806cf51e6a4, b374d1783a084b80ad772173c99bc6c2; no voters:
I20260811 08:16:02.734826 9451 raft_consensus.cc:2781] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:16:02.735045 9451 raft_consensus.cc:686] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4 [term 1 LEADER]: Becoming Leader. State: Replica: 90463fafd4554dda86919806cf51e6a4, State: Running, Role: LEADER
I20260811 08:16:02.735136 9451 consensus_queue.cc:237] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90463fafd4554dda86919806cf51e6a4" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 38111 } } peers { permanent_uuid: "5d9a14f01b054d28a49401228ad6a8cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 35195 } } peers { permanent_uuid: "b374d1783a084b80ad772173c99bc6c2" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 35461 } }
I20260811 08:16:02.735888 8674 catalog_manager.cc:5495] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 90463fafd4554dda86919806cf51e6a4 (127.20.158.130). New cstate: current_term: 1 leader_uuid: "90463fafd4554dda86919806cf51e6a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90463fafd4554dda86919806cf51e6a4" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 38111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5d9a14f01b054d28a49401228ad6a8cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 35195 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b374d1783a084b80ad772173c99bc6c2" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 35461 } health_report { overall_health: UNKNOWN } } }
W20260811 08:16:02.737032 8983 tablet.cc:2369] T 6c75353bdc70464b90d502c992140911 P 5d9a14f01b054d28a49401228ad6a8cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:16:02.746166 9444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:02.743657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33840 (local address 127.20.158.130:38111)
0811 08:16:02.743696 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:02.743697 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:02.743722 (+ 25us) server_negotiation.cc:407] Connection header received
0811 08:16:02.743813 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:02.743813 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:02.743831 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:02.743919 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:16:02.744067 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:02.744546 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:02.745320 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:02.745578 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:02.745641 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:02.745826 (+ 185us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:16:02.745934 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:16:02.746030 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:02.746050 (+ 20us) server_negotiation.cc:299] Negotiation successful
0811 08:16:02.746072 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:16:02.748078 9312 raft_consensus.cc:1261] T 6c75353bdc70464b90d502c992140911 P b374d1783a084b80ad772173c99bc6c2 [term 1 FOLLOWER]: Refusing update from remote peer 90463fafd4554dda86919806cf51e6a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:16:02.748078 8906 raft_consensus.cc:1261] T 6c75353bdc70464b90d502c992140911 P 5d9a14f01b054d28a49401228ad6a8cb [term 1 FOLLOWER]: Refusing update from remote peer 90463fafd4554dda86919806cf51e6a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:16:02.748396 9451 consensus_queue.cc:1035] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5d9a14f01b054d28a49401228ad6a8cb" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 35195 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:16:02.748561 9451 consensus_queue.cc:1035] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b374d1783a084b80ad772173c99bc6c2" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 35461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:16:02.751724 9468 mvcc.cc:205] Tried to move back new op lower bound from 7317242522613530624 to 7317242522563514368. Current Snapshot: MvccSnapshot[applied={T|T < 7317242522613530624}]
I20260811 08:16:02.754016 8673 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41274:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:16:02.754065 9469 mvcc.cc:205] Tried to move back new op lower bound from 7317242522613530624 to 7317242522563514368. Current Snapshot: MvccSnapshot[applied={T|T < 7317242522613530624}]
I20260811 08:16:02.754118 8673 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41274:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:16:02.754884 8673 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6cc8533c340f4003b309b7276cd76d57: Sending DeleteTablet for 3 replicas of tablet 6c75353bdc70464b90d502c992140911
I20260811 08:16:02.755255 8875 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c75353bdc70464b90d502c992140911 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:16:02 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:48666
I20260811 08:16:02.755379 9079 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c75353bdc70464b90d502c992140911 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:16:02 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:33828
I20260811 08:16:02.755682 9284 tablet_service.cc:1514] Processing DeleteTablet for tablet 6c75353bdc70464b90d502c992140911 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:16:02 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:38032
I20260811 08:16:02.755899 9486 tablet_replica.cc:330] T 6c75353bdc70464b90d502c992140911 P b374d1783a084b80ad772173c99bc6c2: stopping tablet replica
I20260811 08:16:02.756052 9486 raft_consensus.cc:2229] T 6c75353bdc70464b90d502c992140911 P b374d1783a084b80ad772173c99bc6c2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:16:02.756072 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 8740
I20260811 08:16:02.756211 9486 raft_consensus.cc:2258] T 6c75353bdc70464b90d502c992140911 P b374d1783a084b80ad772173c99bc6c2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:16:02.798050 9486 ts_tablet_manager.cc:1905] T 6c75353bdc70464b90d502c992140911 P b374d1783a084b80ad772173c99bc6c2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:16:02.800256 9486 ts_tablet_manager.cc:1918] T 6c75353bdc70464b90d502c992140911 P b374d1783a084b80ad772173c99bc6c2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:16:02.800449 9486 log.cc:1196] T 6c75353bdc70464b90d502c992140911 P b374d1783a084b80ad772173c99bc6c2: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-2/wal/wals/6c75353bdc70464b90d502c992140911
I20260811 08:16:02.800823 9486 ts_tablet_manager.cc:1939] T 6c75353bdc70464b90d502c992140911 P b374d1783a084b80ad772173c99bc6c2: Deleting consensus metadata
I20260811 08:16:02.801450 8656 catalog_manager.cc:4841] TS b374d1783a084b80ad772173c99bc6c2 (127.20.158.131:35461): tablet 6c75353bdc70464b90d502c992140911 (table test-table [id=53cc5ad2d5e74453ac21c5ec26042980]) successfully deleted
I20260811 08:16:02.805672 9484 tablet_replica.cc:330] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4: stopping tablet replica
I20260811 08:16:02.805819 9484 raft_consensus.cc:2229] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:16:02.805932 9484 raft_consensus.cc:2258] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:16:02.806559 9484 ts_tablet_manager.cc:1905] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:16:02.808485 9484 ts_tablet_manager.cc:1918] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:16:02.808583 9484 log.cc:1196] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786436003833085-21114-0/minicluster-data/ts-1/wal/wals/6c75353bdc70464b90d502c992140911
I20260811 08:16:02.808887 9484 ts_tablet_manager.cc:1939] T 6c75353bdc70464b90d502c992140911 P 90463fafd4554dda86919806cf51e6a4: Deleting consensus metadata
I20260811 08:16:02.814052 8656 catalog_manager.cc:4841] TS 90463fafd4554dda86919806cf51e6a4 (127.20.158.130:38111): tablet 6c75353bdc70464b90d502c992140911 (table test-table [id=53cc5ad2d5e74453ac21c5ec26042980]) successfully deleted
W20260811 08:16:02.818495 8658 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.158.129:35195 (error 108)
I20260811 08:16:02.819576 9436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:02.819454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:35195 (local address 127.0.0.1:48670)
0811 08:16:02.819507 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:02.819538 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.129:35195: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 08:16:02.819825 8658 catalog_manager.cc:4584] TS 5d9a14f01b054d28a49401228ad6a8cb (127.20.158.129:35195): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6c75353bdc70464b90d502c992140911: Network error: Client connection negotiation failed: client connection to 127.20.158.129:35195: connect: Connection refused (error 111)
I20260811 08:16:02.820078 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 8986
I20260811 08:16:02.834604 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 9192
I20260811 08:16:02.855383 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 8633
I20260811 08:16:02.871356 21114 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260811 08:16:03.216729 21114 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260811 08:16:03.216905 21114 mini_ranger.cc:66] Stopping Ranger...
I20260811 08:16:03.572000 21114 mini_ranger.cc:68] Stopped Ranger
2026-08-11 08:16:03.572 UTC [7185] LOG: received smart shutdown request
2026-08-11 08:16:03.576 UTC [7185] LOG: background worker "logical replication launcher" (PID 7201) exited with exit code 1
2026-08-11 08:16:03.577 UTC [7194] LOG: shutting down
2026-08-11 08:16:03.753 UTC [7185] LOG: database system is shut down
2026-08-11T08:16:03Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (49579 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:16:03 dist-test-slave-gkw7 krb5kdc[9506](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:16:03 dist-test-slave-gkw7 krb5kdc[9506](info): set up 2 sockets
Aug 11 08:16:03 dist-test-slave-gkw7 krb5kdc[9506](info): commencing operation
krb5kdc: starting...
W20260811 08:16:05.122731 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.230s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:16:05 dist-test-slave-gkw7 krb5kdc[9506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436165, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:16:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:16:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:16:05.257124 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:37041
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:45055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:37041,127.20.158.189:37681,127.20.158.188:38767
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:16:05.348730 9527 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:05.349005 9527 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:05.349048 9527 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:05.350265 9527 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:16:05.350338 9527 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:05.350361 9527 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:05.350383 9527 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:16:05.350414 9527 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:16:05.351948 9527 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:45055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:37041,127.20.158.189:37681,127.20.158.188:38767
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:37041
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9527
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:05.352262 9527 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:05.352552 9527 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:05.357750 9536 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:05.357730 9535 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:05.357730 9540 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:05.358706 9527 server_base.cc:1034] running on GCE node
I20260811 08:16:05.359043 9527 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:05.359390 9527 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:05.360574 9527 hybrid_clock.cc:648] HybridClock initialized: now 1786436165360560 us; error 54 us; skew 500 ppm
Aug 11 08:16:05 dist-test-slave-gkw7 krb5kdc[9506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436165, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:05.367005 9527 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:16:05.367476 9527 webserver.cc:460] Webserver started at http://127.20.158.190:45439/ using document root <none> and password file <none>
I20260811 08:16:05.367739 9527 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:05.367808 9527 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:16:05.367954 9527 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:16:05.369063 9527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "3b01fbb312c44112a503097c52bdb144"
format_stamp: "Formatted at 2026-08-11 08:16:05 on dist-test-slave-gkw7"
server_key: "a6cdb4bb47cc95e5bde1a6a58aab3df3"
server_key_iv: "92c0afbacb4b9b4c9959d6494990fc6e"
server_key_version: "encryptionkey@0"
I20260811 08:16:05.369432 9527 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "3b01fbb312c44112a503097c52bdb144"
format_stamp: "Formatted at 2026-08-11 08:16:05 on dist-test-slave-gkw7"
server_key: "a6cdb4bb47cc95e5bde1a6a58aab3df3"
server_key_iv: "92c0afbacb4b9b4c9959d6494990fc6e"
server_key_version: "encryptionkey@0"
I20260811 08:16:05.370923 9527 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:16:05.371721 9550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:05.371917 9527 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:16:05.372025 9527 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "3b01fbb312c44112a503097c52bdb144"
format_stamp: "Formatted at 2026-08-11 08:16:05 on dist-test-slave-gkw7"
server_key: "a6cdb4bb47cc95e5bde1a6a58aab3df3"
server_key_iv: "92c0afbacb4b9b4c9959d6494990fc6e"
server_key_version: "encryptionkey@0"
I20260811 08:16:05.372098 9527 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:05.396884 9527 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:05.399677 9527 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:05.399855 9527 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:05.404325 9527 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:37041
I20260811 08:16:05.404358 9634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:37041 every 8 connection(s)
I20260811 08:16:05.404750 9527 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:16:05.405742 9635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:16:05.407414 9635 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37041 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:16:05 dist-test-slave-gkw7 krb5kdc[9506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436165, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:16:05.413697 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 9527
I20260811 08:16:05.413807 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:16:05.413992 21114 external_mini_cluster.cc:1428] Setting key 8ce79e916de6bfcf97cb8c8fa08117d9
I20260811 08:16:05.417886 9641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.408183 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50436 (local address 127.20.158.190:37041)
0811 08:16:05.408374 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:05.408383 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:05.408464 (+ 81us) server_negotiation.cc:407] Connection header received
0811 08:16:05.409004 (+ 540us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:05.409006 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:05.409024 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:05.409144 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:05.409754 (+ 610us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.410642 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.411557 (+ 915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.411894 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.411990 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:05.414290 (+ 2300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:05.414298 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:05.414299 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:05.414310 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:05.415985 (+ 1675us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.416491 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.416494 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.416494 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.416584 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.416867 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.416868 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.416869 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.417102 (+ 233us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:05.417199 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:05.417423 (+ 224us) server_negotiation.cc:299] Negotiation successful
0811 08:16:05.417606 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":114,"threads_started":1}
I20260811 08:16:05.417889 9639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.408160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:37041 (local address 127.0.0.1:50436)
0811 08:16:05.408350 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:05.408390 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:05.408845 (+ 455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:05.409149 (+ 304us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:05.409151 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:05.409403 (+ 252us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:05.409641 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:05.409646 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.410745 (+ 1099us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.410746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:05.411459 (+ 713us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:05.411461 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.411984 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.411985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:05.412042 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:05.412565 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:05.412575 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:05.414187 (+ 1612us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:05.416136 (+ 1949us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:05.416143 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:05.416146 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:05.416374 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:05.416681 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:05.416682 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:05.416683 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:05.416780 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:05.417193 (+ 413us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:05.417198 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:05.417269 (+ 71us) client_negotiation.cc:769] Sending connection context
0811 08:16:05.417394 (+ 125us) client_negotiation.cc:240] Negotiation successful
0811 08:16:05.417679 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"mutex_wait_us":132,"thread_start_us":110,"threads_started":1}
I20260811 08:16:05.418928 9635 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37681 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:16:05.419332 9639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.419193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:37681 (local address 127.0.0.1:57896)
0811 08:16:05.419249 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:05.419300 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.189:37681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 08:16:05.419492 9553 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.158.189:37681: connect: Connection refused (error 111)
I20260811 08:16:05.419986 9639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.419884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:37681 (local address 127.0.0.1:57906)
0811 08:16:05.419934 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:05.419961 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.189:37681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 08:16:05.420105 9635 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.158.189:37681: Network error: Client connection negotiation failed: client connection to 127.20.158.189:37681: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.20.158.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.189.keytab.
Entry for principal kudu/127.20.158.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.189.keytab.
I20260811 08:16:05.443104 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.189:37681
--webserver_interface=127.20.158.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.189.keytab
--principal=kudu/127.20.158.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:45055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:37041,127.20.158.189:37681,127.20.158.188:38767
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:16:05.469357 9635 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37681 } attempt: 1
I20260811 08:16:05.470017 9639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.469855 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:37681 (local address 127.0.0.1:57914)
0811 08:16:05.469935 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:05.469981 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.189:37681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260811 08:16:05.470423 9639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.470319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:37681 (local address 127.0.0.1:57930)
0811 08:16:05.470371 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:05.470404 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.189:37681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 08:16:05.470520 9635 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.158.189:37681: Network error: Client connection negotiation failed: client connection to 127.20.158.189:37681: connect: Connection refused (error 111)
W20260811 08:16:05.537469 9648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:05.537755 9648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:05.537778 9648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260811 08:16:05.538671 9635 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37681 } attempt: 2
W20260811 08:16:05.539005 9648 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:16:05.539048 9648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:05.539063 9648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:05.539076 9648 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:16:05.539182 9648 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:16:05.539237 9639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.539040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:37681 (local address 127.0.0.1:57934)
0811 08:16:05.539145 (+ 105us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:05.539199 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.189:37681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260811 08:16:05.539674 9639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.539514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:37681 (local address 127.0.0.1:57946)
0811 08:16:05.539569 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:05.539604 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.189:37681: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
W20260811 08:16:05.539786 9635 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.158.189:37681: Network error: Client connection negotiation failed: client connection to 127.20.158.189:37681: connect: Connection refused (error 111)
I20260811 08:16:05.540891 9648 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:45055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:37041,127.20.158.189:37681,127.20.158.188:38767
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.189.keytab
--principal=kudu/127.20.158.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.189:37681
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.158.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9648
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:05.541149 9648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:05.541379 9648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:05.546422 9657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:05.546422 9661 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:05.546516 9659 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:05.546439 9648 server_base.cc:1034] running on GCE node
I20260811 08:16:05.546962 9648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:05.547255 9648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:05.548426 9648 hybrid_clock.cc:648] HybridClock initialized: now 1786436165548410 us; error 31 us; skew 500 ppm
Aug 11 08:16:05 dist-test-slave-gkw7 krb5kdc[9506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436165, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:05.551242 9648 init.cc:377] Logged in from keytab as kudu/127.20.158.189@KRBTEST.COM (short username kudu)
I20260811 08:16:05.551716 9648 webserver.cc:460] Webserver started at http://127.20.158.189:35731/ using document root <none> and password file <none>
I20260811 08:16:05.551972 9648 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:05.552019 9648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:16:05.552166 9648 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:16:05.553289 9648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-1/data/instance:
uuid: "9b5e3b5eff404623b668403ac42e18bf"
format_stamp: "Formatted at 2026-08-11 08:16:05 on dist-test-slave-gkw7"
server_key: "002fb5887635b96e11242f379253af02"
server_key_iv: "9c9c7b8583786b468cfbd5d8ca89089f"
server_key_version: "encryptionkey@0"
I20260811 08:16:05.553731 9648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-1/wal/instance:
uuid: "9b5e3b5eff404623b668403ac42e18bf"
format_stamp: "Formatted at 2026-08-11 08:16:05 on dist-test-slave-gkw7"
server_key: "002fb5887635b96e11242f379253af02"
server_key_iv: "9c9c7b8583786b468cfbd5d8ca89089f"
server_key_version: "encryptionkey@0"
I20260811 08:16:05.555189 9648 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:05.556062 9670 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:05.556293 9648 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:05.556401 9648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-1/wal
uuid: "9b5e3b5eff404623b668403ac42e18bf"
format_stamp: "Formatted at 2026-08-11 08:16:05 on dist-test-slave-gkw7"
server_key: "002fb5887635b96e11242f379253af02"
server_key_iv: "9c9c7b8583786b468cfbd5d8ca89089f"
server_key_version: "encryptionkey@0"
I20260811 08:16:05.556489 9648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:05.575874 9648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:05.578250 9648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:05.578434 9648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:05.583344 9648 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.189:37681
I20260811 08:16:05.583393 9743 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.189:37681 every 8 connection(s)
I20260811 08:16:05.583798 9648 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-1/data/info.pb
I20260811 08:16:05.584798 9744 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:16:05.586469 9744 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37041 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:16:05.591051 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 9648
I20260811 08:16:05.591203 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-1/wal/instance
I20260811 08:16:05.591429 21114 external_mini_cluster.cc:1428] Setting key 2a059fa25c1f93443b0e051db8798528
Aug 11 08:16:05 dist-test-slave-gkw7 krb5kdc[9506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436165, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.189@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:16:05.596840 9641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.587271 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50452 (local address 127.20.158.190:37041)
0811 08:16:05.587400 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:05.587402 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:05.587613 (+ 211us) server_negotiation.cc:407] Connection header received
0811 08:16:05.588156 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:05.588157 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:05.588173 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:05.588256 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:05.588941 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.589487 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.590550 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.590769 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.590843 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:05.593488 (+ 2645us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:05.593490 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:05.593491 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:05.593501 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:05.595254 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.595690 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.595691 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.595692 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.595767 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.596069 (+ 302us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.596070 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.596070 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.596243 (+ 173us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:05.596329 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:05.596588 (+ 259us) server_negotiation.cc:299] Negotiation successful
0811 08:16:05.596710 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 08:16:05.597007 9750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.587252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:37041 (local address 127.0.0.1:50452)
0811 08:16:05.587478 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:05.587516 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:05.588012 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:05.588345 (+ 333us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:05.588349 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:05.588634 (+ 285us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:05.588835 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:05.588838 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.589631 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.589632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:05.590442 (+ 810us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:05.590444 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.590865 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.590866 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:05.590994 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:05.591610 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:05.591622 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:05.593329 (+ 1707us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:05.595351 (+ 2022us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:05.595358 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:05.595360 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:05.595602 (+ 242us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:05.595873 (+ 271us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:05.595874 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:05.595875 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:05.595990 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:05.596318 (+ 328us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:05.596323 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:05.596446 (+ 123us) client_negotiation.cc:769] Sending connection context
0811 08:16:05.596533 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 08:16:05.596683 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":101,"threads_started":1}
I20260811 08:16:05.597666 9744 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37681 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.20.158.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.188@KRBTEST.COM" created.
Aug 11 08:16:05 dist-test-slave-gkw7 krb5kdc[9506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436165, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.189@KRBTEST.COM for kudu/127.20.158.189@KRBTEST.COM
I20260811 08:16:05.609895 9750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.597983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:37681 (local address 127.0.0.1:57950)
0811 08:16:05.598075 (+ 92us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:05.598087 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:05.598171 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:05.598435 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:05.598437 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:05.598565 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:05.598621 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:05.598622 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.600170 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.600171 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:05.600705 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:05.600706 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.601473 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.601474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:05.601606 (+ 132us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:05.602154 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:05.602159 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:05.605660 (+ 3501us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:05.608695 (+ 3035us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:05.608696 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:05.608696 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:05.608865 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:05.609119 (+ 254us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:05.609120 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:05.609120 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:05.609178 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:05.609504 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:05.609505 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:05.609585 (+ 80us) client_negotiation.cc:769] Sending connection context
0811 08:16:05.609658 (+ 73us) client_negotiation.cc:240] Negotiation successful
0811 08:16:05.609770 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74}
I20260811 08:16:05.609989 9753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.598050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57950 (local address 127.20.158.189:37681)
0811 08:16:05.598240 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:05.598247 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:05.598280 (+ 33us) server_negotiation.cc:407] Connection header received
0811 08:16:05.598307 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:05.598310 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:05.598328 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:05.598430 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:05.598704 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.600044 (+ 1340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.600798 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.601368 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.601456 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:05.605768 (+ 4312us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:05.605778 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:05.605779 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:05.605786 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:05.608572 (+ 2786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.608966 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.608970 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.608970 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.609042 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.609250 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.609251 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.609252 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.609426 (+ 174us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:05.609530 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:05.609698 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 08:16:05.609847 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":59,"server-negotiator.queue_time_us":148,"thread_start_us":92,"threads_started":1}
I20260811 08:16:05.611014 9744 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:16:05.611443 9750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.611322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:38767 (local address 127.0.0.1:47346)
0811 08:16:05.611374 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:05.611422 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:38767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 08:16:05.611594 9674 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.158.188:38767: connect: Connection refused (error 111)
I20260811 08:16:05.612139 9750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.612040 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:38767 (local address 127.0.0.1:47352)
0811 08:16:05.612088 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:05.612117 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:38767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 08:16:05.612321 9744 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.158.188:38767: Network error: Client connection negotiation failed: client connection to 127.20.158.188:38767: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.188.keytab.
Entry for principal kudu/127.20.158.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.188.keytab.
I20260811 08:16:05.622692 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.188:38767
--webserver_interface=127.20.158.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.188.keytab
--principal=kudu/127.20.158.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:45055
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:37041,127.20.158.189:37681,127.20.158.188:38767
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:16:05.630951 9635 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37681 } attempt: 3
Aug 11 08:16:05 dist-test-slave-gkw7 krb5kdc[9506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436165, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for kudu/127.20.158.189@KRBTEST.COM
I20260811 08:16:05.638341 9753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.631463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57954 (local address 127.20.158.189:37681)
0811 08:16:05.631541 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:05.631543 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:05.631554 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:16:05.631585 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:05.631586 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:05.631600 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:05.631674 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:05.632012 (+ 338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.632539 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.633248 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.633470 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.633570 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:05.635505 (+ 1935us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:05.635506 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:05.635507 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:05.635515 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:05.637038 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.637441 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.637443 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.637443 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.637506 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.637761 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.637762 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.637763 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.637893 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:05.637969 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:05.638144 (+ 175us) server_negotiation.cc:299] Negotiation successful
0811 08:16:05.638237 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 08:16:05.638341 9639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.631369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:37681 (local address 127.0.0.1:57954)
0811 08:16:05.631434 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:05.631454 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:05.631521 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:05.631681 (+ 160us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:05.631682 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:05.631854 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:05.631923 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:05.631925 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.632635 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.632636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:05.633156 (+ 520us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:05.633158 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.633572 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.633574 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:05.633661 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:05.634156 (+ 495us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:05.634160 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:05.635407 (+ 1247us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:05.637158 (+ 1751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:05.637160 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:05.637160 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:05.637348 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:05.637620 (+ 272us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:05.637621 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:05.637622 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:05.637691 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:05.637972 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:05.637974 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:05.638026 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 08:16:05.638116 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 08:16:05.638233 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 08:16:05.638799 9635 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:16:05.639209 9639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.639091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:38767 (local address 127.0.0.1:47356)
0811 08:16:05.639147 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:05.639177 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:38767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260811 08:16:05.639562 9639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.639470 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:38767 (local address 127.0.0.1:47366)
0811 08:16:05.639516 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:05.639541 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:38767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 08:16:05.639688 9635 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.158.188:38767: Network error: Client connection negotiation failed: client connection to 127.20.158.188:38767: connect: Connection refused (error 111)
I20260811 08:16:05.661587 9744 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } attempt: 1
I20260811 08:16:05.662118 9750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.661966 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:38767 (local address 127.0.0.1:47380)
0811 08:16:05.662036 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:05.662075 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:38767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 08:16:05.662571 9750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.662474 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:38767 (local address 127.0.0.1:47390)
0811 08:16:05.662525 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:05.662553 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:38767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260811 08:16:05.662688 9744 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.158.188:38767: Network error: Client connection negotiation failed: client connection to 127.20.158.188:38767: connect: Connection refused (error 111)
I20260811 08:16:05.670830 9635 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } attempt: 1
I20260811 08:16:05.671283 9639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.671143 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:38767 (local address 127.0.0.1:47392)
0811 08:16:05.671206 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:05.671245 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:38767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 08:16:05.671627 9639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.671530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:38767 (local address 127.0.0.1:47398)
0811 08:16:05.671578 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:05.671607 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:38767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 08:16:05.671723 9635 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.158.188:38767: Network error: Client connection negotiation failed: client connection to 127.20.158.188:38767: connect: Connection refused (error 111)
W20260811 08:16:05.710114 9756 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:05.710356 9756 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:05.710393 9756 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:05.711534 9756 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:16:05.711602 9756 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:05.711628 9756 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:05.711649 9756 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:16:05.711676 9756 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:16:05.713218 9756 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:45055
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:37041,127.20.158.189:37681,127.20.158.188:38767
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.188.keytab
--principal=kudu/127.20.158.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.188:38767
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.158.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9756
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:05.713510 9756 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:05.713790 9756 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:05.719023 9763 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:05.719033 9765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:05.719271 9770 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:05.719341 9756 server_base.cc:1034] running on GCE node
I20260811 08:16:05.719633 9756 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:05.719998 9756 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:05.721194 9756 hybrid_clock.cc:648] HybridClock initialized: now 1786436165721169 us; error 42 us; skew 500 ppm
Aug 11 08:16:05 dist-test-slave-gkw7 krb5kdc[9506](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436165, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:05.723929 9756 init.cc:377] Logged in from keytab as kudu/127.20.158.188@KRBTEST.COM (short username kudu)
I20260811 08:16:05.724485 9756 webserver.cc:460] Webserver started at http://127.20.158.188:41351/ using document root <none> and password file <none>
I20260811 08:16:05.724736 9756 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:05.724810 9756 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:16:05.724967 9756 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:16:05.726240 9756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-2/data/instance:
uuid: "b5e73c806f4b484787fca7c409b30886"
format_stamp: "Formatted at 2026-08-11 08:16:05 on dist-test-slave-gkw7"
server_key: "ddf5a037bee30dfb8dd507a3c9ddf5df"
server_key_iv: "fcf160f8f919979aa41fde268cd1c4db"
server_key_version: "encryptionkey@0"
I20260811 08:16:05.726617 9756 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-2/wal/instance:
uuid: "b5e73c806f4b484787fca7c409b30886"
format_stamp: "Formatted at 2026-08-11 08:16:05 on dist-test-slave-gkw7"
server_key: "ddf5a037bee30dfb8dd507a3c9ddf5df"
server_key_iv: "fcf160f8f919979aa41fde268cd1c4db"
server_key_version: "encryptionkey@0"
I20260811 08:16:05.727991 9756 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 08:16:05.728868 9781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:05.729044 9756 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:05.729187 9756 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-2/wal
uuid: "b5e73c806f4b484787fca7c409b30886"
format_stamp: "Formatted at 2026-08-11 08:16:05 on dist-test-slave-gkw7"
server_key: "ddf5a037bee30dfb8dd507a3c9ddf5df"
server_key_iv: "fcf160f8f919979aa41fde268cd1c4db"
server_key_version: "encryptionkey@0"
I20260811 08:16:05.729269 9756 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:05.730832 9744 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } attempt: 2
I20260811 08:16:05.731269 9750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.731110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:38767 (local address 127.0.0.1:47408)
0811 08:16:05.731198 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:05.731237 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:38767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
I20260811 08:16:05.731587 9750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.731492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:38767 (local address 127.0.0.1:47422)
0811 08:16:05.731537 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:05.731561 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:38767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 08:16:05.731683 9744 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.158.188:38767: Network error: Client connection negotiation failed: client connection to 127.20.158.188:38767: connect: Connection refused (error 111)
I20260811 08:16:05.744352 9756 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:05.746897 9635 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } attempt: 2
I20260811 08:16:05.747166 9756 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:05.747337 9639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.747208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:38767 (local address 127.0.0.1:47424)
0811 08:16:05.747273 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:05.747309 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:38767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260811 08:16:05.747397 9756 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:05.747709 9639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.747608 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:38767 (local address 127.0.0.1:47440)
0811 08:16:05.747660 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:05.747689 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:38767: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 08:16:05.747814 9635 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.158.188:38767: Network error: Client connection negotiation failed: client connection to 127.20.158.188:38767: connect: Connection refused (error 111)
I20260811 08:16:05.752238 9756 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.188:38767
I20260811 08:16:05.752272 9852 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.188:38767 every 8 connection(s)
I20260811 08:16:05.752686 9756 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-2/data/info.pb
I20260811 08:16:05.753746 9854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:16:05.755308 9854 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37041 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:16:05.758922 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 9756
I20260811 08:16:05.759060 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786436003833085-21114-0/minicluster-data/master-2/wal/instance
I20260811 08:16:05.759255 21114 external_mini_cluster.cc:1428] Setting key f7df8a1d94c927d1a7ff2d89e3f7dff5
Aug 11 08:16:05 dist-test-slave-gkw7 krb5kdc[9506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436165, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.188@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
Aug 11 08:16:05 dist-test-slave-gkw7 krb5kdc[9506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436165, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.188@KRBTEST.COM
I20260811 08:16:05.765962 9641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.756036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50464 (local address 127.20.158.190:37041)
0811 08:16:05.756083 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:05.756085 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:05.756332 (+ 247us) server_negotiation.cc:407] Connection header received
0811 08:16:05.756782 (+ 450us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:05.756782 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:05.756792 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:05.756853 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:05.757502 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.758039 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.759454 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.759748 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.759800 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:05.762609 (+ 2809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:05.762611 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:05.762612 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:05.762629 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:05.764413 (+ 1784us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.764843 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.764846 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.764847 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.764909 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.765214 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.765215 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.765216 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.765340 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:05.765424 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:05.765781 (+ 357us) server_negotiation.cc:299] Negotiation successful
0811 08:16:05.765872 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:16:05.766168 9856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.755994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:37041 (local address 127.0.0.1:50464)
0811 08:16:05.756196 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:05.756240 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:05.756697 (+ 457us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:05.756931 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:05.756934 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:05.757204 (+ 270us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:05.757413 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:05.757417 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.758166 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.758167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:05.759325 (+ 1158us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:05.759328 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.759902 (+ 574us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.759903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:05.760090 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:05.760704 (+ 614us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:05.760713 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:05.762514 (+ 1801us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:05.764506 (+ 1992us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:05.764513 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:05.764514 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:05.764743 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:05.764979 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:05.764980 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:05.764981 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:05.765093 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:05.765412 (+ 319us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:05.765420 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:05.765607 (+ 187us) client_negotiation.cc:769] Sending connection context
0811 08:16:05.765739 (+ 132us) client_negotiation.cc:240] Negotiation successful
0811 08:16:05.765895 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":124,"threads_started":1}
I20260811 08:16:05.766780 9854 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37681 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:16:05.768908 9858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.759691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47456 (local address 127.20.158.188:38767)
0811 08:16:05.759894 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:05.759899 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:05.759923 (+ 24us) server_negotiation.cc:407] Connection header received
0811 08:16:05.759996 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:05.759999 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:05.760024 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:05.760097 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:05.760772 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.761781 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.762692 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.763082 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.763154 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:05.765657 (+ 2503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:05.765665 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:05.765665 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:05.765673 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:05.767713 (+ 2040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.768056 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.768059 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.768059 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.768129 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.768337 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.768338 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.768338 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.768482 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:05.768648 (+ 166us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:05.768719 (+ 71us) server_negotiation.cc:299] Negotiation successful
0811 08:16:05.768792 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":83,"threads_started":1}
Aug 11 08:16:05 dist-test-slave-gkw7 krb5kdc[9506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436165, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.188@KRBTEST.COM for kudu/127.20.158.189@KRBTEST.COM
Aug 11 08:16:05 dist-test-slave-gkw7 krb5kdc[9506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436165, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:16:05.774127 9856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.767085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:37681 (local address 127.0.0.1:57964)
0811 08:16:05.767793 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:05.767801 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:05.767857 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:05.767994 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:05.767994 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:05.768117 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:05.768169 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:05.768171 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.768799 (+ 628us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.768800 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:05.769490 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:05.769492 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.769960 (+ 468us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.769961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:05.770022 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:05.770467 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:05.770472 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:05.771588 (+ 1116us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:05.773000 (+ 1412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:05.773001 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:05.773001 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:05.773245 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:05.773444 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:05.773445 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:05.773445 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:05.773516 (+ 71us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:05.773785 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:05.773787 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:05.773846 (+ 59us) client_negotiation.cc:769] Sending connection context
0811 08:16:05.773941 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 08:16:05.774035 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":687}
I20260811 08:16:05.774149 9753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.767128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57964 (local address 127.20.158.189:37681)
0811 08:16:05.767184 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:05.767187 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:05.767852 (+ 665us) server_negotiation.cc:407] Connection header received
0811 08:16:05.767919 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:05.767920 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:05.767931 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:05.767982 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:05.768249 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.768717 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.769606 (+ 889us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.769870 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.769961 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:05.771685 (+ 1724us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:05.771687 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:05.771688 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:05.771695 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:05.772904 (+ 1209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.773320 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.773321 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.773321 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.773371 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.773603 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.773604 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.773604 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.773717 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:05.773768 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:05.773987 (+ 219us) server_negotiation.cc:299] Negotiation successful
0811 08:16:05.774066 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:16:05.774897 9854 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:16:05.777163 9641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.769720 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50478 (local address 127.20.158.190:37041)
0811 08:16:05.769764 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:05.769766 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:05.769774 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:16:05.769830 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:05.769831 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:05.769841 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:05.769895 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:05.770335 (+ 440us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.770786 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.771463 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.771673 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.771748 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:05.774173 (+ 2425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:05.774175 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:05.774175 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:05.774182 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:05.775998 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.776355 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.776356 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.776357 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.776409 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.776619 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.776620 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.776620 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.776761 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:05.776964 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:05.777001 (+ 37us) server_negotiation.cc:299] Negotiation successful
0811 08:16:05.777074 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
Aug 11 08:16:05 dist-test-slave-gkw7 krb5kdc[9506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436165, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.188@KRBTEST.COM for kudu/127.20.158.188@KRBTEST.COM
I20260811 08:16:05.782048 9858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.775212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47458 (local address 127.20.158.188:38767)
0811 08:16:05.775244 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:05.775247 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:05.775285 (+ 38us) server_negotiation.cc:407] Connection header received
0811 08:16:05.775357 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:05.775358 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:05.775370 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:05.775439 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:05.775639 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.776405 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.777285 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.777606 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.777683 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:05.779383 (+ 1700us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:05.779384 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:05.779384 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:05.779391 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:05.780838 (+ 1447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.781191 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.781192 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.781192 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.781239 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.781454 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.781454 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.781454 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.781608 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:05.781673 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:05.781858 (+ 185us) server_negotiation.cc:299] Negotiation successful
0811 08:16:05.781980 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":62,"server-negotiator.queue_time_us":15}
I20260811 08:16:05.782109 9856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.775179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:38767 (local address 127.0.0.1:47458)
0811 08:16:05.775245 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:05.775255 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:05.775297 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:05.775440 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:05.775441 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:05.775545 (+ 104us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:05.775572 (+ 27us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:05.775573 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.776487 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.776488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:05.777195 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:05.777198 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.777676 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.777677 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:05.777721 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:05.778109 (+ 388us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:05.778115 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:05.779307 (+ 1192us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:05.780899 (+ 1592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:05.780900 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:05.780900 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:05.781111 (+ 211us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:05.781314 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:05.781315 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:05.781315 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:05.781387 (+ 72us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:05.781687 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:05.781687 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:05.781739 (+ 52us) client_negotiation.cc:769] Sending connection context
0811 08:16:05.781842 (+ 103us) client_negotiation.cc:240] Negotiation successful
0811 08:16:05.781939 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52,"mutex_wait_us":1}
Aug 11 08:16:05 dist-test-slave-gkw7 krb5kdc[9506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436165, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.189@KRBTEST.COM
I20260811 08:16:05.784088 9854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886: Bootstrap starting.
I20260811 08:16:05.785259 9854 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886: Neither blocks nor log segments found. Creating new log.
I20260811 08:16:05.785631 9854 log.cc:824] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886: Log is configured to *not* fsync() on all Append() calls
I20260811 08:16:05.785658 9753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.778268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57970 (local address 127.20.158.189:37681)
0811 08:16:05.778310 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:05.778312 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:05.778357 (+ 45us) server_negotiation.cc:407] Connection header received
0811 08:16:05.778416 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:05.778417 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:05.778426 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:05.778481 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:05.778899 (+ 418us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.779471 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.780086 (+ 615us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.780376 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.780451 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:05.782963 (+ 2512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:05.782965 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:05.782965 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:05.782973 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:05.784484 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.784805 (+ 321us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.784807 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.784808 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.784873 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.785054 (+ 181us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.785055 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.785055 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.785199 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:05.785390 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:05.785439 (+ 49us) server_negotiation.cc:299] Negotiation successful
0811 08:16:05.785514 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:16:05.786432 9854 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886: No bootstrap required, opened a new log
I20260811 08:16:05.787333 21114 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:16:05.788066 9854 raft_consensus.cc:348] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b01fbb312c44112a503097c52bdb144" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37041 } } peers { permanent_uuid: "9b5e3b5eff404623b668403ac42e18bf" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37681 } } peers { permanent_uuid: "b5e73c806f4b484787fca7c409b30886" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } }
I20260811 08:16:05.788272 9854 raft_consensus.cc:374] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:16:05.788329 9854 raft_consensus.cc:729] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5e73c806f4b484787fca7c409b30886, State: Initialized, Role: FOLLOWER
I20260811 08:16:05.788453 9854 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b01fbb312c44112a503097c52bdb144" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37041 } } peers { permanent_uuid: "9b5e3b5eff404623b668403ac42e18bf" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37681 } } peers { permanent_uuid: "b5e73c806f4b484787fca7c409b30886" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } }
I20260811 08:16:05.788883 9868 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b01fbb312c44112a503097c52bdb144" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37041 } } peers { permanent_uuid: "9b5e3b5eff404623b668403ac42e18bf" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37681 } } peers { permanent_uuid: "b5e73c806f4b484787fca7c409b30886" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } } }
I20260811 08:16:05.788954 9854 sys_catalog.cc:564] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:16:05.788981 9868 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 08:16:05.791025 9887 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:16:05.791109 9887 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:16:05.791442 9756 master_runner.cc:186] Error getting master registration for 127.20.158.190:37041: OK, instance_id { permanent_uuid: "3b01fbb312c44112a503097c52bdb144" instance_seqno: 1786436165403129 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 08:16:05.794778 9756 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 08:16:05.796907 9641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.788693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50490 (local address 127.20.158.190:37041)
0811 08:16:05.788738 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:05.788740 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:05.788897 (+ 157us) server_negotiation.cc:407] Connection header received
0811 08:16:05.788933 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:05.788934 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:05.788944 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:05.789005 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:05.789836 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.790576 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.791848 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.792124 (+ 276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.792165 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:05.793906 (+ 1741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:05.793908 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:05.793908 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:05.793915 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:05.795480 (+ 1565us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.795961 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.795962 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.795963 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.796061 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.796298 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.796299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.796299 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.796428 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:05.796503 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:05.796731 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 08:16:05.796812 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:16:05.797459 9753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.788711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57982 (local address 127.20.158.189:37681)
0811 08:16:05.788752 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:05.788754 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:05.789154 (+ 400us) server_negotiation.cc:407] Connection header received
0811 08:16:05.789215 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:05.789216 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:05.789226 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:05.789270 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:05.789988 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.790675 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.791642 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.791915 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.791976 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:05.793897 (+ 1921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:05.793899 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:05.793899 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:05.793906 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:05.796049 (+ 2143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.796479 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.796480 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.796481 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.796539 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.796752 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.796753 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.796753 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.796884 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:05.796967 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:05.797279 (+ 312us) server_negotiation.cc:299] Negotiation successful
0811 08:16:05.797356 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:16:05.802331 9858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.790689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47468 (local address 127.20.158.188:38767)
0811 08:16:05.790730 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:05.790732 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:05.791765 (+ 1033us) server_negotiation.cc:407] Connection header received
0811 08:16:05.794916 (+ 3151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:05.794917 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:05.794930 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:05.794983 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:05.796253 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.796936 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.797972 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.798274 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.798365 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:05.799584 (+ 1219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:05.799586 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:05.799586 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:05.799595 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:05.801006 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.801406 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.801408 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.801408 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.801471 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.801697 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.801698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.801698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.801862 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:05.801967 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:05.802132 (+ 165us) server_negotiation.cc:299] Negotiation successful
0811 08:16:05.802217 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:16:05.815757 9868 raft_consensus.cc:482] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:16:05.815896 9868 raft_consensus.cc:504] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b01fbb312c44112a503097c52bdb144" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37041 } } peers { permanent_uuid: "9b5e3b5eff404623b668403ac42e18bf" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37681 } } peers { permanent_uuid: "b5e73c806f4b484787fca7c409b30886" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } }
I20260811 08:16:05.816180 9868 leader_election.cc:288] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b01fbb312c44112a503097c52bdb144 (127.20.158.190:37041), 9b5e3b5eff404623b668403ac42e18bf (127.20.158.189:37681)
I20260811 08:16:05.822789 9744 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } attempt: 3
Aug 11 08:16:05 dist-test-slave-gkw7 krb5kdc[9506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436165, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.189@KRBTEST.COM for kudu/127.20.158.188@KRBTEST.COM
I20260811 08:16:05.833564 9750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.823204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:38767 (local address 127.0.0.1:47480)
0811 08:16:05.823574 (+ 370us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:05.823589 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:05.823646 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:05.825438 (+ 1792us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:05.825440 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:05.825674 (+ 234us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:05.825731 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:05.825734 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.826684 (+ 950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.826685 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:05.827523 (+ 838us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:05.827525 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.827967 (+ 442us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.827968 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:05.828031 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:05.828539 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:05.828544 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:05.830167 (+ 1623us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:05.832354 (+ 2187us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:05.832355 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:05.832356 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:05.832590 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:05.832833 (+ 243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:05.832834 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:05.832835 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:05.832900 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:05.833182 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:05.833183 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:05.833228 (+ 45us) client_negotiation.cc:769] Sending connection context
0811 08:16:05.833325 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 08:16:05.833436 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208}
I20260811 08:16:05.833570 9858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.823286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47480 (local address 127.20.158.188:38767)
0811 08:16:05.823728 (+ 442us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:05.823730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:05.823738 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:16:05.823763 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:05.823764 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:05.823774 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:05.825398 (+ 1624us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:05.825820 (+ 422us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.826590 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.827598 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.827891 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.827954 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:05.830249 (+ 2295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:05.830251 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:05.830251 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:05.830258 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:05.832273 (+ 2015us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.832652 (+ 379us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.832654 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.832654 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.832716 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.832953 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.832970 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.832970 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.833111 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:05.833181 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:05.833371 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 08:16:05.833444 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416}
I20260811 08:16:05.835520 9744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b5e3b5eff404623b668403ac42e18bf: Bootstrap starting.
I20260811 08:16:05.836337 9744 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9b5e3b5eff404623b668403ac42e18bf: Neither blocks nor log segments found. Creating new log.
I20260811 08:16:05.836679 9744 log.cc:824] T 00000000000000000000000000000000 P 9b5e3b5eff404623b668403ac42e18bf: Log is configured to *not* fsync() on all Append() calls
I20260811 08:16:05.837661 9744 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9b5e3b5eff404623b668403ac42e18bf: No bootstrap required, opened a new log
I20260811 08:16:05.839883 9744 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9b5e3b5eff404623b668403ac42e18bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b01fbb312c44112a503097c52bdb144" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37041 } } peers { permanent_uuid: "9b5e3b5eff404623b668403ac42e18bf" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37681 } } peers { permanent_uuid: "b5e73c806f4b484787fca7c409b30886" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } }
I20260811 08:16:05.840054 9744 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9b5e3b5eff404623b668403ac42e18bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:16:05.840095 9744 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9b5e3b5eff404623b668403ac42e18bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9b5e3b5eff404623b668403ac42e18bf, State: Initialized, Role: FOLLOWER
I20260811 08:16:05.840251 9744 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9b5e3b5eff404623b668403ac42e18bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b01fbb312c44112a503097c52bdb144" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37041 } } peers { permanent_uuid: "9b5e3b5eff404623b668403ac42e18bf" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37681 } } peers { permanent_uuid: "b5e73c806f4b484787fca7c409b30886" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } }
I20260811 08:16:05.840649 9744 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9b5e3b5eff404623b668403ac42e18bf [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:16:05.840605 9892 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b5e3b5eff404623b668403ac42e18bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b01fbb312c44112a503097c52bdb144" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37041 } } peers { permanent_uuid: "9b5e3b5eff404623b668403ac42e18bf" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37681 } } peers { permanent_uuid: "b5e73c806f4b484787fca7c409b30886" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } } }
I20260811 08:16:05.840713 9892 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b5e3b5eff404623b668403ac42e18bf [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:16:05.840936 9704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e73c806f4b484787fca7c409b30886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b5e3b5eff404623b668403ac42e18bf" is_pre_election: true
I20260811 08:16:05.841076 9704 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9b5e3b5eff404623b668403ac42e18bf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5e73c806f4b484787fca7c409b30886 in term 0.
I20260811 08:16:05.841387 9782 leader_election.cc:302] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b5e3b5eff404623b668403ac42e18bf, b5e73c806f4b484787fca7c409b30886; no voters:
I20260811 08:16:05.841591 9868 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:16:05.841650 9868 raft_consensus.cc:482] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:16:05.841670 9868 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:16:05.842610 9868 raft_consensus.cc:504] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b01fbb312c44112a503097c52bdb144" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37041 } } peers { permanent_uuid: "9b5e3b5eff404623b668403ac42e18bf" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37681 } } peers { permanent_uuid: "b5e73c806f4b484787fca7c409b30886" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } }
I20260811 08:16:05.842759 9868 leader_election.cc:288] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [CANDIDATE]: Term 1 election: Requested vote from peers 3b01fbb312c44112a503097c52bdb144 (127.20.158.190:37041), 9b5e3b5eff404623b668403ac42e18bf (127.20.158.189:37681)
W20260811 08:16:05.843225 9905 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 9b5e3b5eff404623b668403ac42e18bf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:16:05.843277 9905 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:16:05.846946 9635 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } attempt: 3
I20260811 08:16:05.844230 9648 master_runner.cc:186] Error getting master registration for 127.20.158.190:37041: OK, instance_id { permanent_uuid: "3b01fbb312c44112a503097c52bdb144" instance_seqno: 1786436165403129 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 08:16:05.847139 9648 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 08:16:05.847285 9704 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e73c806f4b484787fca7c409b30886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9b5e3b5eff404623b668403ac42e18bf"
I20260811 08:16:05.847349 9704 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9b5e3b5eff404623b668403ac42e18bf [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:16:05.848254 9704 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 9b5e3b5eff404623b668403ac42e18bf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e73c806f4b484787fca7c409b30886 in term 1.
I20260811 08:16:05.848486 9782 leader_election.cc:302] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9b5e3b5eff404623b668403ac42e18bf, b5e73c806f4b484787fca7c409b30886; no voters:
I20260811 08:16:05.848605 9868 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:16:05.848802 9868 raft_consensus.cc:686] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [term 1 LEADER]: Becoming Leader. State: Replica: b5e73c806f4b484787fca7c409b30886, State: Running, Role: LEADER
I20260811 08:16:05.848903 9868 consensus_queue.cc:237] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b01fbb312c44112a503097c52bdb144" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37041 } } peers { permanent_uuid: "9b5e3b5eff404623b668403ac42e18bf" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37681 } } peers { permanent_uuid: "b5e73c806f4b484787fca7c409b30886" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } }
I20260811 08:16:05.849449 9908 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5e73c806f4b484787fca7c409b30886. Latest consensus state: current_term: 1 leader_uuid: "b5e73c806f4b484787fca7c409b30886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b01fbb312c44112a503097c52bdb144" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37041 } } peers { permanent_uuid: "9b5e3b5eff404623b668403ac42e18bf" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37681 } } peers { permanent_uuid: "b5e73c806f4b484787fca7c409b30886" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } } }
I20260811 08:16:05.849566 9908 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [sys.catalog]: This master's current role is: LEADER
Aug 11 08:16:05 dist-test-slave-gkw7 krb5kdc[9506](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436165, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for kudu/127.20.158.188@KRBTEST.COM
I20260811 08:16:05.855790 9639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.847213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:38767 (local address 127.0.0.1:47494)
0811 08:16:05.847309 (+ 96us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:05.847322 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:05.847365 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:05.847542 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:05.847543 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:05.847774 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:05.847823 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:05.847826 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.848664 (+ 838us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.848665 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:05.849454 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:05.849457 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.850140 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.850141 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:05.850207 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:05.850715 (+ 508us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:05.850721 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:05.852372 (+ 1651us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:05.854617 (+ 2245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:05.854618 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:05.854619 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:05.854842 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:05.855038 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:05.855039 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:05.855039 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:05.855094 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:05.855372 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:05.855373 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:05.855417 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 08:16:05.855582 (+ 165us) client_negotiation.cc:240] Negotiation successful
0811 08:16:05.855689 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73}
I20260811 08:16:05.856128 9858 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:05.847312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47494 (local address 127.20.158.188:38767)
0811 08:16:05.847354 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:05.847357 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:05.847365 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:16:05.847442 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:05.847443 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:05.847452 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:05.847499 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:05.847898 (+ 399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.848476 (+ 578us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.849585 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:05.849889 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:05.849952 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:05.852471 (+ 2519us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:05.852472 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:05.852473 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:05.852480 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:05.854525 (+ 2045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.854917 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.854918 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.854918 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.854973 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:05.855157 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:05.855158 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:05.855158 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:05.855292 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:05.855347 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:05.855970 (+ 623us) server_negotiation.cc:299] Negotiation successful
0811 08:16:05.856044 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:16:05.858080 9635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b01fbb312c44112a503097c52bdb144: Bootstrap starting.
I20260811 08:16:05.858841 9635 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b01fbb312c44112a503097c52bdb144: Neither blocks nor log segments found. Creating new log.
I20260811 08:16:05.859138 9635 log.cc:824] T 00000000000000000000000000000000 P 3b01fbb312c44112a503097c52bdb144: Log is configured to *not* fsync() on all Append() calls
I20260811 08:16:05.859815 9911 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:16:05.860029 9911 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:16:05.860286 9635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b01fbb312c44112a503097c52bdb144: No bootstrap required, opened a new log
I20260811 08:16:05.862485 9704 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 9b5e3b5eff404623b668403ac42e18bf [term 1 FOLLOWER]: Refusing update from remote peer b5e73c806f4b484787fca7c409b30886: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:16:05.862870 9908 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9b5e3b5eff404623b668403ac42e18bf" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:16:05.863838 9635 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b01fbb312c44112a503097c52bdb144 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b01fbb312c44112a503097c52bdb144" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37041 } } peers { permanent_uuid: "9b5e3b5eff404623b668403ac42e18bf" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37681 } } peers { permanent_uuid: "b5e73c806f4b484787fca7c409b30886" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } }
I20260811 08:16:05.864038 9635 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3b01fbb312c44112a503097c52bdb144 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:16:05.864102 9635 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b01fbb312c44112a503097c52bdb144 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b01fbb312c44112a503097c52bdb144, State: Initialized, Role: FOLLOWER
I20260811 08:16:05.864223 9892 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b5e3b5eff404623b668403ac42e18bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5e73c806f4b484787fca7c409b30886. Latest consensus state: current_term: 1 leader_uuid: "b5e73c806f4b484787fca7c409b30886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b01fbb312c44112a503097c52bdb144" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37041 } } peers { permanent_uuid: "9b5e3b5eff404623b668403ac42e18bf" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37681 } } peers { permanent_uuid: "b5e73c806f4b484787fca7c409b30886" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } } }
I20260811 08:16:05.864337 9892 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b5e3b5eff404623b668403ac42e18bf [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:16:05.864481 9635 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b01fbb312c44112a503097c52bdb144 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b01fbb312c44112a503097c52bdb144" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37041 } } peers { permanent_uuid: "9b5e3b5eff404623b668403ac42e18bf" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37681 } } peers { permanent_uuid: "b5e73c806f4b484787fca7c409b30886" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } }
I20260811 08:16:05.864835 9635 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b01fbb312c44112a503097c52bdb144 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:16:05.864876 9595 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e73c806f4b484787fca7c409b30886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b01fbb312c44112a503097c52bdb144" is_pre_election: true
I20260811 08:16:05.865003 9595 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3b01fbb312c44112a503097c52bdb144 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b5e73c806f4b484787fca7c409b30886 in term 0.
I20260811 08:16:05.865244 9593 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b5e73c806f4b484787fca7c409b30886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b01fbb312c44112a503097c52bdb144"
I20260811 08:16:05.865310 9593 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b01fbb312c44112a503097c52bdb144 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:16:05.866392 9593 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3b01fbb312c44112a503097c52bdb144 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b5e73c806f4b484787fca7c409b30886 in term 1.
I20260811 08:16:05.866746 9592 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3b01fbb312c44112a503097c52bdb144 [term 1 FOLLOWER]: Refusing update from remote peer b5e73c806f4b484787fca7c409b30886: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:16:05.868548 9908 consensus_queue.cc:1035] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b01fbb312c44112a503097c52bdb144" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37041 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:16:05.870453 9908 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b5e73c806f4b484787fca7c409b30886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b01fbb312c44112a503097c52bdb144" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37041 } } peers { permanent_uuid: "9b5e3b5eff404623b668403ac42e18bf" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37681 } } peers { permanent_uuid: "b5e73c806f4b484787fca7c409b30886" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } } }
I20260811 08:16:05.870435 9918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b01fbb312c44112a503097c52bdb144 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b5e73c806f4b484787fca7c409b30886. Latest consensus state: current_term: 1 leader_uuid: "b5e73c806f4b484787fca7c409b30886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b01fbb312c44112a503097c52bdb144" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37041 } } peers { permanent_uuid: "9b5e3b5eff404623b668403ac42e18bf" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37681 } } peers { permanent_uuid: "b5e73c806f4b484787fca7c409b30886" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } } }
I20260811 08:16:05.870527 9908 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [sys.catalog]: This master's current role is: LEADER
I20260811 08:16:05.870532 9918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b01fbb312c44112a503097c52bdb144 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:16:05.871052 9892 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9b5e3b5eff404623b668403ac42e18bf [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b5e73c806f4b484787fca7c409b30886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b01fbb312c44112a503097c52bdb144" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37041 } } peers { permanent_uuid: "9b5e3b5eff404623b668403ac42e18bf" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37681 } } peers { permanent_uuid: "b5e73c806f4b484787fca7c409b30886" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } } }
I20260811 08:16:05.871145 9892 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9b5e3b5eff404623b668403ac42e18bf [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:16:05.871150 9913 mvcc.cc:205] Tried to move back new op lower bound from 7317242535370227712 to 7317242535317774336. Current Snapshot: MvccSnapshot[applied={T|T < 7317242535370227712}]
I20260811 08:16:05.871330 9936 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b01fbb312c44112a503097c52bdb144 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b5e73c806f4b484787fca7c409b30886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b01fbb312c44112a503097c52bdb144" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37041 } } peers { permanent_uuid: "9b5e3b5eff404623b668403ac42e18bf" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37681 } } peers { permanent_uuid: "b5e73c806f4b484787fca7c409b30886" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } } }
I20260811 08:16:05.871407 9936 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b01fbb312c44112a503097c52bdb144 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:16:05.873685 9914 mvcc.cc:205] Tried to move back new op lower bound from 7317242535370227712 to 7317242535317774336. Current Snapshot: MvccSnapshot[applied={T|T < 7317242535370227712}]
I20260811 08:16:05.874373 9911 catalog_manager.cc:1347] Generated new cluster ID: 1ced1df14a054c04bbfb50850b0c64f3
I20260811 08:16:05.874428 9911 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:16:05.883354 9868 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "b5e73c806f4b484787fca7c409b30886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b01fbb312c44112a503097c52bdb144" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37041 } } peers { permanent_uuid: "9b5e3b5eff404623b668403ac42e18bf" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37681 } } peers { permanent_uuid: "b5e73c806f4b484787fca7c409b30886" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } } }
I20260811 08:16:05.883507 9868 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886 [sys.catalog]: This master's current role is: LEADER
I20260811 08:16:05.885349 9936 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b01fbb312c44112a503097c52bdb144 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "b5e73c806f4b484787fca7c409b30886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b01fbb312c44112a503097c52bdb144" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37041 } } peers { permanent_uuid: "9b5e3b5eff404623b668403ac42e18bf" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 37681 } } peers { permanent_uuid: "b5e73c806f4b484787fca7c409b30886" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 38767 } } }
I20260811 08:16:05.885445 9936 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b01fbb312c44112a503097c52bdb144 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:16:05.885622 9938 mvcc.cc:205] Tried to move back new op lower bound from 7317242535370227712 to 7317242535317774336. Current Snapshot: MvccSnapshot[applied={T|T < 7317242535370227712}]
W20260811 08:16:05.886368 9935 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3b01fbb312c44112a503097c52bdb144: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:16:05.886493 9935 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:16:05.888749 9911 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:16:05.889554 9911 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:16:05.897698 9911 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b5e73c806f4b484787fca7c409b30886: Generated new TSK 0
I20260811 08:16:05.897917 9911 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:16:06.843751 9905 catalog_manager.cc:1259] Loaded cluster ID: 1ced1df14a054c04bbfb50850b0c64f3
I20260811 08:16:06.843863 9905 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 9b5e3b5eff404623b668403ac42e18bf: loading cluster ID for follower catalog manager: success
I20260811 08:16:06.844735 9905 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 9b5e3b5eff404623b668403ac42e18bf: acquiring CA information for follower catalog manager: success
I20260811 08:16:06.845049 9905 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 9b5e3b5eff404623b668403ac42e18bf: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 08:16:06.887064 9935 catalog_manager.cc:1259] Loaded cluster ID: 1ced1df14a054c04bbfb50850b0c64f3
I20260811 08:16:06.887181 9935 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3b01fbb312c44112a503097c52bdb144: loading cluster ID for follower catalog manager: success
I20260811 08:16:06.888195 9935 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3b01fbb312c44112a503097c52bdb144: acquiring CA information for follower catalog manager: success
I20260811 08:16:06.888520 9935 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3b01fbb312c44112a503097c52bdb144: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 08:16:06.956238 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 9527
I20260811 08:16:06.969905 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 9648
I20260811 08:16:06.982852 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 9756
2026-08-11T08:16:06Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (3119 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:16:07 dist-test-slave-gkw7 krb5kdc[9958](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:16:07 dist-test-slave-gkw7 krb5kdc[9958](info): set up 2 sockets
Aug 11 08:16:07 dist-test-slave-gkw7 krb5kdc[9958](info): commencing operation
krb5kdc: starting...
W20260811 08:16:08.298445 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.286s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:16:08 dist-test-slave-gkw7 krb5kdc[9958](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436168, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:16:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:16:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:16:08.428119 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:41177
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:35385
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:41177
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:16:08.513123 9979 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:08.513376 9979 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:08.513415 9979 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:08.514564 9979 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:16:08.514638 9979 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:08.514663 9979 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:08.514693 9979 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:16:08.514724 9979 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:16:08.516228 9979 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:35385
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:41177
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:41177
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9979
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:08.516520 9979 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:08.516760 9979 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:08.522151 9993 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:08.522100 9989 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:08.522169 9979 server_base.cc:1034] running on GCE node
W20260811 08:16:08.522130 9990 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:08.522686 9979 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:08.523046 9979 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:08.524215 9979 hybrid_clock.cc:648] HybridClock initialized: now 1786436168524162 us; error 88 us; skew 500 ppm
Aug 11 08:16:08 dist-test-slave-gkw7 krb5kdc[9958](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436168, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:08.526906 9979 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:16:08.527379 9979 webserver.cc:460] Webserver started at http://127.20.158.190:44085/ using document root <none> and password file <none>
I20260811 08:16:08.527626 9979 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:08.527697 9979 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:16:08.527848 9979 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:16:08.528949 9979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "3f2df1de9e2b48088e4e1d09365be7ba"
format_stamp: "Formatted at 2026-08-11 08:16:08 on dist-test-slave-gkw7"
server_key: "45b4e893479dffa56b20007237dc8d49"
server_key_iv: "58a0f923f5b62df0170179c4bf487f37"
server_key_version: "encryptionkey@0"
I20260811 08:16:08.529322 9979 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "3f2df1de9e2b48088e4e1d09365be7ba"
format_stamp: "Formatted at 2026-08-11 08:16:08 on dist-test-slave-gkw7"
server_key: "45b4e893479dffa56b20007237dc8d49"
server_key_iv: "58a0f923f5b62df0170179c4bf487f37"
server_key_version: "encryptionkey@0"
I20260811 08:16:08.530737 9979 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:16:08.531461 10001 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:08.531634 9979 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:16:08.531744 9979 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "3f2df1de9e2b48088e4e1d09365be7ba"
format_stamp: "Formatted at 2026-08-11 08:16:08 on dist-test-slave-gkw7"
server_key: "45b4e893479dffa56b20007237dc8d49"
server_key_iv: "58a0f923f5b62df0170179c4bf487f37"
server_key_version: "encryptionkey@0"
I20260811 08:16:08.531821 9979 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:08.547379 9979 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:08.549332 9979 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:08.549502 9979 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:08.554292 9979 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:41177
I20260811 08:16:08.554330 10075 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:41177 every 8 connection(s)
I20260811 08:16:08.554705 9979 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:16:08.555689 10076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:16:08.558135 10076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f2df1de9e2b48088e4e1d09365be7ba: Bootstrap starting.
I20260811 08:16:08.558759 10076 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f2df1de9e2b48088e4e1d09365be7ba: Neither blocks nor log segments found. Creating new log.
I20260811 08:16:08.559090 10076 log.cc:824] T 00000000000000000000000000000000 P 3f2df1de9e2b48088e4e1d09365be7ba: Log is configured to *not* fsync() on all Append() calls
I20260811 08:16:08.559892 10076 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f2df1de9e2b48088e4e1d09365be7ba: No bootstrap required, opened a new log
I20260811 08:16:08.561662 10076 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3f2df1de9e2b48088e4e1d09365be7ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f2df1de9e2b48088e4e1d09365be7ba" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 41177 } }
I20260811 08:16:08.561836 10076 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3f2df1de9e2b48088e4e1d09365be7ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:16:08.561862 10076 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3f2df1de9e2b48088e4e1d09365be7ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f2df1de9e2b48088e4e1d09365be7ba, State: Initialized, Role: FOLLOWER
I20260811 08:16:08.562070 10076 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f2df1de9e2b48088e4e1d09365be7ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f2df1de9e2b48088e4e1d09365be7ba" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 41177 } }
I20260811 08:16:08.562166 10076 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3f2df1de9e2b48088e4e1d09365be7ba [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:16:08.562219 10076 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3f2df1de9e2b48088e4e1d09365be7ba [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:16:08.562276 10076 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3f2df1de9e2b48088e4e1d09365be7ba [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:16:08.562906 10076 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3f2df1de9e2b48088e4e1d09365be7ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f2df1de9e2b48088e4e1d09365be7ba" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 41177 } }
I20260811 08:16:08.563027 10076 leader_election.cc:302] T 00000000000000000000000000000000 P 3f2df1de9e2b48088e4e1d09365be7ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f2df1de9e2b48088e4e1d09365be7ba; no voters:
I20260811 08:16:08.563239 10076 leader_election.cc:288] T 00000000000000000000000000000000 P 3f2df1de9e2b48088e4e1d09365be7ba [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:16:08.563306 10082 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3f2df1de9e2b48088e4e1d09365be7ba [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:16:08.563469 10082 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3f2df1de9e2b48088e4e1d09365be7ba [term 1 LEADER]: Becoming Leader. State: Replica: 3f2df1de9e2b48088e4e1d09365be7ba, State: Running, Role: LEADER
I20260811 08:16:08.563521 10076 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3f2df1de9e2b48088e4e1d09365be7ba [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:16:08.563639 10082 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f2df1de9e2b48088e4e1d09365be7ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f2df1de9e2b48088e4e1d09365be7ba" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 41177 } }
I20260811 08:16:08.564200 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 9979
I20260811 08:16:08.564239 10083 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f2df1de9e2b48088e4e1d09365be7ba [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f2df1de9e2b48088e4e1d09365be7ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f2df1de9e2b48088e4e1d09365be7ba" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 41177 } } }
I20260811 08:16:08.564323 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:16:08.564323 10083 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f2df1de9e2b48088e4e1d09365be7ba [sys.catalog]: This master's current role is: LEADER
I20260811 08:16:08.564553 21114 external_mini_cluster.cc:1428] Setting key 6f9ec2b96db7d58f410a2a581df6a763
I20260811 08:16:08.564714 10084 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f2df1de9e2b48088e4e1d09365be7ba [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f2df1de9e2b48088e4e1d09365be7ba. Latest consensus state: current_term: 1 leader_uuid: "3f2df1de9e2b48088e4e1d09365be7ba" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f2df1de9e2b48088e4e1d09365be7ba" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 41177 } } }
I20260811 08:16:08.564935 10084 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f2df1de9e2b48088e4e1d09365be7ba [sys.catalog]: This master's current role is: LEADER
W20260811 08:16:08.565583 10107 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3f2df1de9e2b48088e4e1d09365be7ba: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:16:08.565685 10107 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:16:08.565770 10091 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:16:08.565977 10091 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:16:08.567704 10091 catalog_manager.cc:1347] Generated new cluster ID: 377520833ac24bba81c2f3f7958725c0
I20260811 08:16:08.567761 10091 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:16:08 dist-test-slave-gkw7 krb5kdc[9958](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436168, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:16:08.575314 10110 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:08.565104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34590 (local address 127.20.158.190:41177)
0811 08:16:08.565308 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:08.565320 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:08.565577 (+ 257us) server_negotiation.cc:407] Connection header received
0811 08:16:08.565756 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:08.565765 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:08.565838 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:08.565987 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:08.566818 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:08.568085 (+ 1267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:08.568872 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:08.569303 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:08.569434 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:08.571858 (+ 2424us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:08.571862 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:08.571863 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:08.571875 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:08.573691 (+ 1816us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:08.574081 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:08.574084 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:08.574085 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:08.574193 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:08.574420 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:08.574421 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:08.574422 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:08.574665 (+ 243us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:08.574839 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:08.574950 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 08:16:08.575099 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":87,"threads_started":1}
I20260811 08:16:08.576076 10091 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:16:08.576328 21114 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:16:08.576794 10091 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:16:08.581984 10091 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3f2df1de9e2b48088e4e1d09365be7ba: Generated new TSK 0
I20260811 08:16:08.582177 10091 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:16:08.630431 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 9979
2026-08-11T08:16:08Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1651 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:16:08 dist-test-slave-gkw7 krb5kdc[10118](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:16:08 dist-test-slave-gkw7 krb5kdc[10118](info): set up 2 sockets
Aug 11 08:16:08 dist-test-slave-gkw7 krb5kdc[10118](info): commencing operation
krb5kdc: starting...
W20260811 08:16:09.893885 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.230s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:16:09 dist-test-slave-gkw7 krb5kdc[10118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:16:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:16:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:16:10.024183 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:42151
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:46487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:42151
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:16:10.108547 10138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:10.108796 10138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:10.108835 10138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:10.109997 10138 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:16:10.110070 10138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:10.110095 10138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:10.110123 10138 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:16:10.110163 10138 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:16:10.111647 10138 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:46487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:42151
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:42151
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10138
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:10.111927 10138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:10.112167 10138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:10.117420 10145 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:10.117395 10144 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:10.117398 10147 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:10.117448 10138 server_base.cc:1034] running on GCE node
I20260811 08:16:10.117906 10138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:10.118211 10138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:10.119371 10138 hybrid_clock.cc:648] HybridClock initialized: now 1786436170119356 us; error 32 us; skew 500 ppm
Aug 11 08:16:10 dist-test-slave-gkw7 krb5kdc[10118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436170, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:10.122371 10138 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:16:10.122892 10138 webserver.cc:460] Webserver started at http://127.20.158.190:38949/ using document root <none> and password file <none>
I20260811 08:16:10.123170 10138 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:10.123242 10138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:16:10.123402 10138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:16:10.124601 10138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "b1599434abf6461f8bee1df13434e025"
format_stamp: "Formatted at 2026-08-11 08:16:10 on dist-test-slave-gkw7"
server_key: "c8804c122295879cd63ca4c862eb5123"
server_key_iv: "a886805ccc82c68e347bdef1e6354387"
server_key_version: "encryptionkey@0"
I20260811 08:16:10.124976 10138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "b1599434abf6461f8bee1df13434e025"
format_stamp: "Formatted at 2026-08-11 08:16:10 on dist-test-slave-gkw7"
server_key: "c8804c122295879cd63ca4c862eb5123"
server_key_iv: "a886805ccc82c68e347bdef1e6354387"
server_key_version: "encryptionkey@0"
I20260811 08:16:10.128157 10138 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s
I20260811 08:16:10.129024 10158 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:10.129240 10138 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:10.129341 10138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "b1599434abf6461f8bee1df13434e025"
format_stamp: "Formatted at 2026-08-11 08:16:10 on dist-test-slave-gkw7"
server_key: "c8804c122295879cd63ca4c862eb5123"
server_key_iv: "a886805ccc82c68e347bdef1e6354387"
server_key_version: "encryptionkey@0"
I20260811 08:16:10.129429 10138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:10.143885 10138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:10.146106 10138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:10.146281 10138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:10.150518 10138 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:42151
I20260811 08:16:10.150569 10237 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:42151 every 8 connection(s)
I20260811 08:16:10.150964 10138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:16:10.151983 10238 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:16:10.154354 10238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025: Bootstrap starting.
I20260811 08:16:10.154956 10238 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025: Neither blocks nor log segments found. Creating new log.
I20260811 08:16:10.155267 10238 log.cc:824] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025: Log is configured to *not* fsync() on all Append() calls
I20260811 08:16:10.156003 10238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025: No bootstrap required, opened a new log
I20260811 08:16:10.157814 10238 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1599434abf6461f8bee1df13434e025" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42151 } }
I20260811 08:16:10.157958 10238 raft_consensus.cc:374] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:16:10.157980 10238 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1599434abf6461f8bee1df13434e025, State: Initialized, Role: FOLLOWER
I20260811 08:16:10.158186 10238 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1599434abf6461f8bee1df13434e025" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42151 } }
I20260811 08:16:10.158270 10238 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:16:10.158315 10238 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:16:10.158367 10238 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:16:10.159250 10238 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1599434abf6461f8bee1df13434e025" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42151 } }
I20260811 08:16:10.159369 10238 leader_election.cc:302] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1599434abf6461f8bee1df13434e025; no voters:
I20260811 08:16:10.159561 10238 leader_election.cc:288] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:16:10.159608 10244 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:16:10.159794 10244 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [term 1 LEADER]: Becoming Leader. State: Replica: b1599434abf6461f8bee1df13434e025, State: Running, Role: LEADER
I20260811 08:16:10.159862 10238 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:16:10.159930 10244 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1599434abf6461f8bee1df13434e025" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42151 } }
I20260811 08:16:10.160111 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 10138
I20260811 08:16:10.160287 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:16:10.160521 21114 external_mini_cluster.cc:1428] Setting key e2aa663808bfadb6fc168ee248c17b09
I20260811 08:16:10.160998 10245 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b1599434abf6461f8bee1df13434e025" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1599434abf6461f8bee1df13434e025" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42151 } } }
I20260811 08:16:10.161103 10245 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [sys.catalog]: This master's current role is: LEADER
I20260811 08:16:10.161309 10246 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1599434abf6461f8bee1df13434e025. Latest consensus state: current_term: 1 leader_uuid: "b1599434abf6461f8bee1df13434e025" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1599434abf6461f8bee1df13434e025" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42151 } } }
I20260811 08:16:10.161401 10246 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [sys.catalog]: This master's current role is: LEADER
I20260811 08:16:10.161774 10261 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:16:10.162436 10261 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:16:10.164279 10261 catalog_manager.cc:1347] Generated new cluster ID: 9623006999f947bdaf687f7d6d6935ad
I20260811 08:16:10.164366 10261 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:16:10 dist-test-slave-gkw7 krb5kdc[10118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436169, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:16:10.171693 10259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:10.161050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60772 (local address 127.20.158.190:42151)
0811 08:16:10.161254 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:10.161268 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:10.161726 (+ 458us) server_negotiation.cc:407] Connection header received
0811 08:16:10.161979 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:10.161988 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:10.162054 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:10.162211 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:10.162938 (+ 727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.164203 (+ 1265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.164990 (+ 787us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.165489 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.165693 (+ 204us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:10.168063 (+ 2370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:10.168067 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:10.168068 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:10.168081 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:10.169849 (+ 1768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:10.170366 (+ 517us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:10.170369 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:10.170392 (+ 23us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:10.170515 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:10.170739 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:10.170740 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:10.170741 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:10.171001 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:10.171184 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:10.171259 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 08:16:10.171520 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":91,"threads_started":1}
I20260811 08:16:10.202673 10261 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:16:10.203444 10261 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:16:10.206773 10261 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025: Generated new TSK 0
I20260811 08:16:10.206974 10261 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.158.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
I20260811 08:16:10.236501 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:0
--local_ip_for_outbound_sockets=127.20.158.129
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:42151
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:46487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:16:10.322285 10274 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:10.322537 10274 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:10.322564 10274 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:10.323791 10274 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:10.323839 10274 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:10.323868 10274 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:16:10.325430 10274 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:46487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:42151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10274
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:10.325740 10274 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:10.326007 10274 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:10.331593 10285 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:10.331635 10290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:10.331537 10286 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:10.331782 10274 server_base.cc:1034] running on GCE node
I20260811 08:16:10.332013 10274 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:10.332350 10274 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:10.333604 10274 hybrid_clock.cc:648] HybridClock initialized: now 1786436170333577 us; error 41 us; skew 500 ppm
Aug 11 08:16:10 dist-test-slave-gkw7 krb5kdc[10118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436170, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:10.336234 10274 init.cc:377] Logged in from keytab as kudu/127.20.158.129@KRBTEST.COM (short username kudu)
I20260811 08:16:10.336694 10274 webserver.cc:460] Webserver started at http://127.20.158.129:41763/ using document root <none> and password file <none>
I20260811 08:16:10.336957 10274 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:10.337029 10274 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:16:10.337198 10274 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:16:10.338338 10274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/data/instance:
uuid: "ef5370f6fa8646a7b2a055ced98f57de"
format_stamp: "Formatted at 2026-08-11 08:16:10 on dist-test-slave-gkw7"
server_key: "803227b12d42491b8c0aed601de8c157"
server_key_iv: "08d3d0ebdd7664aee4587f098f96b39d"
server_key_version: "encryptionkey@0"
I20260811 08:16:10.338723 10274 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance:
uuid: "ef5370f6fa8646a7b2a055ced98f57de"
format_stamp: "Formatted at 2026-08-11 08:16:10 on dist-test-slave-gkw7"
server_key: "803227b12d42491b8c0aed601de8c157"
server_key_iv: "08d3d0ebdd7664aee4587f098f96b39d"
server_key_version: "encryptionkey@0"
I20260811 08:16:10.340116 10274 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:16:10.340916 10300 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:10.341112 10274 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:10.341223 10274 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "ef5370f6fa8646a7b2a055ced98f57de"
format_stamp: "Formatted at 2026-08-11 08:16:10 on dist-test-slave-gkw7"
server_key: "803227b12d42491b8c0aed601de8c157"
server_key_iv: "08d3d0ebdd7664aee4587f098f96b39d"
server_key_version: "encryptionkey@0"
I20260811 08:16:10.341301 10274 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:10.359072 10274 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:10.361757 10274 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:10.362154 10274 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:10.362448 10274 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:16:10.362884 10274 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:16:10.362946 10274 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:10.362993 10274 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:16:10.363021 10274 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:10.369010 10274 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:45803
I20260811 08:16:10.369063 10473 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:45803 every 8 connection(s)
I20260811 08:16:10.369386 10274 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:16:10.373176 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 10274
I20260811 08:16:10.373298 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance
I20260811 08:16:10.373499 21114 external_mini_cluster.cc:1428] Setting key aa180d9b07686331a620c74a37c2eb7d
Aug 11 08:16:10 dist-test-slave-gkw7 krb5kdc[10118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436170, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.158.130@KRBTEST.COM; defaulting to no policy
I20260811 08:16:10.384021 10259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:10.370166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:56857 (local address 127.20.158.190:42151)
0811 08:16:10.370252 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:10.370255 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:10.370442 (+ 187us) server_negotiation.cc:407] Connection header received
0811 08:16:10.371034 (+ 592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:10.371035 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:10.371045 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:10.371099 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:10.372060 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.372565 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.373939 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.374146 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.374235 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:10.380909 (+ 6674us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:10.380911 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:10.380911 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:10.380920 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:10.382622 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:10.383033 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:10.383035 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:10.383035 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:10.383097 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:10.383390 (+ 293us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:10.383391 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:10.383391 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:10.383549 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:10.383626 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:10.383883 (+ 257us) server_negotiation.cc:299] Negotiation successful
0811 08:16:10.383956 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260811 08:16:10.384228 10476 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:10.370130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.129:56857)
0811 08:16:10.370320 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:10.370358 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:10.370938 (+ 580us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:10.371171 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:10.371175 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:10.371781 (+ 606us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:10.371979 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:10.371984 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.372648 (+ 664us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.372649 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:10.373858 (+ 1209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:10.373861 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.374240 (+ 379us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.374241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:10.374358 (+ 117us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:10.379062 (+ 4704us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:10.379071 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:10.380794 (+ 1723us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:10.382719 (+ 1925us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:10.382726 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:10.382728 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:10.382948 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:10.383174 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:10.383175 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:10.383175 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:10.383292 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:10.383622 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:10.383628 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:10.383757 (+ 129us) client_negotiation.cc:769] Sending connection context
0811 08:16:10.383845 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 08:16:10.383970 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":104,"threads_started":1}
I20260811 08:16:10.384795 10474 heartbeater.cc:347] Connected to a master server at 127.20.158.190:42151
I20260811 08:16:10.384912 10474 heartbeater.cc:464] Registering TS with master...
I20260811 08:16:10.385097 10474 heartbeater.cc:511] Master 127.20.158.190:42151 requested a full tablet report, sending...
I20260811 08:16:10.385805 10189 ts_manager.cc:194] Registered new tserver with Master: ef5370f6fa8646a7b2a055ced98f57de (127.20.158.129:45803)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.130@KRBTEST.COM" created.
I20260811 08:16:10.386504 10189 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.129@KRBTEST.COM'} at 127.20.158.129:56857
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
I20260811 08:16:10.401292 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:0
--local_ip_for_outbound_sockets=127.20.158.130
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:42151
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:46487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:16:10.485895 10481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:10.486157 10481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:10.486207 10481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:10.487361 10481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:10.487442 10481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:10.487486 10481 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:16:10.489082 10481 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:46487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:42151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10481
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:10.489360 10481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:10.489648 10481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:10.494755 10489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:10.494747 10492 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:10.494748 10490 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:10.495036 10481 server_base.cc:1034] running on GCE node
I20260811 08:16:10.495245 10481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:10.495451 10481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:10.496591 10481 hybrid_clock.cc:648] HybridClock initialized: now 1786436170496582 us; error 33 us; skew 500 ppm
Aug 11 08:16:10 dist-test-slave-gkw7 krb5kdc[10118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436170, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:10.499130 10481 init.cc:377] Logged in from keytab as kudu/127.20.158.130@KRBTEST.COM (short username kudu)
I20260811 08:16:10.499645 10481 webserver.cc:460] Webserver started at http://127.20.158.130:39699/ using document root <none> and password file <none>
I20260811 08:16:10.499899 10481 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:10.499970 10481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:16:10.500126 10481 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:16:10.501642 10481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/data/instance:
uuid: "472f971d03f34c50ba0baac2c5b876e8"
format_stamp: "Formatted at 2026-08-11 08:16:10 on dist-test-slave-gkw7"
server_key: "a05b7ef1d98acce54b0f750715e244fb"
server_key_iv: "7a46cbcb74bb6b52624467063c20d491"
server_key_version: "encryptionkey@0"
I20260811 08:16:10.502142 10481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance:
uuid: "472f971d03f34c50ba0baac2c5b876e8"
format_stamp: "Formatted at 2026-08-11 08:16:10 on dist-test-slave-gkw7"
server_key: "a05b7ef1d98acce54b0f750715e244fb"
server_key_iv: "7a46cbcb74bb6b52624467063c20d491"
server_key_version: "encryptionkey@0"
I20260811 08:16:10.504168 10481 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260811 08:16:10.505215 10505 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:10.505743 10481 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:10.505878 10481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "472f971d03f34c50ba0baac2c5b876e8"
format_stamp: "Formatted at 2026-08-11 08:16:10 on dist-test-slave-gkw7"
server_key: "a05b7ef1d98acce54b0f750715e244fb"
server_key_iv: "7a46cbcb74bb6b52624467063c20d491"
server_key_version: "encryptionkey@0"
I20260811 08:16:10.505961 10481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:10.518646 10481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:10.520475 10481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:10.520597 10481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:10.520810 10481 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:16:10.521076 10481 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:16:10.521108 10481 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:10.521130 10481 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:16:10.521143 10481 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:10.527650 10481 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:35493
I20260811 08:16:10.527752 10683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:35493 every 8 connection(s)
I20260811 08:16:10.528072 10481 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
Aug 11 08:16:10 dist-test-slave-gkw7 krb5kdc[10118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436170, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:16:10.537431 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 10481
I20260811 08:16:10.537587 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance
I20260811 08:16:10.537822 21114 external_mini_cluster.cc:1428] Setting key 8a7154dbf3a0e6cf61255f2d3fc86ed1
I20260811 08:16:10.538030 10259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:10.528932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:55173 (local address 127.20.158.190:42151)
0811 08:16:10.528979 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:10.528981 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:10.529178 (+ 197us) server_negotiation.cc:407] Connection header received
0811 08:16:10.529744 (+ 566us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:10.529745 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:10.529755 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:10.529817 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:10.530780 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.531271 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.532338 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.532535 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.532594 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:10.535205 (+ 2611us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:10.535206 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:10.535207 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:10.535213 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:10.536463 (+ 1250us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:10.536858 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:10.536858 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:10.536858 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:10.536910 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:10.537272 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:10.537273 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:10.537273 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:10.537377 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:10.537430 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:10.537832 (+ 402us) server_negotiation.cc:299] Negotiation successful
0811 08:16:10.537944 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:16:10.538327 10686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:10.528884 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.130:55173)
0811 08:16:10.529054 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:10.529098 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:10.529652 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:10.529893 (+ 241us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:10.529897 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:10.530491 (+ 594us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:10.530701 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:10.530706 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.531348 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.531349 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:10.532257 (+ 908us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:10.532260 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.532672 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.532676 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:10.532804 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:10.533449 (+ 645us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:10.533459 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:10.535106 (+ 1647us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:10.536541 (+ 1435us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:10.536548 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:10.536550 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:10.536788 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:10.536999 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:10.537000 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:10.537001 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:10.537165 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:10.537447 (+ 282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:10.537455 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:10.537675 (+ 220us) client_negotiation.cc:769] Sending connection context
0811 08:16:10.537814 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 08:16:10.538020 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":95,"threads_started":1}
I20260811 08:16:10.538856 10684 heartbeater.cc:347] Connected to a master server at 127.20.158.190:42151
I20260811 08:16:10.538977 10684 heartbeater.cc:464] Registering TS with master...
I20260811 08:16:10.539196 10684 heartbeater.cc:511] Master 127.20.158.190:42151 requested a full tablet report, sending...
I20260811 08:16:10.539611 10189 ts_manager.cc:194] Registered new tserver with Master: 472f971d03f34c50ba0baac2c5b876e8 (127.20.158.130:35493)
I20260811 08:16:10.540119 10189 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.130@KRBTEST.COM'} at 127.20.158.130:55173
WARNING: no policy specified for kudu/127.20.158.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
I20260811 08:16:10.565296 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:0
--local_ip_for_outbound_sockets=127.20.158.131
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:42151
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:46487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:16:10.649694 10693 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:10.649955 10693 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:10.649997 10693 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:10.651157 10693 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:10.651232 10693 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:10.651281 10693 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:16:10.652779 10693 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:46487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:42151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10693
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:10.653069 10693 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:10.653322 10693 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:10.658661 10705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:10.658667 10702 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:10.658674 10701 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:10.658723 10693 server_base.cc:1034] running on GCE node
I20260811 08:16:10.659124 10693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:10.659384 10693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:10.660561 10693 hybrid_clock.cc:648] HybridClock initialized: now 1786436170660538 us; error 41 us; skew 500 ppm
Aug 11 08:16:10 dist-test-slave-gkw7 krb5kdc[10118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436170, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:10.663465 10693 init.cc:377] Logged in from keytab as kudu/127.20.158.131@KRBTEST.COM (short username kudu)
I20260811 08:16:10.663908 10693 webserver.cc:460] Webserver started at http://127.20.158.131:37811/ using document root <none> and password file <none>
I20260811 08:16:10.664162 10693 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:10.664234 10693 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:16:10.664387 10693 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:16:10.665488 10693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/data/instance:
uuid: "80b4717a476b4299bca7f9ed8cf35063"
format_stamp: "Formatted at 2026-08-11 08:16:10 on dist-test-slave-gkw7"
server_key: "d790e5cd87f3ce4453c552a6b9784c14"
server_key_iv: "37eebd4a37f2b4dacd0475ca832e4227"
server_key_version: "encryptionkey@0"
I20260811 08:16:10.665927 10693 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance:
uuid: "80b4717a476b4299bca7f9ed8cf35063"
format_stamp: "Formatted at 2026-08-11 08:16:10 on dist-test-slave-gkw7"
server_key: "d790e5cd87f3ce4453c552a6b9784c14"
server_key_iv: "37eebd4a37f2b4dacd0475ca832e4227"
server_key_version: "encryptionkey@0"
I20260811 08:16:10.667369 10693 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:10.668128 10714 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:10.668332 10693 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:10.668444 10693 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "80b4717a476b4299bca7f9ed8cf35063"
format_stamp: "Formatted at 2026-08-11 08:16:10 on dist-test-slave-gkw7"
server_key: "d790e5cd87f3ce4453c552a6b9784c14"
server_key_iv: "37eebd4a37f2b4dacd0475ca832e4227"
server_key_version: "encryptionkey@0"
I20260811 08:16:10.668520 10693 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:10.700080 10693 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:10.702442 10693 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:10.702616 10693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:10.702884 10693 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:16:10.703238 10693 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:16:10.703298 10693 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:10.703336 10693 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:16:10.703383 10693 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:10.709484 10693 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:45505
I20260811 08:16:10.709542 10868 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:45505 every 8 connection(s)
I20260811 08:16:10.709924 10693 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
I20260811 08:16:10.711409 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 10693
I20260811 08:16:10.711519 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance
I20260811 08:16:10.711710 21114 external_mini_cluster.cc:1428] Setting key fdbacfe7add9e46e79ef788c9352663e
Aug 11 08:16:10 dist-test-slave-gkw7 krb5kdc[10118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436170, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:16:10.719825 10259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:10.710706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:60877 (local address 127.20.158.190:42151)
0811 08:16:10.710749 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:10.710751 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:10.711025 (+ 274us) server_negotiation.cc:407] Connection header received
0811 08:16:10.711638 (+ 613us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:10.711639 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:10.711654 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:10.711704 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:10.712948 (+ 1244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.713455 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.714516 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.714721 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.714810 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:10.716995 (+ 2185us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:10.716997 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:10.716997 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:10.717005 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:10.718393 (+ 1388us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:10.718816 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:10.718818 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:10.718818 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:10.718881 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:10.719147 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:10.719148 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:10.719148 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:10.719274 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:10.719355 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:10.719637 (+ 282us) server_negotiation.cc:299] Negotiation successful
0811 08:16:10.719725 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 08:16:10.720069 10875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:10.710686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.131:60877)
0811 08:16:10.710854 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:10.710944 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:10.711483 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:10.711775 (+ 292us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:10.711780 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:10.712559 (+ 779us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:10.712841 (+ 282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:10.712847 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.713572 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.713573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:10.714404 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:10.714406 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.714823 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.714824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:10.714955 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:10.715413 (+ 458us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:10.715421 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:10.716897 (+ 1476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:10.718490 (+ 1593us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:10.718497 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:10.718499 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:10.718736 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:10.718954 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:10.718955 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:10.718956 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:10.719067 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:10.719344 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:10.719352 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:10.719498 (+ 146us) client_negotiation.cc:769] Sending connection context
0811 08:16:10.719613 (+ 115us) client_negotiation.cc:240] Negotiation successful
0811 08:16:10.719794 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":77,"threads_started":1}
I20260811 08:16:10.720683 10873 heartbeater.cc:347] Connected to a master server at 127.20.158.190:42151
I20260811 08:16:10.720780 10873 heartbeater.cc:464] Registering TS with master...
I20260811 08:16:10.720943 10873 heartbeater.cc:511] Master 127.20.158.190:42151 requested a full tablet report, sending...
I20260811 08:16:10.721416 10189 ts_manager.cc:194] Registered new tserver with Master: 80b4717a476b4299bca7f9ed8cf35063 (127.20.158.131:45505)
I20260811 08:16:10.721958 10189 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.131@KRBTEST.COM'} at 127.20.158.131:60877
I20260811 08:16:10.723551 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:16:10.731750 10259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:10.724955 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60778 (local address 127.20.158.190:42151)
0811 08:16:10.725022 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:10.725024 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:10.725141 (+ 117us) server_negotiation.cc:407] Connection header received
0811 08:16:10.725230 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:10.725231 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:10.725251 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:10.725332 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:10.726020 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.726531 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.727334 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.727538 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.727634 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:10.728948 (+ 1314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:10.728950 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:10.728950 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:10.728958 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:10.730369 (+ 1411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:10.730789 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:10.730790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:10.730791 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:10.730858 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:10.731108 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:10.731109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:10.731109 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:10.731271 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:10.731387 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:10.731559 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 08:16:10.731650 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 08:16:10.733618 10189 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60778:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:16:10.735177 10189 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:16:10.741894 10891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:10.737907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:45505 (local address 127.0.0.1:44168)
0811 08:16:10.738185 (+ 278us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:10.738194 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:10.738231 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:10.738499 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:10.738500 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:10.738502 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:16:10.738541 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:10.738543 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.739773 (+ 1230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.739774 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:10.740869 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:10.740871 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.741557 (+ 686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.741558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:10.741648 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:10.741663 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 08:16:10.741735 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 08:16:10.741810 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":84,"threads_started":1}
I20260811 08:16:10.742002 10893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:10.737431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:35493 (local address 127.0.0.1:54294)
0811 08:16:10.737620 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:10.737686 (+ 66us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:10.737759 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:10.737975 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:10.737978 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:10.737981 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:16:10.738051 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:10.738053 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.739399 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.739400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:10.740776 (+ 1376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:10.740780 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.741705 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.741706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:10.741781 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:10.741784 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:16:10.741853 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 08:16:10.741887 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"mutex_wait_us":33,"thread_start_us":65,"threads_started":1}
I20260811 08:16:10.742233 10898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:10.738019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44168 (local address 127.20.158.131:45505)
0811 08:16:10.738248 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:10.738253 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:10.738264 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:16:10.738329 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:10.738331 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:10.738349 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:10.738427 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:16:10.738631 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.739671 (+ 1040us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.740962 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.741447 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.741538 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:10.741619 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:10.742136 (+ 517us) server_negotiation.cc:299] Negotiation successful
0811 08:16:10.742175 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":198,"thread_start_us":85,"threads_started":1}
I20260811 08:16:10.743006 10896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:10.737446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:45803 (local address 127.0.0.1:38118)
0811 08:16:10.738042 (+ 596us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:10.738053 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:10.738115 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:10.739560 (+ 1445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:10.739561 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:10.739563 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:16:10.739606 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:10.739607 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.740646 (+ 1039us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.740647 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:10.741781 (+ 1134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:10.741784 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.742771 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.742772 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:10.742838 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:10.742842 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:16:10.742894 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 08:16:10.742937 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":579,"mutex_wait_us":1,"thread_start_us":114,"threads_started":1}
I20260811 08:16:10.743052 10777 tablet_service.cc:1467] Processing CreateTablet for tablet acfdb0eeb7854809886627e7cce208fb (DEFAULT_TABLE table=test-table [id=79da6e5137814a6098257fcae5ca5012]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:16:10.743356 10895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:10.737627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38118 (local address 127.20.158.129:45803)
0811 08:16:10.737805 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:10.737810 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:10.739414 (+ 1604us) server_negotiation.cc:407] Connection header received
0811 08:16:10.739458 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:10.739461 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:10.739476 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:10.739547 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:16:10.739701 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.740532 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.741856 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.742615 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.742681 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:10.742731 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:10.743206 (+ 475us) server_negotiation.cc:299] Negotiation successful
0811 08:16:10.743251 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":104,"threads_started":1}
I20260811 08:16:10.743518 10777 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acfdb0eeb7854809886627e7cce208fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:16:10.743661 10894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:10.737541 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54294 (local address 127.20.158.130:35493)
0811 08:16:10.737747 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:10.737752 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:10.737764 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:16:10.737857 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:10.737859 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:10.737875 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:10.737971 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:16:10.738135 (+ 164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.739296 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.740865 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.741635 (+ 770us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.741709 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:10.741761 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:10.743484 (+ 1723us) server_negotiation.cc:299] Negotiation successful
0811 08:16:10.743527 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":165,"thread_start_us":99,"threads_started":1}
I20260811 08:16:10.744002 10369 tablet_service.cc:1467] Processing CreateTablet for tablet acfdb0eeb7854809886627e7cce208fb (DEFAULT_TABLE table=test-table [id=79da6e5137814a6098257fcae5ca5012]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:16:10.744243 10369 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acfdb0eeb7854809886627e7cce208fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:16:10.746340 10899 tablet_bootstrap.cc:492] T acfdb0eeb7854809886627e7cce208fb P 80b4717a476b4299bca7f9ed8cf35063: Bootstrap starting.
I20260811 08:16:10.746879 10900 tablet_bootstrap.cc:492] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de: Bootstrap starting.
I20260811 08:16:10.747054 10899 tablet_bootstrap.cc:654] T acfdb0eeb7854809886627e7cce208fb P 80b4717a476b4299bca7f9ed8cf35063: Neither blocks nor log segments found. Creating new log.
I20260811 08:16:10.747030 10580 tablet_service.cc:1467] Processing CreateTablet for tablet acfdb0eeb7854809886627e7cce208fb (DEFAULT_TABLE table=test-table [id=79da6e5137814a6098257fcae5ca5012]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:16:10.747298 10580 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acfdb0eeb7854809886627e7cce208fb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:16:10.747607 10900 tablet_bootstrap.cc:654] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de: Neither blocks nor log segments found. Creating new log.
I20260811 08:16:10.747673 10899 log.cc:824] T acfdb0eeb7854809886627e7cce208fb P 80b4717a476b4299bca7f9ed8cf35063: Log is configured to *not* fsync() on all Append() calls
I20260811 08:16:10.748124 10900 log.cc:824] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de: Log is configured to *not* fsync() on all Append() calls
I20260811 08:16:10.748533 10899 tablet_bootstrap.cc:492] T acfdb0eeb7854809886627e7cce208fb P 80b4717a476b4299bca7f9ed8cf35063: No bootstrap required, opened a new log
I20260811 08:16:10.748577 10899 ts_tablet_manager.cc:1397] T acfdb0eeb7854809886627e7cce208fb P 80b4717a476b4299bca7f9ed8cf35063: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:16:10.748936 10900 tablet_bootstrap.cc:492] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de: No bootstrap required, opened a new log
I20260811 08:16:10.748991 10900 ts_tablet_manager.cc:1397] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:16:10.750547 10899 raft_consensus.cc:348] T acfdb0eeb7854809886627e7cce208fb P 80b4717a476b4299bca7f9ed8cf35063 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } }
I20260811 08:16:10.750737 10899 raft_consensus.cc:374] T acfdb0eeb7854809886627e7cce208fb P 80b4717a476b4299bca7f9ed8cf35063 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:16:10.750772 10899 raft_consensus.cc:729] T acfdb0eeb7854809886627e7cce208fb P 80b4717a476b4299bca7f9ed8cf35063 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80b4717a476b4299bca7f9ed8cf35063, State: Initialized, Role: FOLLOWER
I20260811 08:16:10.750898 10899 consensus_queue.cc:260] T acfdb0eeb7854809886627e7cce208fb P 80b4717a476b4299bca7f9ed8cf35063 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } }
I20260811 08:16:10.750937 10900 raft_consensus.cc:348] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } }
I20260811 08:16:10.751088 10900 raft_consensus.cc:374] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:16:10.751137 10900 raft_consensus.cc:729] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5370f6fa8646a7b2a055ced98f57de, State: Initialized, Role: FOLLOWER
I20260811 08:16:10.751222 10899 ts_tablet_manager.cc:1428] T acfdb0eeb7854809886627e7cce208fb P 80b4717a476b4299bca7f9ed8cf35063: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:16:10.751266 10900 consensus_queue.cc:260] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } }
I20260811 08:16:10.751354 10873 heartbeater.cc:503] Master 127.20.158.190:42151 was elected leader, sending a full tablet report...
I20260811 08:16:10.751509 10907 tablet_bootstrap.cc:492] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8: Bootstrap starting.
I20260811 08:16:10.751569 10900 ts_tablet_manager.cc:1428] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:16:10.751628 10474 heartbeater.cc:503] Master 127.20.158.190:42151 was elected leader, sending a full tablet report...
I20260811 08:16:10.752179 10907 tablet_bootstrap.cc:654] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8: Neither blocks nor log segments found. Creating new log.
I20260811 08:16:10.752717 10907 log.cc:824] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8: Log is configured to *not* fsync() on all Append() calls
I20260811 08:16:10.753417 10907 tablet_bootstrap.cc:492] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8: No bootstrap required, opened a new log
I20260811 08:16:10.753470 10907 ts_tablet_manager.cc:1397] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:16:10.754787 10907 raft_consensus.cc:348] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } }
I20260811 08:16:10.754917 10907 raft_consensus.cc:374] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:16:10.754940 10907 raft_consensus.cc:729] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 472f971d03f34c50ba0baac2c5b876e8, State: Initialized, Role: FOLLOWER
I20260811 08:16:10.755045 10907 consensus_queue.cc:260] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } }
I20260811 08:16:10.755271 10907 ts_tablet_manager.cc:1428] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:16:10.755334 10684 heartbeater.cc:503] Master 127.20.158.190:42151 was elected leader, sending a full tablet report...
W20260811 08:16:10.778695 10685 tablet.cc:2369] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:16:10.804476 10914 raft_consensus.cc:482] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:16:10.804617 10914 raft_consensus.cc:504] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } }
I20260811 08:16:10.805114 10914 leader_election.cc:288] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef5370f6fa8646a7b2a055ced98f57de (127.20.158.129:45803), 80b4717a476b4299bca7f9ed8cf35063 (127.20.158.131:45505)
I20260811 08:16:10.808099 10686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:10.805364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:45803 (local address 127.20.158.130:42803)
0811 08:16:10.805449 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:10.805463 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:10.805512 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:10.805719 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:10.805720 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:10.805722 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:16:10.805804 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:10.805806 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.806482 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.806483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:10.807254 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:10.807256 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.807824 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.807826 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:10.807910 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:10.807913 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:16:10.807984 (+ 71us) client_negotiation.cc:240] Negotiation successful
0811 08:16:10.808025 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":64,"mutex_wait_us":20}
I20260811 08:16:10.808099 10895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:10.805439 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:42803 (local address 127.20.158.129:45803)
0811 08:16:10.805493 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:10.805495 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:10.805510 (+ 15us) server_negotiation.cc:407] Connection header received
0811 08:16:10.805611 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:10.805613 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:10.805625 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:10.805714 (+ 89us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:16:10.805881 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.806387 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.807349 (+ 962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.807735 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.807827 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:10.807836 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:10.807990 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 08:16:10.808027 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260811 08:16:10.808197 10898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:10.805519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:33379 (local address 127.20.158.131:45505)
0811 08:16:10.805593 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:10.805595 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:10.805714 (+ 119us) server_negotiation.cc:407] Connection header received
0811 08:16:10.805797 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:10.805798 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:10.805807 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:10.805881 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:16:10.806047 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.806511 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.807454 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.807841 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.807931 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:10.807939 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:10.808092 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 08:16:10.808128 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 08:16:10.808429 10916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:10.805364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:45505 (local address 127.20.158.130:33379)
0811 08:16:10.805616 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:10.805627 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:10.805729 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:10.805886 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:10.805886 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:10.805888 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:16:10.805968 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:10.805975 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.806599 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.806600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:10.807358 (+ 758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:10.807360 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.807932 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.807933 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:10.808004 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:10.808009 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:16:10.808086 (+ 77us) client_negotiation.cc:240] Negotiation successful
0811 08:16:10.808127 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":234,"mutex_wait_us":16,"thread_start_us":130,"threads_started":1}
I20260811 08:16:10.808465 10404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acfdb0eeb7854809886627e7cce208fb" candidate_uuid: "472f971d03f34c50ba0baac2c5b876e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5370f6fa8646a7b2a055ced98f57de" is_pre_election: true
I20260811 08:16:10.808694 10404 raft_consensus.cc:2454] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 472f971d03f34c50ba0baac2c5b876e8 in term 0.
I20260811 08:16:10.808776 10803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acfdb0eeb7854809886627e7cce208fb" candidate_uuid: "472f971d03f34c50ba0baac2c5b876e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80b4717a476b4299bca7f9ed8cf35063" is_pre_election: true
I20260811 08:16:10.808960 10803 raft_consensus.cc:2454] T acfdb0eeb7854809886627e7cce208fb P 80b4717a476b4299bca7f9ed8cf35063 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 472f971d03f34c50ba0baac2c5b876e8 in term 0.
I20260811 08:16:10.808961 10507 leader_election.cc:302] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 472f971d03f34c50ba0baac2c5b876e8, ef5370f6fa8646a7b2a055ced98f57de; no voters:
I20260811 08:16:10.809101 10914 raft_consensus.cc:2781] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:16:10.809185 10914 raft_consensus.cc:482] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:16:10.809226 10914 raft_consensus.cc:3037] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:16:10.809990 10914 raft_consensus.cc:504] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } }
I20260811 08:16:10.810173 10914 leader_election.cc:288] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8 [CANDIDATE]: Term 1 election: Requested vote from peers ef5370f6fa8646a7b2a055ced98f57de (127.20.158.129:45803), 80b4717a476b4299bca7f9ed8cf35063 (127.20.158.131:45505)
I20260811 08:16:10.810335 10404 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acfdb0eeb7854809886627e7cce208fb" candidate_uuid: "472f971d03f34c50ba0baac2c5b876e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef5370f6fa8646a7b2a055ced98f57de"
I20260811 08:16:10.810343 10803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acfdb0eeb7854809886627e7cce208fb" candidate_uuid: "472f971d03f34c50ba0baac2c5b876e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80b4717a476b4299bca7f9ed8cf35063"
I20260811 08:16:10.810411 10803 raft_consensus.cc:3037] T acfdb0eeb7854809886627e7cce208fb P 80b4717a476b4299bca7f9ed8cf35063 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:16:10.810432 10404 raft_consensus.cc:3037] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:16:10.811154 10803 raft_consensus.cc:2454] T acfdb0eeb7854809886627e7cce208fb P 80b4717a476b4299bca7f9ed8cf35063 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 472f971d03f34c50ba0baac2c5b876e8 in term 1.
I20260811 08:16:10.811188 10404 raft_consensus.cc:2454] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 472f971d03f34c50ba0baac2c5b876e8 in term 1.
I20260811 08:16:10.811400 10511 leader_election.cc:302] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 472f971d03f34c50ba0baac2c5b876e8, 80b4717a476b4299bca7f9ed8cf35063; no voters:
I20260811 08:16:10.811527 10914 raft_consensus.cc:2781] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:16:10.811691 10914 raft_consensus.cc:686] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8 [term 1 LEADER]: Becoming Leader. State: Replica: 472f971d03f34c50ba0baac2c5b876e8, State: Running, Role: LEADER
I20260811 08:16:10.811820 10914 consensus_queue.cc:237] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } }
I20260811 08:16:10.812705 10188 catalog_manager.cc:5495] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 472f971d03f34c50ba0baac2c5b876e8 (127.20.158.130). New cstate: current_term: 1 leader_uuid: "472f971d03f34c50ba0baac2c5b876e8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } health_report { overall_health: UNKNOWN } } }
I20260811 08:16:10.835402 10894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:10.832742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54300 (local address 127.20.158.130:35493)
0811 08:16:10.832805 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:10.832807 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:10.832816 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:16:10.832910 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:10.832911 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:10.832933 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:10.833037 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:16:10.833241 (+ 204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.833809 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.834577 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:10.834783 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:10.834862 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:10.835048 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:16:10.835152 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:16:10.835246 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:10.835266 (+ 20us) server_negotiation.cc:299] Negotiation successful
0811 08:16:10.835288 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 08:16:10.837458 10803 raft_consensus.cc:1261] T acfdb0eeb7854809886627e7cce208fb P 80b4717a476b4299bca7f9ed8cf35063 [term 1 FOLLOWER]: Refusing update from remote peer 472f971d03f34c50ba0baac2c5b876e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:16:10.837458 10404 raft_consensus.cc:1261] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de [term 1 FOLLOWER]: Refusing update from remote peer 472f971d03f34c50ba0baac2c5b876e8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:16:10.837874 10917 consensus_queue.cc:1035] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:16:10.838016 10914 consensus_queue.cc:1035] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:16:10.840723 10925 mvcc.cc:205] Tried to move back new op lower bound from 7317242555746852864 to 7317242555645857792. Current Snapshot: MvccSnapshot[applied={T|T < 7317242555746852864}]
I20260811 08:16:10.841002 10924 mvcc.cc:205] Tried to move back new op lower bound from 7317242555746852864 to 7317242555645857792. Current Snapshot: MvccSnapshot[applied={T|T < 7317242555746852864}]
I20260811 08:16:10.841639 10923 mvcc.cc:205] Tried to move back new op lower bound from 7317242555746852864 to 7317242555645857792. Current Snapshot: MvccSnapshot[applied={T|T < 7317242555746852864 or (T in {7317242555746852864})}]
I20260811 08:16:10.843271 10188 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60778:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:16:10.843405 10188 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60778:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:16:10.844246 10188 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025: Sending DeleteTablet for 3 replicas of tablet acfdb0eeb7854809886627e7cce208fb
I20260811 08:16:10.844573 10580 tablet_service.cc:1514] Processing DeleteTablet for tablet acfdb0eeb7854809886627e7cce208fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:16:10 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:54294
I20260811 08:16:10.844631 10777 tablet_service.cc:1514] Processing DeleteTablet for tablet acfdb0eeb7854809886627e7cce208fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:16:10 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:44168
I20260811 08:16:10.844617 10369 tablet_service.cc:1514] Processing DeleteTablet for tablet acfdb0eeb7854809886627e7cce208fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:16:10 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:38118
I20260811 08:16:10.844838 10936 tablet_replica.cc:330] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de: stopping tablet replica
I20260811 08:16:10.844952 10936 raft_consensus.cc:2229] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:16:10.844967 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 10274
I20260811 08:16:10.856745 10937 tablet_replica.cc:330] T acfdb0eeb7854809886627e7cce208fb P 80b4717a476b4299bca7f9ed8cf35063: stopping tablet replica
I20260811 08:16:10.856926 10937 raft_consensus.cc:2229] T acfdb0eeb7854809886627e7cce208fb P 80b4717a476b4299bca7f9ed8cf35063 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:16:10.857084 10937 raft_consensus.cc:2258] T acfdb0eeb7854809886627e7cce208fb P 80b4717a476b4299bca7f9ed8cf35063 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:16:10.857652 10937 ts_tablet_manager.cc:1905] T acfdb0eeb7854809886627e7cce208fb P 80b4717a476b4299bca7f9ed8cf35063: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:16:10.859202 10935 tablet_replica.cc:330] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8: stopping tablet replica
I20260811 08:16:10.859359 10935 raft_consensus.cc:2229] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:16:10.859443 10937 ts_tablet_manager.cc:1918] T acfdb0eeb7854809886627e7cce208fb P 80b4717a476b4299bca7f9ed8cf35063: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:16:10.859515 10937 log.cc:1196] T acfdb0eeb7854809886627e7cce208fb P 80b4717a476b4299bca7f9ed8cf35063: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/wal/wals/acfdb0eeb7854809886627e7cce208fb
I20260811 08:16:10.859526 10935 raft_consensus.cc:2258] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:16:10.859802 10937 ts_tablet_manager.cc:1939] T acfdb0eeb7854809886627e7cce208fb P 80b4717a476b4299bca7f9ed8cf35063: Deleting consensus metadata
I20260811 08:16:10.860324 10165 catalog_manager.cc:4841] TS 80b4717a476b4299bca7f9ed8cf35063 (127.20.158.131:45505): tablet acfdb0eeb7854809886627e7cce208fb (table test-table [id=79da6e5137814a6098257fcae5ca5012]) successfully deleted
I20260811 08:16:10.872017 10935 ts_tablet_manager.cc:1905] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:16:10.873894 10935 ts_tablet_manager.cc:1918] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:16:10.873999 10935 log.cc:1196] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/wal/wals/acfdb0eeb7854809886627e7cce208fb
I20260811 08:16:10.874284 10935 ts_tablet_manager.cc:1939] T acfdb0eeb7854809886627e7cce208fb P 472f971d03f34c50ba0baac2c5b876e8: Deleting consensus metadata
I20260811 08:16:10.877245 10165 catalog_manager.cc:4841] TS 472f971d03f34c50ba0baac2c5b876e8 (127.20.158.130:35493): tablet acfdb0eeb7854809886627e7cce208fb (table test-table [id=79da6e5137814a6098257fcae5ca5012]) successfully deleted
W20260811 08:16:10.882575 10162 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.158.129:45803 (error 108)
I20260811 08:16:10.882871 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 10481
I20260811 08:16:10.885643 10896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:10.885472 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:45803 (local address 127.0.0.1:38128)
0811 08:16:10.885547 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:10.885599 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.129:45803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 08:16:10.885921 10162 catalog_manager.cc:4584] TS ef5370f6fa8646a7b2a055ced98f57de (127.20.158.129:45803): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet acfdb0eeb7854809886627e7cce208fb: Network error: Client connection negotiation failed: client connection to 127.20.158.129:45803: connect: Connection refused (error 111)
I20260811 08:16:10.891366 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 10693
I20260811 08:16:10.908012 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 10138
I20260811 08:16:10.920677 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:42151
--webserver_interface=127.20.158.190
--webserver_port=38949
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:46487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:42151
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:16:11.006798 10941 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:11.007069 10941 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:11.007110 10941 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:11.008276 10941 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:16:11.008358 10941 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:11.008383 10941 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:11.008404 10941 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:16:11.008433 10941 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:16:11.009950 10941 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:46487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:42151
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:42151
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=38949
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10941
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:11.010236 10941 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:11.010479 10941 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:11.020066 10951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:11.020118 10941 server_base.cc:1034] running on GCE node
W20260811 08:16:11.020095 10952 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:11.020097 10955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:11.020576 10941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:11.020924 10941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:11.022073 10941 hybrid_clock.cc:648] HybridClock initialized: now 1786436171022052 us; error 43 us; skew 500 ppm
Aug 11 08:16:11 dist-test-slave-gkw7 krb5kdc[10118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436171, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:11.024735 10941 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:16:11.025285 10941 webserver.cc:460] Webserver started at http://127.20.158.190:38949/ using document root <none> and password file <none>
I20260811 08:16:11.025593 10941 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:11.025700 10941 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:16:11.027103 10941 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:16:11.027824 10964 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:11.028012 10941 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:16:11.028123 10941 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "b1599434abf6461f8bee1df13434e025"
format_stamp: "Formatted at 2026-08-11 08:16:10 on dist-test-slave-gkw7"
server_key: "c8804c122295879cd63ca4c862eb5123"
server_key_iv: "a886805ccc82c68e347bdef1e6354387"
server_key_version: "encryptionkey@0"
I20260811 08:16:11.028550 10941 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:11.046280 10941 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:11.048347 10941 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:11.048532 10941 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:11.053156 10941 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:42151
I20260811 08:16:11.053197 11043 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:42151 every 8 connection(s)
I20260811 08:16:11.053730 10941 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:16:11.055521 11045 sys_catalog.cc:263] Verifying existing consensus state
I20260811 08:16:11.056277 11045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025: Bootstrap starting.
I20260811 08:16:11.056444 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 10941
I20260811 08:16:11.056763 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:45803
--local_ip_for_outbound_sockets=127.20.158.129
--tserver_master_addrs=127.20.158.190:42151
--webserver_port=41763
--webserver_interface=127.20.158.129
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:46487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:16:11.065625 11045 log.cc:824] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025: Log is configured to *not* fsync() on all Append() calls
I20260811 08:16:11.067925 11045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:16:11.068312 11045 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025: Bootstrap complete.
I20260811 08:16:11.070998 11045 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1599434abf6461f8bee1df13434e025" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42151 } }
I20260811 08:16:11.071295 11045 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1599434abf6461f8bee1df13434e025, State: Initialized, Role: FOLLOWER
I20260811 08:16:11.071532 11045 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1599434abf6461f8bee1df13434e025" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42151 } }
I20260811 08:16:11.071645 11045 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:16:11.071714 11045 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:16:11.071771 11045 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [term 1 FOLLOWER]: Advancing to term 2
I20260811 08:16:11.073087 11045 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1599434abf6461f8bee1df13434e025" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42151 } }
I20260811 08:16:11.073241 11045 leader_election.cc:302] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1599434abf6461f8bee1df13434e025; no voters:
I20260811 08:16:11.073477 11045 leader_election.cc:288] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 08:16:11.073575 11051 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [term 2 FOLLOWER]: Leader election won for term 2
I20260811 08:16:11.073731 11051 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [term 2 LEADER]: Becoming Leader. State: Replica: b1599434abf6461f8bee1df13434e025, State: Running, Role: LEADER
I20260811 08:16:11.073817 11045 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:16:11.073904 11051 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1599434abf6461f8bee1df13434e025" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42151 } }
I20260811 08:16:11.074319 11052 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "b1599434abf6461f8bee1df13434e025" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1599434abf6461f8bee1df13434e025" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42151 } } }
I20260811 08:16:11.074393 11052 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [sys.catalog]: This master's current role is: LEADER
I20260811 08:16:11.074625 11055 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1599434abf6461f8bee1df13434e025. Latest consensus state: current_term: 2 leader_uuid: "b1599434abf6461f8bee1df13434e025" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1599434abf6461f8bee1df13434e025" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42151 } } }
I20260811 08:16:11.074726 11055 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [sys.catalog]: This master's current role is: LEADER
I20260811 08:16:11.076164 11073 catalog_manager.cc:1259] Loaded cluster ID: 9623006999f947bdaf687f7d6d6935ad
I20260811 08:16:11.076227 11073 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025: loading cluster ID for follower catalog manager: success
W20260811 08:16:11.076453 11073 catalog_manager.cc:1576] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025: acquiring CA information for follower catalog manager: Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG
W20260811 08:16:11.076504 11073 catalog_manager.cc:873] Runtime error: could not decrypt private key with the password returned by the configured command: unable to load data from memory: error reading private key: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D07803A:asn1 encoding routines:ASN1_ITEM_EX_D2I:nested asn1 error:tasn_dec.c:386:Type=X509_ALGOR error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=algor, Type=X509_SIG: failed to prepare follower catalog manager, will retry
I20260811 08:16:11.076550 11060 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:16:11.076934 11060 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:16:11.077047 11060 catalog_manager.cc:1259] Loaded cluster ID: 9623006999f947bdaf687f7d6d6935ad
I20260811 08:16:11.077085 11060 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:16:11.077275 11060 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260811 08:16:11.082521 11060 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260811 08:16:11.085796 11060 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:16:11.086056 11060 catalog_manager.cc:5879] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025: Loaded TSK: 0
I20260811 08:16:11.086328 11060 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 08:16:11.145455 11047 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:11.145771 11047 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:11.145813 11047 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:11.146987 11047 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:11.147058 11047 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:11.147102 11047 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:16:11.148579 11047 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:46487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:45803
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=41763
--tserver_master_addrs=127.20.158.190:42151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11047
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:11.148852 11047 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:11.149094 11047 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:11.155676 11088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:11.155689 11085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:11.155685 11083 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:11.155948 11047 server_base.cc:1034] running on GCE node
I20260811 08:16:11.156296 11047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:11.156625 11047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:11.157827 11047 hybrid_clock.cc:648] HybridClock initialized: now 1786436171157801 us; error 40 us; skew 500 ppm
Aug 11 08:16:11 dist-test-slave-gkw7 krb5kdc[10118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436171, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:11.161321 11047 init.cc:377] Logged in from keytab as kudu/127.20.158.129@KRBTEST.COM (short username kudu)
I20260811 08:16:11.162079 11047 webserver.cc:460] Webserver started at http://127.20.158.129:41763/ using document root <none> and password file <none>
I20260811 08:16:11.162398 11047 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:11.162504 11047 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:16:11.164685 11047 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:16:11.165665 11095 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:11.165840 11047 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:11.165957 11047 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "ef5370f6fa8646a7b2a055ced98f57de"
format_stamp: "Formatted at 2026-08-11 08:16:10 on dist-test-slave-gkw7"
server_key: "803227b12d42491b8c0aed601de8c157"
server_key_iv: "08d3d0ebdd7664aee4587f098f96b39d"
server_key_version: "encryptionkey@0"
I20260811 08:16:11.166328 11047 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:11.182307 11047 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:11.185312 11047 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:11.185491 11047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:11.185834 11047 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:16:11.186398 11103 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 08:16:11.187909 11047 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 08:16:11.187978 11047 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 08:16:11.188019 11047 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 08:16:11.189190 11047 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 08:16:11.189250 11047 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 08:16:11.189317 11103 tablet_bootstrap.cc:492] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de: Bootstrap starting.
I20260811 08:16:11.197634 11047 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:45803
I20260811 08:16:11.198140 11047 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:16:11.199501 11270 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:45803 every 8 connection(s)
I20260811 08:16:11.199903 11103 log.cc:824] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de: Log is configured to *not* fsync() on all Append() calls
I20260811 08:16:11.202930 11103 tablet_bootstrap.cc:492] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:16:11.203282 11103 tablet_bootstrap.cc:492] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de: Bootstrap complete.
I20260811 08:16:11.204540 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 11047
I20260811 08:16:11.204595 11103 ts_tablet_manager.cc:1397] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.009s
I20260811 08:16:11.204859 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:35493
--local_ip_for_outbound_sockets=127.20.158.130
--tserver_master_addrs=127.20.158.190:42151
--webserver_port=39699
--webserver_interface=127.20.158.130
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:46487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:16:11.206776 11103 raft_consensus.cc:348] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } }
I20260811 08:16:11.207203 11103 raft_consensus.cc:729] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5370f6fa8646a7b2a055ced98f57de, State: Initialized, Role: FOLLOWER
Aug 11 08:16:11 dist-test-slave-gkw7 krb5kdc[10118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436171, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:16:11.207453 11103 consensus_queue.cc:260] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } }
I20260811 08:16:11.207770 11103 ts_tablet_manager.cc:1428] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de: Time spent starting tablet: real 0.003s user 0.003s sys 0.002s
I20260811 08:16:11.211860 11273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:11.198985 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.129:57391)
0811 08:16:11.199221 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:11.199278 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:11.199963 (+ 685us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:11.200473 (+ 510us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:11.200477 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:11.200756 (+ 279us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:11.200948 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:11.200953 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.202793 (+ 1840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.202794 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:11.204249 (+ 1455us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:11.204253 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.205154 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.205156 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:11.205322 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:11.206111 (+ 789us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:11.206122 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:11.208001 (+ 1879us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:11.210070 (+ 2069us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:11.210078 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:11.210080 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:11.210319 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:11.210626 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:11.210627 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:11.210627 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:11.210753 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:11.211212 (+ 459us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:11.211219 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:11.211359 (+ 140us) client_negotiation.cc:769] Sending connection context
0811 08:16:11.211464 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 08:16:11.211650 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":112,"threads_started":1}
I20260811 08:16:11.211869 11274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:11.199299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:57391 (local address 127.20.158.190:42151)
0811 08:16:11.199903 (+ 604us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:11.199913 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:11.199958 (+ 45us) server_negotiation.cc:407] Connection header received
0811 08:16:11.200185 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:11.200192 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:11.200251 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:11.200406 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:11.201100 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.202651 (+ 1551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.204369 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.205016 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.205692 (+ 676us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:11.208126 (+ 2434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:11.208130 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:11.208130 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:11.208140 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:11.209962 (+ 1822us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:11.210433 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:11.210437 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:11.210437 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:11.210535 (+ 98us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:11.210906 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:11.210907 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:11.210907 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:11.211124 (+ 217us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:11.211223 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:11.211536 (+ 313us) server_negotiation.cc:299] Negotiation successful
0811 08:16:11.211661 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":552,"thread_start_us":78,"threads_started":1}
I20260811 08:16:11.212671 11271 heartbeater.cc:347] Connected to a master server at 127.20.158.190:42151
I20260811 08:16:11.212780 11271 heartbeater.cc:464] Registering TS with master...
I20260811 08:16:11.212978 11271 heartbeater.cc:511] Master 127.20.158.190:42151 requested a full tablet report, sending...
I20260811 08:16:11.213776 10988 ts_manager.cc:194] Registered new tserver with Master: ef5370f6fa8646a7b2a055ced98f57de (127.20.158.129:45803)
I20260811 08:16:11.214928 10988 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.129@KRBTEST.COM'} at 127.20.158.129:57391
I20260811 08:16:11.215770 11271 heartbeater.cc:503] Master 127.20.158.190:42151 was elected leader, sending a full tablet report...
I20260811 08:16:11.224457 11282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:11.214357 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:45803 (local address 127.0.0.1:38134)
0811 08:16:11.221089 (+ 6732us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:11.221126 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:11.221246 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:11.221477 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:11.221480 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:11.221482 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:16:11.221579 (+ 97us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:11.221581 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.222441 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.222442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:11.223317 (+ 875us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:11.223319 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.224086 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.224087 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:11.224212 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:11.224223 (+ 11us) client_negotiation.cc:769] Sending connection context
0811 08:16:11.224307 (+ 84us) client_negotiation.cc:240] Negotiation successful
0811 08:16:11.224363 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6701,"thread_start_us":102,"threads_started":1}
I20260811 08:16:11.224447 11283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:11.214624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38134 (local address 127.20.158.129:45803)
0811 08:16:11.214793 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:11.214798 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:11.221226 (+ 6428us) server_negotiation.cc:407] Connection header received
0811 08:16:11.221355 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:11.221357 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:11.221373 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:11.221473 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:16:11.221673 (+ 200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.222346 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.223415 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.223997 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.224087 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:11.224147 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:11.224324 (+ 177us) server_negotiation.cc:299] Negotiation successful
0811 08:16:11.224366 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":91,"threads_started":1}
I20260811 08:16:11.225015 11167 tablet_service.cc:1514] Processing DeleteTablet for tablet acfdb0eeb7854809886627e7cce208fb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:16:10 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:38134
I20260811 08:16:11.225632 11285 tablet_replica.cc:330] stopping tablet replica
I20260811 08:16:11.225773 11285 raft_consensus.cc:2229] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:16:11.225848 11285 raft_consensus.cc:2258] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:16:11.226174 11285 ts_tablet_manager.cc:1905] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:16:11.228150 11285 ts_tablet_manager.cc:1918] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:16:11.228256 11285 log.cc:1196] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/wal/wals/acfdb0eeb7854809886627e7cce208fb
I20260811 08:16:11.228513 11285 ts_tablet_manager.cc:1939] T acfdb0eeb7854809886627e7cce208fb P ef5370f6fa8646a7b2a055ced98f57de: Deleting consensus metadata
I20260811 08:16:11.229070 10967 catalog_manager.cc:4841] TS ef5370f6fa8646a7b2a055ced98f57de (127.20.158.129:45803): tablet acfdb0eeb7854809886627e7cce208fb (table test-table [id=79da6e5137814a6098257fcae5ca5012]) successfully deleted
W20260811 08:16:11.304965 11277 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:11.305182 11277 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:11.305207 11277 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:11.306289 11277 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:11.306326 11277 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:11.306351 11277 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:16:11.307776 11277 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:46487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:35493
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=39699
--tserver_master_addrs=127.20.158.190:42151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11277
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:11.307958 11277 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:11.308135 11277 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:11.313176 11293 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:11.313180 11297 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:11.313189 11294 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:11.313486 11277 server_base.cc:1034] running on GCE node
I20260811 08:16:11.313750 11277 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:11.313946 11277 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:11.315102 11277 hybrid_clock.cc:648] HybridClock initialized: now 1786436171315083 us; error 33 us; skew 500 ppm
Aug 11 08:16:11 dist-test-slave-gkw7 krb5kdc[10118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436171, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:11.317647 11277 init.cc:377] Logged in from keytab as kudu/127.20.158.130@KRBTEST.COM (short username kudu)
I20260811 08:16:11.318053 11277 webserver.cc:460] Webserver started at http://127.20.158.130:39699/ using document root <none> and password file <none>
I20260811 08:16:11.318302 11277 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:11.318363 11277 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:16:11.319861 11277 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:11.320538 11310 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:11.320772 11277 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:11.320878 11277 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "472f971d03f34c50ba0baac2c5b876e8"
format_stamp: "Formatted at 2026-08-11 08:16:10 on dist-test-slave-gkw7"
server_key: "a05b7ef1d98acce54b0f750715e244fb"
server_key_iv: "7a46cbcb74bb6b52624467063c20d491"
server_key_version: "encryptionkey@0"
I20260811 08:16:11.321261 11277 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:11.344672 11277 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:11.346729 11277 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:11.346853 11277 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:11.347049 11277 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:16:11.347386 11277 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:16:11.347421 11277 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:11.347445 11277 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:16:11.347494 11277 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:11.353413 11277 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:35493
I20260811 08:16:11.353498 11483 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:35493 every 8 connection(s)
I20260811 08:16:11.353855 11277 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
Aug 11 08:16:11 dist-test-slave-gkw7 krb5kdc[10118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436171, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:16:11.363241 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 11277
I20260811 08:16:11.363596 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:45505
--local_ip_for_outbound_sockets=127.20.158.131
--tserver_master_addrs=127.20.158.190:42151
--webserver_port=37811
--webserver_interface=127.20.158.131
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:46487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:16:11.364046 11274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:11.354678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:54555 (local address 127.20.158.190:42151)
0811 08:16:11.354756 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:11.354758 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:11.354996 (+ 238us) server_negotiation.cc:407] Connection header received
0811 08:16:11.355495 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:11.355496 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:11.355507 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:11.355567 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:11.356614 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.357113 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.358289 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.358506 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.358575 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:11.360767 (+ 2192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:11.360769 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:11.360769 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:11.360777 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:11.362411 (+ 1634us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:11.362873 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:11.362874 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:11.362875 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:11.362944 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:11.363277 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:11.363278 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:11.363279 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:11.363459 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:11.363523 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:11.363890 (+ 367us) server_negotiation.cc:299] Negotiation successful
0811 08:16:11.363978 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 08:16:11.364357 11488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:11.354675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.130:54555)
0811 08:16:11.354870 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:11.354906 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:11.355401 (+ 495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:11.355684 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:11.355688 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:11.356316 (+ 628us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:11.356515 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:11.356520 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.357214 (+ 694us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.357215 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:11.358184 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:11.358187 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.358590 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.358591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:11.358694 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:11.359191 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:11.359200 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:11.360639 (+ 1439us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:11.362514 (+ 1875us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:11.362522 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:11.362525 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:11.362786 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:11.363013 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:11.363014 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:11.363015 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:11.363185 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:11.363519 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:11.363527 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:11.363722 (+ 195us) client_negotiation.cc:769] Sending connection context
0811 08:16:11.363850 (+ 128us) client_negotiation.cc:240] Negotiation successful
0811 08:16:11.364057 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":109,"threads_started":1}
I20260811 08:16:11.364902 11484 heartbeater.cc:347] Connected to a master server at 127.20.158.190:42151
I20260811 08:16:11.365031 11484 heartbeater.cc:464] Registering TS with master...
I20260811 08:16:11.365222 11484 heartbeater.cc:511] Master 127.20.158.190:42151 requested a full tablet report, sending...
I20260811 08:16:11.365734 10988 ts_manager.cc:194] Registered new tserver with Master: 472f971d03f34c50ba0baac2c5b876e8 (127.20.158.130:35493)
I20260811 08:16:11.366283 10988 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.130@KRBTEST.COM'} at 127.20.158.130:54555
W20260811 08:16:11.448974 11490 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:11.449250 11490 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:11.449298 11490 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:11.450456 11490 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:11.450539 11490 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:11.450583 11490 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:16:11.452016 11490 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:46487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:45505
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=37811
--tserver_master_addrs=127.20.158.190:42151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11490
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:11.452344 11490 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:11.452589 11490 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:11.457931 11497 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:11.457990 11499 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:11.457931 11507 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:11.458056 11490 server_base.cc:1034] running on GCE node
I20260811 08:16:11.458329 11490 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:11.458573 11490 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:11.459743 11490 hybrid_clock.cc:648] HybridClock initialized: now 1786436171459724 us; error 39 us; skew 500 ppm
Aug 11 08:16:11 dist-test-slave-gkw7 krb5kdc[10118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436171, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:11.462520 11490 init.cc:377] Logged in from keytab as kudu/127.20.158.131@KRBTEST.COM (short username kudu)
I20260811 08:16:11.463028 11490 webserver.cc:460] Webserver started at http://127.20.158.131:37811/ using document root <none> and password file <none>
I20260811 08:16:11.463264 11490 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:11.463348 11490 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:16:11.464756 11490 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:11.465372 11520 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:11.465606 11490 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:11.465742 11490 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "80b4717a476b4299bca7f9ed8cf35063"
format_stamp: "Formatted at 2026-08-11 08:16:10 on dist-test-slave-gkw7"
server_key: "d790e5cd87f3ce4453c552a6b9784c14"
server_key_iv: "37eebd4a37f2b4dacd0475ca832e4227"
server_key_version: "encryptionkey@0"
I20260811 08:16:11.466089 11490 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:11.483352 11490 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:11.486035 11490 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:11.486213 11490 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:11.486490 11490 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:16:11.486841 11490 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:16:11.486902 11490 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:11.486938 11490 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:16:11.486984 11490 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:11.493218 11490 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:45505
I20260811 08:16:11.493266 11680 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:45505 every 8 connection(s)
I20260811 08:16:11.493665 11490 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
Aug 11 08:16:11 dist-test-slave-gkw7 krb5kdc[10118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436171, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:16:11.500583 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 11490
I20260811 08:16:11.503625 11274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:11.494444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:58579 (local address 127.20.158.190:42151)
0811 08:16:11.494541 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:11.494543 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:11.494814 (+ 271us) server_negotiation.cc:407] Connection header received
0811 08:16:11.495356 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:11.495358 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:11.495369 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:11.495434 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:11.496428 (+ 994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.496931 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.497979 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.498210 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.498283 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:11.500597 (+ 2314us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:11.500599 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:11.500599 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:11.500606 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:11.502251 (+ 1645us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:11.502654 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:11.502655 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:11.502655 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:11.502720 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:11.502957 (+ 237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:11.502958 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:11.502959 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:11.503079 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:11.503131 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:11.503496 (+ 365us) server_negotiation.cc:299] Negotiation successful
0811 08:16:11.503560 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 08:16:11.503865 11685 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:11.494433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.131:58579)
0811 08:16:11.494676 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:11.494718 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:11.495214 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:11.495489 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:11.495493 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:11.496080 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:11.496321 (+ 241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:11.496327 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.497026 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.497027 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:11.497892 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:11.497895 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.498325 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.498326 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:11.498442 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:11.499054 (+ 612us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:11.499063 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:11.500478 (+ 1415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:11.502341 (+ 1863us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:11.502347 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:11.502349 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:11.502582 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:11.502788 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:11.502789 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:11.502789 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:11.502891 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:11.503178 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:11.503185 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:11.503350 (+ 165us) client_negotiation.cc:769] Sending connection context
0811 08:16:11.503474 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 08:16:11.503634 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"thread_start_us":122,"threads_started":1}
I20260811 08:16:11.504333 11681 heartbeater.cc:347] Connected to a master server at 127.20.158.190:42151
I20260811 08:16:11.504434 11681 heartbeater.cc:464] Registering TS with master...
I20260811 08:16:11.504642 11681 heartbeater.cc:511] Master 127.20.158.190:42151 requested a full tablet report, sending...
I20260811 08:16:11.505049 10988 ts_manager.cc:194] Registered new tserver with Master: 80b4717a476b4299bca7f9ed8cf35063 (127.20.158.131:45505)
I20260811 08:16:11.505410 10988 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.131@KRBTEST.COM'} at 127.20.158.131:58579
I20260811 08:16:11.508193 11687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:11.501067 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60792 (local address 127.20.158.190:42151)
0811 08:16:11.501201 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:11.501203 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:11.501488 (+ 285us) server_negotiation.cc:407] Connection header received
0811 08:16:11.501507 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:11.501508 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:11.501519 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:11.501625 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:11.502266 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.502897 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.503966 (+ 1069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.504254 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.504341 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:11.505717 (+ 1376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:11.505718 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:11.505719 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:11.505726 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:11.507018 (+ 1292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:11.507383 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:11.507384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:11.507385 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:11.507449 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:11.507669 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:11.507670 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:11.507670 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:11.507784 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:11.507968 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:11.508008 (+ 40us) server_negotiation.cc:299] Negotiation successful
0811 08:16:11.508089 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":73,"threads_started":1}
I20260811 08:16:11.508912 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:16:11.511756 11687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:11.509273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60804 (local address 127.20.158.190:42151)
0811 08:16:11.509312 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:11.509314 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:11.509438 (+ 124us) server_negotiation.cc:407] Connection header received
0811 08:16:11.509507 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:11.509508 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:11.509579 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:11.509654 (+ 75us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:16:11.509762 (+ 108us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.510221 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.510981 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.511192 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.511268 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:11.511432 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:16:11.511539 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:16:11.511635 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:11.511654 (+ 19us) server_negotiation.cc:299] Negotiation successful
0811 08:16:11.511684 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 08:16:11.512032 10988 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:60804:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:16:11.513955 10988 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:16:11.516338 11167 tablet_service.cc:1467] Processing CreateTablet for tablet 7568f3c225e2490080635c5f9e2f33cb (DEFAULT_TABLE table=test-table [id=78bb2aa5d370449996df395eda1ccb9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:16:11.516551 11167 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7568f3c225e2490080635c5f9e2f33cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:16:11.518266 11103 tablet_bootstrap.cc:492] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de: Bootstrap starting.
I20260811 08:16:11.518635 11103 tablet_bootstrap.cc:654] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de: Neither blocks nor log segments found. Creating new log.
I20260811 08:16:11.519248 11103 tablet_bootstrap.cc:492] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de: No bootstrap required, opened a new log
I20260811 08:16:11.519305 11103 ts_tablet_manager.cc:1397] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260811 08:16:11.519418 11103 raft_consensus.cc:348] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } }
I20260811 08:16:11.519497 11103 raft_consensus.cc:374] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:16:11.519554 11103 raft_consensus.cc:729] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5370f6fa8646a7b2a055ced98f57de, State: Initialized, Role: FOLLOWER
I20260811 08:16:11.519603 11103 consensus_queue.cc:260] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } }
I20260811 08:16:11.519717 11103 ts_tablet_manager.cc:1428] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:11.520109 11282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:11.515988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:45505 (local address 127.0.0.1:44180)
0811 08:16:11.516141 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:11.516151 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:11.516194 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:11.516507 (+ 313us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:11.516508 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:11.516510 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:16:11.516552 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:11.516554 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.517721 (+ 1167us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.517722 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:11.518753 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:11.518755 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.519861 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.519863 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:11.519933 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:11.519939 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 08:16:11.519991 (+ 52us) client_negotiation.cc:240] Negotiation successful
0811 08:16:11.520042 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":93,"threads_started":1}
I20260811 08:16:11.520390 11694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:11.516103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44180 (local address 127.20.158.131:45505)
0811 08:16:11.516319 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:11.516324 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:11.516342 (+ 18us) server_negotiation.cc:407] Connection header received
0811 08:16:11.516374 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:11.516375 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:11.516388 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:11.516485 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:16:11.516637 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.517597 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.518822 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.519620 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.519713 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:11.519783 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:11.520253 (+ 470us) server_negotiation.cc:299] Negotiation successful
0811 08:16:11.520305 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":94,"threads_started":1}
I20260811 08:16:11.521169 11584 tablet_service.cc:1467] Processing CreateTablet for tablet 7568f3c225e2490080635c5f9e2f33cb (DEFAULT_TABLE table=test-table [id=78bb2aa5d370449996df395eda1ccb9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:16:11.521615 11584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7568f3c225e2490080635c5f9e2f33cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:16:11.522388 11692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:11.515993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54316 (local address 127.20.158.130:35493)
0811 08:16:11.518477 (+ 2484us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:11.518482 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:11.518493 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:16:11.518530 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:11.518532 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:11.518547 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:11.518623 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:16:11.518826 (+ 203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.519896 (+ 1070us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.521282 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.522035 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.522099 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:11.522138 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:11.522293 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 08:16:11.522327 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2445,"thread_start_us":101,"threads_started":1}
I20260811 08:16:11.522403 11691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:11.515894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:35493 (local address 127.0.0.1:54316)
0811 08:16:11.516176 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:11.516185 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:11.516228 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:11.518700 (+ 2472us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:11.518701 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:11.518703 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:16:11.518743 (+ 40us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:11.518744 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.520014 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.520015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:11.521196 (+ 1181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:11.521200 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.522127 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.522128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:11.522201 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:11.522207 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 08:16:11.522272 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 08:16:11.522320 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"mutex_wait_us":1}
I20260811 08:16:11.523377 11385 tablet_service.cc:1467] Processing CreateTablet for tablet 7568f3c225e2490080635c5f9e2f33cb (DEFAULT_TABLE table=test-table [id=78bb2aa5d370449996df395eda1ccb9d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:16:11.523811 11385 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7568f3c225e2490080635c5f9e2f33cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:16:11.525511 11697 tablet_bootstrap.cc:492] T 7568f3c225e2490080635c5f9e2f33cb P 80b4717a476b4299bca7f9ed8cf35063: Bootstrap starting.
I20260811 08:16:11.526190 11697 tablet_bootstrap.cc:654] T 7568f3c225e2490080635c5f9e2f33cb P 80b4717a476b4299bca7f9ed8cf35063: Neither blocks nor log segments found. Creating new log.
I20260811 08:16:11.526612 11697 log.cc:824] T 7568f3c225e2490080635c5f9e2f33cb P 80b4717a476b4299bca7f9ed8cf35063: Log is configured to *not* fsync() on all Append() calls
I20260811 08:16:11.526980 11702 tablet_bootstrap.cc:492] T 7568f3c225e2490080635c5f9e2f33cb P 472f971d03f34c50ba0baac2c5b876e8: Bootstrap starting.
I20260811 08:16:11.527474 11697 tablet_bootstrap.cc:492] T 7568f3c225e2490080635c5f9e2f33cb P 80b4717a476b4299bca7f9ed8cf35063: No bootstrap required, opened a new log
I20260811 08:16:11.527570 11702 tablet_bootstrap.cc:654] T 7568f3c225e2490080635c5f9e2f33cb P 472f971d03f34c50ba0baac2c5b876e8: Neither blocks nor log segments found. Creating new log.
I20260811 08:16:11.527611 11697 ts_tablet_manager.cc:1397] T 7568f3c225e2490080635c5f9e2f33cb P 80b4717a476b4299bca7f9ed8cf35063: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:16:11.528146 11702 log.cc:824] T 7568f3c225e2490080635c5f9e2f33cb P 472f971d03f34c50ba0baac2c5b876e8: Log is configured to *not* fsync() on all Append() calls
I20260811 08:16:11.528858 11702 tablet_bootstrap.cc:492] T 7568f3c225e2490080635c5f9e2f33cb P 472f971d03f34c50ba0baac2c5b876e8: No bootstrap required, opened a new log
I20260811 08:16:11.528944 11702 ts_tablet_manager.cc:1397] T 7568f3c225e2490080635c5f9e2f33cb P 472f971d03f34c50ba0baac2c5b876e8: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:16:11.529201 11697 raft_consensus.cc:348] T 7568f3c225e2490080635c5f9e2f33cb P 80b4717a476b4299bca7f9ed8cf35063 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } }
I20260811 08:16:11.529338 11697 raft_consensus.cc:374] T 7568f3c225e2490080635c5f9e2f33cb P 80b4717a476b4299bca7f9ed8cf35063 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:16:11.529361 11697 raft_consensus.cc:729] T 7568f3c225e2490080635c5f9e2f33cb P 80b4717a476b4299bca7f9ed8cf35063 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80b4717a476b4299bca7f9ed8cf35063, State: Initialized, Role: FOLLOWER
I20260811 08:16:11.529505 11697 consensus_queue.cc:260] T 7568f3c225e2490080635c5f9e2f33cb P 80b4717a476b4299bca7f9ed8cf35063 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } }
I20260811 08:16:11.529850 11697 ts_tablet_manager.cc:1428] T 7568f3c225e2490080635c5f9e2f33cb P 80b4717a476b4299bca7f9ed8cf35063: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:16:11.529906 11681 heartbeater.cc:503] Master 127.20.158.190:42151 was elected leader, sending a full tablet report...
I20260811 08:16:11.531322 11702 raft_consensus.cc:348] T 7568f3c225e2490080635c5f9e2f33cb P 472f971d03f34c50ba0baac2c5b876e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } }
I20260811 08:16:11.531442 11702 raft_consensus.cc:374] T 7568f3c225e2490080635c5f9e2f33cb P 472f971d03f34c50ba0baac2c5b876e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:16:11.531463 11702 raft_consensus.cc:729] T 7568f3c225e2490080635c5f9e2f33cb P 472f971d03f34c50ba0baac2c5b876e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 472f971d03f34c50ba0baac2c5b876e8, State: Initialized, Role: FOLLOWER
I20260811 08:16:11.531538 11702 consensus_queue.cc:260] T 7568f3c225e2490080635c5f9e2f33cb P 472f971d03f34c50ba0baac2c5b876e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } }
I20260811 08:16:11.531749 11702 ts_tablet_manager.cc:1428] T 7568f3c225e2490080635c5f9e2f33cb P 472f971d03f34c50ba0baac2c5b876e8: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:16:11.531809 11484 heartbeater.cc:503] Master 127.20.158.190:42151 was elected leader, sending a full tablet report...
I20260811 08:16:11.575265 11281 raft_consensus.cc:482] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:16:11.575450 11281 raft_consensus.cc:504] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } }
I20260811 08:16:11.575861 11281 leader_election.cc:288] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 472f971d03f34c50ba0baac2c5b876e8 (127.20.158.130:35493), 80b4717a476b4299bca7f9ed8cf35063 (127.20.158.131:45505)
I20260811 08:16:11.579416 11273 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:11.576036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:35493 (local address 127.20.158.129:59069)
0811 08:16:11.576105 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:11.576117 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:11.576165 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:11.576380 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:11.576382 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:11.576384 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:16:11.576445 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:11.576448 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.577272 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.577273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:11.578501 (+ 1228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:11.578505 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.579216 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.579217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:11.579272 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:11.579276 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:16:11.579321 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 08:16:11.579358 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":45}
I20260811 08:16:11.579479 11692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:11.576116 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:59069 (local address 127.20.158.130:35493)
0811 08:16:11.576193 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:11.576196 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:11.576206 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:16:11.576237 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:11.576238 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:11.576249 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:11.576313 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:16:11.576533 (+ 220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.577152 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.578603 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.579122 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.579210 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:11.579220 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:11.579349 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 08:16:11.579386 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:16:11.579749 11707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:11.576186 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:45505 (local address 127.20.158.129:55657)
0811 08:16:11.576419 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:11.576431 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:11.576491 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:11.576614 (+ 123us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:11.576615 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:11.576616 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:16:11.576936 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:11.576939 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.577680 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.577681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:11.578759 (+ 1078us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:11.578761 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.579492 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.579493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:11.579587 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:11.579592 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:16:11.579645 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 08:16:11.579680 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":153,"threads_started":1}
I20260811 08:16:11.579802 11694 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:11.576257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:55657 (local address 127.20.158.131:45505)
0811 08:16:11.576334 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:11.576337 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:11.576502 (+ 165us) server_negotiation.cc:407] Connection header received
0811 08:16:11.576537 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:11.576539 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:11.576549 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:11.576613 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:16:11.577016 (+ 403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.577603 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.578845 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.579405 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.579476 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:11.579483 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:11.579682 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 08:16:11.579732 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260811 08:16:11.579988 11414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7568f3c225e2490080635c5f9e2f33cb" candidate_uuid: "ef5370f6fa8646a7b2a055ced98f57de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "472f971d03f34c50ba0baac2c5b876e8" is_pre_election: true
I20260811 08:16:11.580127 11414 raft_consensus.cc:2454] T 7568f3c225e2490080635c5f9e2f33cb P 472f971d03f34c50ba0baac2c5b876e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5370f6fa8646a7b2a055ced98f57de in term 0.
I20260811 08:16:11.580304 11100 leader_election.cc:302] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 472f971d03f34c50ba0baac2c5b876e8, ef5370f6fa8646a7b2a055ced98f57de; no voters:
I20260811 08:16:11.580432 11281 raft_consensus.cc:2781] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:16:11.580533 11281 raft_consensus.cc:482] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:16:11.580587 11281 raft_consensus.cc:3037] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:16:11.580649 11608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7568f3c225e2490080635c5f9e2f33cb" candidate_uuid: "ef5370f6fa8646a7b2a055ced98f57de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80b4717a476b4299bca7f9ed8cf35063" is_pre_election: true
I20260811 08:16:11.580818 11608 raft_consensus.cc:2454] T 7568f3c225e2490080635c5f9e2f33cb P 80b4717a476b4299bca7f9ed8cf35063 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef5370f6fa8646a7b2a055ced98f57de in term 0.
I20260811 08:16:11.581418 11281 raft_consensus.cc:504] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } }
I20260811 08:16:11.581612 11281 leader_election.cc:288] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [CANDIDATE]: Term 1 election: Requested vote from peers 472f971d03f34c50ba0baac2c5b876e8 (127.20.158.130:35493), 80b4717a476b4299bca7f9ed8cf35063 (127.20.158.131:45505)
I20260811 08:16:11.581730 11414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7568f3c225e2490080635c5f9e2f33cb" candidate_uuid: "ef5370f6fa8646a7b2a055ced98f57de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "472f971d03f34c50ba0baac2c5b876e8"
I20260811 08:16:11.581789 11608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7568f3c225e2490080635c5f9e2f33cb" candidate_uuid: "ef5370f6fa8646a7b2a055ced98f57de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "80b4717a476b4299bca7f9ed8cf35063"
I20260811 08:16:11.581835 11414 raft_consensus.cc:3037] T 7568f3c225e2490080635c5f9e2f33cb P 472f971d03f34c50ba0baac2c5b876e8 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:16:11.581871 11608 raft_consensus.cc:3037] T 7568f3c225e2490080635c5f9e2f33cb P 80b4717a476b4299bca7f9ed8cf35063 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:16:11.582777 11414 raft_consensus.cc:2454] T 7568f3c225e2490080635c5f9e2f33cb P 472f971d03f34c50ba0baac2c5b876e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5370f6fa8646a7b2a055ced98f57de in term 1.
I20260811 08:16:11.582777 11608 raft_consensus.cc:2454] T 7568f3c225e2490080635c5f9e2f33cb P 80b4717a476b4299bca7f9ed8cf35063 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef5370f6fa8646a7b2a055ced98f57de in term 1.
I20260811 08:16:11.582957 11100 leader_election.cc:302] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 472f971d03f34c50ba0baac2c5b876e8, ef5370f6fa8646a7b2a055ced98f57de; no voters:
I20260811 08:16:11.583057 11281 raft_consensus.cc:2781] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:16:11.583220 11281 raft_consensus.cc:686] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [term 1 LEADER]: Becoming Leader. State: Replica: ef5370f6fa8646a7b2a055ced98f57de, State: Running, Role: LEADER
I20260811 08:16:11.583283 11281 consensus_queue.cc:237] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } }
I20260811 08:16:11.584138 10987 catalog_manager.cc:5495] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de reported cstate change: term changed from 0 to 1, leader changed from <none> to ef5370f6fa8646a7b2a055ced98f57de (127.20.158.129). New cstate: current_term: 1 leader_uuid: "ef5370f6fa8646a7b2a055ced98f57de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } health_report { overall_health: HEALTHY } } }
I20260811 08:16:11.594266 11283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:11.591833 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38140 (local address 127.20.158.129:45803)
0811 08:16:11.591885 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:11.591887 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:11.591898 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:16:11.591938 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:11.591939 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:11.591963 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:11.592041 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:16:11.592168 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.592642 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.593426 (+ 784us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:11.593667 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:11.593743 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:11.593917 (+ 174us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:16:11.594024 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:16:11.594101 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:11.594162 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 08:16:11.594183 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:16:11.595862 11414 raft_consensus.cc:1261] T 7568f3c225e2490080635c5f9e2f33cb P 472f971d03f34c50ba0baac2c5b876e8 [term 1 FOLLOWER]: Refusing update from remote peer ef5370f6fa8646a7b2a055ced98f57de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:16:11.595901 11608 raft_consensus.cc:1261] T 7568f3c225e2490080635c5f9e2f33cb P 80b4717a476b4299bca7f9ed8cf35063 [term 1 FOLLOWER]: Refusing update from remote peer ef5370f6fa8646a7b2a055ced98f57de: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:16:11.596282 11281 consensus_queue.cc:1035] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [LEADER]: Connected to new peer: Peer: permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:16:11.596416 11709 consensus_queue.cc:1035] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [LEADER]: Connected to new peer: Peer: permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:16:11.599421 11719 mvcc.cc:205] Tried to move back new op lower bound from 7317242558854135808 to 7317242558805700608. Current Snapshot: MvccSnapshot[applied={T|T < 7317242558854135808}]
I20260811 08:16:11.601248 10988 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:60804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:16:11.601358 10988 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:60804:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:16:11.602258 10988 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025: Sending DeleteTablet for 3 replicas of tablet 7568f3c225e2490080635c5f9e2f33cb
I20260811 08:16:11.602597 11385 tablet_service.cc:1514] Processing DeleteTablet for tablet 7568f3c225e2490080635c5f9e2f33cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:16:11 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:54316
I20260811 08:16:11.602648 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 11047
I20260811 08:16:11.602895 11584 tablet_service.cc:1514] Processing DeleteTablet for tablet 7568f3c225e2490080635c5f9e2f33cb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:16:11 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:44180
I20260811 08:16:11.609845 11729 tablet_replica.cc:330] T 7568f3c225e2490080635c5f9e2f33cb P 80b4717a476b4299bca7f9ed8cf35063: stopping tablet replica
I20260811 08:16:11.610030 11729 raft_consensus.cc:2229] T 7568f3c225e2490080635c5f9e2f33cb P 80b4717a476b4299bca7f9ed8cf35063 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:16:11.610199 11729 raft_consensus.cc:2258] T 7568f3c225e2490080635c5f9e2f33cb P 80b4717a476b4299bca7f9ed8cf35063 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:16:11.611749 11729 ts_tablet_manager.cc:1905] T 7568f3c225e2490080635c5f9e2f33cb P 80b4717a476b4299bca7f9ed8cf35063: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:16:11.613268 11728 tablet_replica.cc:330] T 7568f3c225e2490080635c5f9e2f33cb P 472f971d03f34c50ba0baac2c5b876e8: stopping tablet replica
I20260811 08:16:11.613437 11728 raft_consensus.cc:2229] T 7568f3c225e2490080635c5f9e2f33cb P 472f971d03f34c50ba0baac2c5b876e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:16:11.613562 11729 ts_tablet_manager.cc:1918] T 7568f3c225e2490080635c5f9e2f33cb P 80b4717a476b4299bca7f9ed8cf35063: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:16:11.613620 11728 raft_consensus.cc:2258] T 7568f3c225e2490080635c5f9e2f33cb P 472f971d03f34c50ba0baac2c5b876e8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:16:11.613663 11729 log.cc:1196] T 7568f3c225e2490080635c5f9e2f33cb P 80b4717a476b4299bca7f9ed8cf35063: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/wal/wals/7568f3c225e2490080635c5f9e2f33cb
I20260811 08:16:11.613974 11729 ts_tablet_manager.cc:1939] T 7568f3c225e2490080635c5f9e2f33cb P 80b4717a476b4299bca7f9ed8cf35063: Deleting consensus metadata
I20260811 08:16:11.614545 10969 catalog_manager.cc:4841] TS 80b4717a476b4299bca7f9ed8cf35063 (127.20.158.131:45505): tablet 7568f3c225e2490080635c5f9e2f33cb (table test-table [id=78bb2aa5d370449996df395eda1ccb9d]) successfully deleted
I20260811 08:16:11.617094 11728 ts_tablet_manager.cc:1905] T 7568f3c225e2490080635c5f9e2f33cb P 472f971d03f34c50ba0baac2c5b876e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:16:11.618649 11728 ts_tablet_manager.cc:1918] T 7568f3c225e2490080635c5f9e2f33cb P 472f971d03f34c50ba0baac2c5b876e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:16:11.618722 11728 log.cc:1196] T 7568f3c225e2490080635c5f9e2f33cb P 472f971d03f34c50ba0baac2c5b876e8: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/wal/wals/7568f3c225e2490080635c5f9e2f33cb
I20260811 08:16:11.619040 11728 ts_tablet_manager.cc:1939] T 7568f3c225e2490080635c5f9e2f33cb P 472f971d03f34c50ba0baac2c5b876e8: Deleting consensus metadata
I20260811 08:16:11.619541 10969 catalog_manager.cc:4841] TS 472f971d03f34c50ba0baac2c5b876e8 (127.20.158.130:35493): tablet 7568f3c225e2490080635c5f9e2f33cb (table test-table [id=78bb2aa5d370449996df395eda1ccb9d]) successfully deleted
W20260811 08:16:11.621507 10967 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.158.129:45803 (error 108)
I20260811 08:16:11.622143 11691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:11.621988 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:45803 (local address 127.0.0.1:38154)
0811 08:16:11.622030 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:11.622104 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.129:45803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
I20260811 08:16:11.622248 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 11277
W20260811 08:16:11.622274 10967 catalog_manager.cc:4584] TS ef5370f6fa8646a7b2a055ced98f57de (127.20.158.129:45803): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 7568f3c225e2490080635c5f9e2f33cb: Network error: Client connection negotiation failed: client connection to 127.20.158.129:45803: connect: Connection refused (error 111)
I20260811 08:16:11.634958 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 11490
I20260811 08:16:11.653100 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 10941
I20260811 08:16:11.662886 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:42151
--webserver_interface=127.20.158.190
--webserver_port=38949
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:46487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:42151
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:16:11.748489 11732 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:11.748708 11732 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:11.748730 11732 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:11.749924 11732 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:16:11.749969 11732 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:11.749984 11732 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:11.749996 11732 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:16:11.750049 11732 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:16:11.751550 11732 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:46487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:42151
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:42151
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=38949
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11732
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:11.751813 11732 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:11.752069 11732 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:11.757319 11740 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:11.757309 11744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:11.757305 11739 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:11.757375 11732 server_base.cc:1034] running on GCE node
I20260811 08:16:11.757778 11732 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:11.758134 11732 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:11.759325 11732 hybrid_clock.cc:648] HybridClock initialized: now 1786436171759304 us; error 42 us; skew 500 ppm
Aug 11 08:16:11 dist-test-slave-gkw7 krb5kdc[10118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436171, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:11.762050 11732 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:16:11.762629 11732 webserver.cc:460] Webserver started at http://127.20.158.190:38949/ using document root <none> and password file <none>
I20260811 08:16:11.762909 11732 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:11.762987 11732 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:16:11.764503 11732 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:11.765198 11755 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:11.765398 11732 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:16:11.765496 11732 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "b1599434abf6461f8bee1df13434e025"
format_stamp: "Formatted at 2026-08-11 08:16:10 on dist-test-slave-gkw7"
server_key: "c8804c122295879cd63ca4c862eb5123"
server_key_iv: "a886805ccc82c68e347bdef1e6354387"
server_key_version: "encryptionkey@0"
I20260811 08:16:11.765947 11732 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:11.780339 11732 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:11.782538 11732 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:11.782713 11732 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:11.787176 11732 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:42151
I20260811 08:16:11.787211 11846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:42151 every 8 connection(s)
I20260811 08:16:11.787616 11732 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:16:11.788821 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 11732
I20260811 08:16:11.789151 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:45803
--local_ip_for_outbound_sockets=127.20.158.129
--tserver_master_addrs=127.20.158.190:42151
--webserver_port=41763
--webserver_interface=127.20.158.129
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:46487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:16:11.790359 11847 sys_catalog.cc:263] Verifying existing consensus state
I20260811 08:16:11.791078 11847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025: Bootstrap starting.
I20260811 08:16:11.800294 11847 log.cc:824] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025: Log is configured to *not* fsync() on all Append() calls
I20260811 08:16:11.802891 11847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:16:11.803265 11847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025: Bootstrap complete.
I20260811 08:16:11.805812 11847 raft_consensus.cc:348] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1599434abf6461f8bee1df13434e025" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42151 } }
I20260811 08:16:11.806110 11847 raft_consensus.cc:729] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: b1599434abf6461f8bee1df13434e025, State: Initialized, Role: FOLLOWER
I20260811 08:16:11.806344 11847 consensus_queue.cc:260] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1599434abf6461f8bee1df13434e025" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42151 } }
I20260811 08:16:11.806444 11847 raft_consensus.cc:388] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:16:11.806501 11847 raft_consensus.cc:482] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:16:11.806552 11847 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [term 2 FOLLOWER]: Advancing to term 3
I20260811 08:16:11.807583 11847 raft_consensus.cc:504] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1599434abf6461f8bee1df13434e025" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42151 } }
I20260811 08:16:11.807714 11847 leader_election.cc:302] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b1599434abf6461f8bee1df13434e025; no voters:
I20260811 08:16:11.807946 11847 leader_election.cc:288] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 08:16:11.807987 11856 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [term 3 FOLLOWER]: Leader election won for term 3
I20260811 08:16:11.808105 11856 raft_consensus.cc:686] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [term 3 LEADER]: Becoming Leader. State: Replica: b1599434abf6461f8bee1df13434e025, State: Running, Role: LEADER
I20260811 08:16:11.808235 11847 sys_catalog.cc:564] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:16:11.808209 11856 consensus_queue.cc:237] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1599434abf6461f8bee1df13434e025" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42151 } }
I20260811 08:16:11.808552 11857 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "b1599434abf6461f8bee1df13434e025" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1599434abf6461f8bee1df13434e025" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42151 } } }
I20260811 08:16:11.808555 11858 sys_catalog.cc:455] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b1599434abf6461f8bee1df13434e025. Latest consensus state: current_term: 3 leader_uuid: "b1599434abf6461f8bee1df13434e025" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b1599434abf6461f8bee1df13434e025" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42151 } } }
I20260811 08:16:11.808740 11857 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [sys.catalog]: This master's current role is: LEADER
I20260811 08:16:11.808763 11858 sys_catalog.cc:458] T 00000000000000000000000000000000 P b1599434abf6461f8bee1df13434e025 [sys.catalog]: This master's current role is: LEADER
I20260811 08:16:11.809835 11867 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:16:11.810698 11867 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:16:11.810791 11867 catalog_manager.cc:1259] Loaded cluster ID: 9623006999f947bdaf687f7d6d6935ad
I20260811 08:16:11.810812 11867 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260811 08:16:11.811008 11867 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fe50340f9ad google::LogMessage::Fail() at ??:0
@ 0x7fe50341288a google::LogMessage::SendToLog() at ??:0
@ 0x7fe50340f4de google::LogMessage::Flush() at ??:0
@ 0x7fe503410a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fe50b3340f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fe50b33d8b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fe5052dd0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fe5052d2954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fe5061366db start_thread at ??:0
@ 0x7fe501f0d61f clone at ??:0
W20260811 08:16:11.893162 11852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:11.893378 11852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:11.893401 11852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:11.894589 11852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:11.894635 11852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:11.894662 11852 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:16:11.896188 11852 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:46487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:45803
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=41763
--tserver_master_addrs=127.20.158.190:42151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11852
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:11.896436 11852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:11.896694 11852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:11.902012 11904 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:11.902036 11903 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:11.902241 11909 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:11.902464 11852 server_base.cc:1034] running on GCE node
I20260811 08:16:11.902671 11852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:11.902945 11852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:11.904167 11852 hybrid_clock.cc:648] HybridClock initialized: now 1786436171904129 us; error 53 us; skew 500 ppm
Aug 11 08:16:11 dist-test-slave-gkw7 krb5kdc[10118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436171, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:11.911379 11852 init.cc:377] Logged in from keytab as kudu/127.20.158.129@KRBTEST.COM (short username kudu)
I20260811 08:16:11.911913 11852 webserver.cc:460] Webserver started at http://127.20.158.129:41763/ using document root <none> and password file <none>
I20260811 08:16:11.912153 11852 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:11.912233 11852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:16:11.913707 11852 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:16:11.914491 11917 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:11.914690 11852 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:16:11.914803 11852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "ef5370f6fa8646a7b2a055ced98f57de"
format_stamp: "Formatted at 2026-08-11 08:16:10 on dist-test-slave-gkw7"
server_key: "803227b12d42491b8c0aed601de8c157"
server_key_iv: "08d3d0ebdd7664aee4587f098f96b39d"
server_key_version: "encryptionkey@0"
I20260811 08:16:11.915336 11852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:11.944865 11852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:11.947870 11852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:11.948052 11852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:11.948361 11852 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:16:11.948907 11928 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 08:16:11.950625 11852 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 08:16:11.950677 11852 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 08:16:11.950708 11852 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 08:16:11.951822 11852 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 08:16:11.951869 11852 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 08:16:11.951984 11928 tablet_bootstrap.cc:492] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de: Bootstrap starting.
I20260811 08:16:11.959434 11852 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:45803
I20260811 08:16:11.959921 11852 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:16:11.961817 12096 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:45803 every 8 connection(s)
I20260811 08:16:11.963382 11928 log.cc:824] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de: Log is configured to *not* fsync() on all Append() calls
I20260811 08:16:11.965685 11928 tablet_bootstrap.cc:492] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:16:11.965970 11928 tablet_bootstrap.cc:492] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de: Bootstrap complete.
I20260811 08:16:11.966266 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 11852
I20260811 08:16:11.966583 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:35493
--local_ip_for_outbound_sockets=127.20.158.130
--tserver_master_addrs=127.20.158.190:42151
--webserver_port=39699
--webserver_interface=127.20.158.130
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:46487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:16:11.967270 11928 ts_tablet_manager.cc:1397] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de: Time spent bootstrapping tablet: real 0.015s user 0.010s sys 0.003s
I20260811 08:16:11.968454 11928 raft_consensus.cc:348] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } }
I20260811 08:16:11.968850 11928 raft_consensus.cc:729] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef5370f6fa8646a7b2a055ced98f57de, State: Initialized, Role: FOLLOWER
I20260811 08:16:11.969041 11928 consensus_queue.cc:260] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } }
I20260811 08:16:11.969364 11928 ts_tablet_manager.cc:1428] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
W20260811 08:16:12.043862 12106 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:16:11.960662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.129:40625)
0811 08:16:11.960856 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:11.960904 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:11.961711 (+ 807us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:12.043639 (+ 81928us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":115,"threads_started":1}
W20260811 08:16:12.045989 12101 heartbeater.cc:644] Failed to heartbeat to 127.20.158.190:42151 (0 consecutive failures): Network error: Failed to ping master at 127.20.158.190:42151: Client connection negotiation failed: client connection to 127.20.158.190:42151: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 08:16:12.046437 12106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:12.046281 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.129:59079)
0811 08:16:12.046357 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:12.046406 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260811 08:16:12.046868 12106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:12.046763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.129:45037)
0811 08:16:12.046819 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:12.046847 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260811 08:16:12.047045 12101 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 08:16:12.080379 12108 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:12.080624 12108 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:12.080654 12108 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:12.082041 12108 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:12.082103 12108 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:12.082134 12108 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:16:12.083777 12108 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:46487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:35493
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=39699
--tserver_master_addrs=127.20.158.190:42151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12108
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:12.084069 12108 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:12.084365 12108 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:12.089759 12120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:12.089780 12116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:12.089759 12118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:12.090137 12108 server_base.cc:1034] running on GCE node
I20260811 08:16:12.090369 12108 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:12.090622 12108 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:12.091797 12108 hybrid_clock.cc:648] HybridClock initialized: now 1786436172091791 us; error 41 us; skew 500 ppm
Aug 11 08:16:12 dist-test-slave-gkw7 krb5kdc[10118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436172, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:12.094781 12108 init.cc:377] Logged in from keytab as kudu/127.20.158.130@KRBTEST.COM (short username kudu)
I20260811 08:16:12.095243 12108 webserver.cc:460] Webserver started at http://127.20.158.130:39699/ using document root <none> and password file <none>
I20260811 08:16:12.095476 12108 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:12.095525 12108 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:16:12.096961 12108 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:12.097676 12132 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:12.097893 12108 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:12.097990 12108 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "472f971d03f34c50ba0baac2c5b876e8"
format_stamp: "Formatted at 2026-08-11 08:16:10 on dist-test-slave-gkw7"
server_key: "a05b7ef1d98acce54b0f750715e244fb"
server_key_iv: "7a46cbcb74bb6b52624467063c20d491"
server_key_version: "encryptionkey@0"
I20260811 08:16:12.098451 12108 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:12.116545 12108 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:12.119174 12108 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:12.119369 12108 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:12.119643 12108 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:16:12.120007 12108 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:16:12.120074 12108 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:12.120119 12108 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:16:12.120148 12108 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:12.126986 12108 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:35493
I20260811 08:16:12.127034 12313 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:35493 every 8 connection(s)
I20260811 08:16:12.127456 12108 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
I20260811 08:16:12.128633 12316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:12.128226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.130:53857)
0811 08:16:12.128392 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:12.128477 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":72,"threads_started":1}
W20260811 08:16:12.129055 12314 heartbeater.cc:644] Failed to heartbeat to 127.20.158.190:42151 (0 consecutive failures): Network error: Failed to ping master at 127.20.158.190:42151: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
I20260811 08:16:12.129338 12316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:12.129242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.130:55569)
0811 08:16:12.129291 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:12.129320 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 08:16:12.129676 12316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:12.129572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.130:57975)
0811 08:16:12.129608 (+ 36us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:12.129637 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
W20260811 08:16:12.129849 12314 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 08:16:12.137418 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 12108
I20260811 08:16:12.137712 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:45505
--local_ip_for_outbound_sockets=127.20.158.131
--tserver_master_addrs=127.20.158.190:42151
--webserver_port=37811
--webserver_interface=127.20.158.131
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:46487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:16:12.222540 12317 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:12.222760 12317 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:12.222784 12317 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:12.224061 12317 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:12.224105 12317 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:12.224131 12317 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:16:12.225674 12317 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:46487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:45505
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=37811
--tserver_master_addrs=127.20.158.190:42151
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12317
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:12.225930 12317 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:12.226166 12317 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:12.231451 12325 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:12.231458 12326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:12.231458 12328 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:12.231771 12317 server_base.cc:1034] running on GCE node
I20260811 08:16:12.231990 12317 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:12.232231 12317 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:12.233381 12317 hybrid_clock.cc:648] HybridClock initialized: now 1786436172233365 us; error 36 us; skew 500 ppm
Aug 11 08:16:12 dist-test-slave-gkw7 krb5kdc[10118](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436172, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:12.235937 12317 init.cc:377] Logged in from keytab as kudu/127.20.158.131@KRBTEST.COM (short username kudu)
I20260811 08:16:12.236421 12317 webserver.cc:460] Webserver started at http://127.20.158.131:37811/ using document root <none> and password file <none>
I20260811 08:16:12.236611 12317 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:12.236661 12317 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:16:12.238065 12317 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:12.238726 12342 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:12.238965 12317 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:12.239063 12317 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "80b4717a476b4299bca7f9ed8cf35063"
format_stamp: "Formatted at 2026-08-11 08:16:10 on dist-test-slave-gkw7"
server_key: "d790e5cd87f3ce4453c552a6b9784c14"
server_key_iv: "37eebd4a37f2b4dacd0475ca832e4227"
server_key_version: "encryptionkey@0"
I20260811 08:16:12.239426 12317 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:12.250917 12317 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:12.252910 12317 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:12.253077 12317 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:12.253337 12317 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:16:12.253746 12317 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:16:12.253803 12317 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:12.253845 12317 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:16:12.253872 12317 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:12.260174 12317 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:45505
I20260811 08:16:12.260229 12516 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:45505 every 8 connection(s)
I20260811 08:16:12.260579 12317 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
I20260811 08:16:12.261698 12522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:12.261259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.131:57403)
0811 08:16:12.261428 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:12.261509 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":82,"threads_started":1}
W20260811 08:16:12.262156 12519 heartbeater.cc:644] Failed to heartbeat to 127.20.158.190:42151 (0 consecutive failures): Network error: Failed to ping master at 127.20.158.190:42151: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
I20260811 08:16:12.262452 12522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:12.262363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.131:59487)
0811 08:16:12.262407 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:12.262434 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
I20260811 08:16:12.262758 12522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:12.262680 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.131:52545)
0811 08:16:12.262721 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:12.262742 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260811 08:16:12.262882 12519 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 08:16:12.263743 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 12317
I20260811 08:16:13.047752 12527 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:13.047437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.129:60575)
0811 08:16:13.047645 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:13.047686 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":68,"threads_started":1}
I20260811 08:16:13.130455 12528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:13.130213 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.130:54733)
0811 08:16:13.130363 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:13.130404 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":61,"threads_started":1}
I20260811 08:16:13.263442 12529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:13.263226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.131:46381)
0811 08:16:13.263352 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:13.263390 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":60,"threads_started":1}
I20260811 08:16:13.807905 12530 raft_consensus.cc:482] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:16:13.808112 12530 raft_consensus.cc:504] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } }
I20260811 08:16:13.808496 12530 leader_election.cc:288] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 472f971d03f34c50ba0baac2c5b876e8 (127.20.158.130:35493), 80b4717a476b4299bca7f9ed8cf35063 (127.20.158.131:45505)
Aug 11 08:16:13 dist-test-slave-gkw7 krb5kdc[10118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436171, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for kudu/127.20.158.131@KRBTEST.COM
Aug 11 08:16:13 dist-test-slave-gkw7 krb5kdc[10118](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436171, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for kudu/127.20.158.130@KRBTEST.COM
I20260811 08:16:13.819639 12532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:13.808833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:35493 (local address 127.20.158.129:34517)
0811 08:16:13.808983 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:13.808995 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:13.809066 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:13.810168 (+ 1102us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:13.810171 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:13.810557 (+ 386us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:13.810758 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:13.810764 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:13.811979 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:13.811980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:13.812735 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:13.812737 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:13.813418 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:13.813419 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:13.813484 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:13.814167 (+ 683us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:13.814172 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:13.816002 (+ 1830us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:13.818047 (+ 2045us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:13.818048 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:13.818049 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:13.818294 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:13.818568 (+ 274us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:13.818569 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:13.818569 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:13.818669 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:13.819079 (+ 410us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:13.819085 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:13.819227 (+ 142us) client_negotiation.cc:769] Sending connection context
0811 08:16:13.819337 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 08:16:13.819517 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"mutex_wait_us":2,"thread_start_us":110,"threads_started":1}
I20260811 08:16:13.819739 12535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:13.809220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:58497 (local address 127.20.158.131:45505)
0811 08:16:13.809379 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:13.809388 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:13.809407 (+ 19us) server_negotiation.cc:407] Connection header received
0811 08:16:13.809900 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:13.809903 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:13.809941 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:13.810094 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:13.810899 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:13.811793 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:13.812865 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:13.813257 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:13.813336 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:13.815820 (+ 2484us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:13.815824 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:13.815842 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:13.815854 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:13.817876 (+ 2022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:13.818366 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:13.818369 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:13.818369 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:13.818466 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:13.818743 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:13.818744 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:13.818744 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:13.819019 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:13.819112 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:13.819465 (+ 353us) server_negotiation.cc:299] Negotiation successful
0811 08:16:13.819614 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":74,"threads_started":1}
I20260811 08:16:13.819770 12533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:13.808956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:34517 (local address 127.20.158.130:35493)
0811 08:16:13.809256 (+ 300us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:13.809271 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:13.809298 (+ 27us) server_negotiation.cc:407] Connection header received
0811 08:16:13.809877 (+ 579us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:13.809881 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:13.809928 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:13.810081 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:13.810901 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:13.811886 (+ 985us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:13.812824 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:13.813320 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:13.813438 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:13.816107 (+ 2669us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:13.816110 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:13.816111 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:13.816121 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:13.817955 (+ 1834us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:13.818389 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:13.818392 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:13.818393 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:13.818483 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:13.818736 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:13.818737 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:13.818738 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:13.818992 (+ 254us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:13.819085 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:13.819393 (+ 308us) server_negotiation.cc:299] Negotiation successful
0811 08:16:13.819626 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":254,"thread_start_us":69,"threads_started":1}
I20260811 08:16:13.820091 12534 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:13.809068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:45505 (local address 127.20.158.129:58497)
0811 08:16:13.809234 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:13.809246 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:13.809314 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:13.810169 (+ 855us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:13.810172 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:13.810557 (+ 385us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:13.810758 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:13.810764 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:13.811905 (+ 1141us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:13.811906 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:13.812736 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:13.812739 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:13.813356 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:13.813357 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:13.813479 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:13.814101 (+ 622us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:13.814109 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:13.815670 (+ 1561us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:13.817982 (+ 2312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:13.817989 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:13.817991 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:13.818264 (+ 273us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:13.818552 (+ 288us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:13.818553 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:13.818553 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:13.818665 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:13.819104 (+ 439us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:13.819105 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:13.819242 (+ 137us) client_negotiation.cc:769] Sending connection context
0811 08:16:13.819339 (+ 97us) client_negotiation.cc:240] Negotiation successful
0811 08:16:13.820036 (+ 697us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"mutex_wait_us":666,"thread_start_us":71,"threads_started":1}
W20260811 08:16:13.821008 11923 leader_election.cc:341] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 472f971d03f34c50ba0baac2c5b876e8 (127.20.158.130:35493): Not found: Tablet not found: 7568f3c225e2490080635c5f9e2f33cb
W20260811 08:16:13.821106 11923 leader_election.cc:341] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 80b4717a476b4299bca7f9ed8cf35063 (127.20.158.131:45505): Not found: Tablet not found: 7568f3c225e2490080635c5f9e2f33cb
I20260811 08:16:13.821164 11923 leader_election.cc:302] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5370f6fa8646a7b2a055ced98f57de; no voters: 472f971d03f34c50ba0baac2c5b876e8, 80b4717a476b4299bca7f9ed8cf35063
I20260811 08:16:13.821346 12530 raft_consensus.cc:2726] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 08:16:14.048524 12532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:14.048352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.129:59627)
0811 08:16:14.048428 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:14.048479 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
I20260811 08:16:14.131330 12536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:14.131078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.130:46613)
0811 08:16:14.131231 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:14.131284 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":81,"threads_started":1}
I20260811 08:16:14.264271 12538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:14.263935 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.131:54235)
0811 08:16:14.264092 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:14.264200 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":64,"threads_started":1}
I20260811 08:16:15.049499 12539 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:15.049246 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.129:60265)
0811 08:16:15.049404 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:15.049451 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":70,"threads_started":1}
I20260811 08:16:15.132102 12540 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:15.131864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.130:49019)
0811 08:16:15.132002 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:15.132048 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":65,"threads_started":1}
I20260811 08:16:15.265009 12542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:15.264766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.131:55997)
0811 08:16:15.264920 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:15.264966 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":65,"threads_started":1}
I20260811 08:16:15.376621 12544 raft_consensus.cc:482] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:16:15.376734 12544 raft_consensus.cc:504] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } }
I20260811 08:16:15.376902 12544 leader_election.cc:288] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 472f971d03f34c50ba0baac2c5b876e8 (127.20.158.130:35493), 80b4717a476b4299bca7f9ed8cf35063 (127.20.158.131:45505)
W20260811 08:16:15.377496 11923 leader_election.cc:341] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 80b4717a476b4299bca7f9ed8cf35063 (127.20.158.131:45505): Not found: Tablet not found: 7568f3c225e2490080635c5f9e2f33cb
W20260811 08:16:15.377626 11923 leader_election.cc:341] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 472f971d03f34c50ba0baac2c5b876e8 (127.20.158.130:35493): Not found: Tablet not found: 7568f3c225e2490080635c5f9e2f33cb
I20260811 08:16:15.377646 11923 leader_election.cc:302] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5370f6fa8646a7b2a055ced98f57de; no voters: 472f971d03f34c50ba0baac2c5b876e8, 80b4717a476b4299bca7f9ed8cf35063
I20260811 08:16:15.377729 12544 raft_consensus.cc:2726] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 08:16:16.050438 12545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:16.050139 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.129:51295)
0811 08:16:16.050340 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:16.050389 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175,"thread_start_us":77,"threads_started":1}
I20260811 08:16:16.132925 12547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:16.132642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.130:53895)
0811 08:16:16.132806 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:16.132855 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":81,"threads_started":1}
I20260811 08:16:16.265930 12549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:16.265668 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.131:34629)
0811 08:16:16.265842 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:16.265884 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":82,"threads_started":1}
I20260811 08:16:17.051399 12550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:17.051153 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.129:44777)
0811 08:16:17.051310 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:17.051352 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":67,"threads_started":1}
I20260811 08:16:17.133966 12551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:17.133656 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.130:35215)
0811 08:16:17.133872 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:17.133921 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":117,"threads_started":1}
I20260811 08:16:17.266710 12552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:17.266443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.131:46497)
0811 08:16:17.266609 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:17.266660 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":67,"threads_started":1}
I20260811 08:16:18.052224 12553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:18.051980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.129:46867)
0811 08:16:18.052120 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:18.052167 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":73,"threads_started":1}
I20260811 08:16:18.134668 12554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:18.134451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.130:58871)
0811 08:16:18.134579 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:18.134620 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":63,"threads_started":1}
I20260811 08:16:18.267551 12555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:18.267338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.131:44859)
0811 08:16:18.267470 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:18.267511 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":80,"threads_started":1}
I20260811 08:16:18.373441 12556 raft_consensus.cc:482] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:16:18.373610 12556 raft_consensus.cc:504] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } }
I20260811 08:16:18.373795 12556 leader_election.cc:288] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 472f971d03f34c50ba0baac2c5b876e8 (127.20.158.130:35493), 80b4717a476b4299bca7f9ed8cf35063 (127.20.158.131:45505)
W20260811 08:16:18.374293 11923 leader_election.cc:341] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 472f971d03f34c50ba0baac2c5b876e8 (127.20.158.130:35493): Not found: Tablet not found: 7568f3c225e2490080635c5f9e2f33cb
W20260811 08:16:18.374385 11923 leader_election.cc:341] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 80b4717a476b4299bca7f9ed8cf35063 (127.20.158.131:45505): Not found: Tablet not found: 7568f3c225e2490080635c5f9e2f33cb
I20260811 08:16:18.374404 11923 leader_election.cc:302] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5370f6fa8646a7b2a055ced98f57de; no voters: 472f971d03f34c50ba0baac2c5b876e8, 80b4717a476b4299bca7f9ed8cf35063
I20260811 08:16:18.374477 12556 raft_consensus.cc:2726] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 08:16:19.053071 12558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:19.052778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.129:58589)
0811 08:16:19.052951 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:19.053004 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":80,"threads_started":1}
I20260811 08:16:19.135440 12559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:19.135229 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.130:54067)
0811 08:16:19.135360 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:19.135395 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":64,"threads_started":1}
I20260811 08:16:19.268268 12560 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:19.268023 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.131:58263)
0811 08:16:19.268181 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:19.268222 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":116,"threads_started":1}
I20260811 08:16:20.053925 12561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:20.053682 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.129:49825)
0811 08:16:20.053839 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:20.053880 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":83,"threads_started":1}
I20260811 08:16:20.136196 12563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:20.135970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.130:54093)
0811 08:16:20.136109 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:20.136152 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":65,"threads_started":1}
I20260811 08:16:20.269047 12565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:20.268806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.131:56965)
0811 08:16:20.268960 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:20.269001 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":89,"threads_started":1}
I20260811 08:16:21.054769 12567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:21.054508 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.129:50015)
0811 08:16:21.054654 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:21.054701 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":70,"threads_started":1}
I20260811 08:16:21.137072 12569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:21.136812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.130:57777)
0811 08:16:21.136975 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:21.137023 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":95,"threads_started":1}
I20260811 08:16:21.269850 12570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:21.269640 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.131:47419)
0811 08:16:21.269767 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:21.269805 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":61,"threads_started":1}
I20260811 08:16:22.055784 12571 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:22.055521 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.129:51239)
0811 08:16:22.055693 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:22.055736 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":82,"threads_started":1}
I20260811 08:16:22.137912 12572 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:22.137672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.130:37831)
0811 08:16:22.137818 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:22.137860 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":85,"threads_started":1}
I20260811 08:16:22.270571 12573 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:22.270315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.131:55749)
0811 08:16:22.270482 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:22.270523 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":65,"threads_started":1}
I20260811 08:16:22.938764 12574 raft_consensus.cc:482] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:16:22.938882 12574 raft_consensus.cc:504] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "472f971d03f34c50ba0baac2c5b876e8" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 35493 } } peers { permanent_uuid: "80b4717a476b4299bca7f9ed8cf35063" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 45505 } } peers { permanent_uuid: "ef5370f6fa8646a7b2a055ced98f57de" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45803 } }
I20260811 08:16:22.939093 12574 leader_election.cc:288] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 472f971d03f34c50ba0baac2c5b876e8 (127.20.158.130:35493), 80b4717a476b4299bca7f9ed8cf35063 (127.20.158.131:45505)
W20260811 08:16:22.939548 11923 leader_election.cc:341] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 80b4717a476b4299bca7f9ed8cf35063 (127.20.158.131:45505): Not found: Tablet not found: 7568f3c225e2490080635c5f9e2f33cb
W20260811 08:16:22.939668 11923 leader_election.cc:341] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 472f971d03f34c50ba0baac2c5b876e8 (127.20.158.130:35493): Not found: Tablet not found: 7568f3c225e2490080635c5f9e2f33cb
I20260811 08:16:22.939705 11923 leader_election.cc:302] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef5370f6fa8646a7b2a055ced98f57de; no voters: 472f971d03f34c50ba0baac2c5b876e8, 80b4717a476b4299bca7f9ed8cf35063
I20260811 08:16:22.939801 12574 raft_consensus.cc:2726] T 7568f3c225e2490080635c5f9e2f33cb P ef5370f6fa8646a7b2a055ced98f57de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 08:16:23.056658 12575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:23.056400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.129:39323)
0811 08:16:23.056556 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:23.056606 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":70,"threads_started":1}
I20260811 08:16:23.138648 12576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:23.138400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.130:55893)
0811 08:16:23.138535 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:23.138577 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":64,"threads_started":1}
I20260811 08:16:23.271428 12579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:23.271175 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.131:36875)
0811 08:16:23.271340 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:23.271383 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":85,"threads_started":1}
I20260811 08:16:24.057490 12582 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:24.057260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.129:58699)
0811 08:16:24.057406 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:24.057443 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":70,"threads_started":1}
I20260811 08:16:24.139479 12584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:24.139199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.130:41997)
0811 08:16:24.139367 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:24.139428 (+ 61us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":75,"threads_started":1}
I20260811 08:16:24.272213 12586 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:24.271962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.131:55823)
0811 08:16:24.272127 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:24.272167 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":107,"threads_started":1}
I20260811 08:16:25.058372 12587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:25.058095 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.129:35287)
0811 08:16:25.058273 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:25.058321 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":74,"threads_started":1}
I20260811 08:16:25.140225 12588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:25.139967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.130:59179)
0811 08:16:25.140115 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:25.140178 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":62,"threads_started":1}
I20260811 08:16:25.273335 12589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:25.272992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.131:45539)
0811 08:16:25.273207 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:25.273263 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189,"thread_start_us":134,"threads_started":1}
I20260811 08:16:26.059176 12591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:26.058907 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.129:50733)
0811 08:16:26.059074 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:26.059121 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":89,"threads_started":1}
I20260811 08:16:26.141021 12592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:26.140765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.130:58687)
0811 08:16:26.140931 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:26.140974 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":95,"threads_started":1}
I20260811 08:16:26.274114 12593 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:26.273880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.131:38681)
0811 08:16:26.274025 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:26.274063 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":78,"threads_started":1}
I20260811 08:16:27.060155 12594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:27.059903 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.129:47451)
0811 08:16:27.060051 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:27.060101 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":64,"threads_started":1}
I20260811 08:16:27.142088 12596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:27.141776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.130:46807)
0811 08:16:27.141948 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:27.141995 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":88,"threads_started":1}
I20260811 08:16:27.273082 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 11852
I20260811 08:16:27.279117 12597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:27.278896 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:42151 (local address 127.20.158.131:42739)
0811 08:16:27.279024 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:27.279058 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:42151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":75,"threads_started":1}
I20260811 08:16:27.285017 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 12108
I20260811 08:16:27.298306 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 12317
2026-08-11T08:16:27Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18659 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:16:27 dist-test-slave-gkw7 krb5kdc[12602](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:16:27 dist-test-slave-gkw7 krb5kdc[12602](info): set up 2 sockets
Aug 11 08:16:27 dist-test-slave-gkw7 krb5kdc[12602](info): commencing operation
krb5kdc: starting...
W20260811 08:16:28.570798 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.247s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:16:28 dist-test-slave-gkw7 krb5kdc[12602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436188, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:16:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:16:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:16:28.701051 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:38617
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:37253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:38617
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:16:28.787185 12622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:28.787444 12622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:28.787482 12622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:28.788614 12622 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 08:16:28.788683 12622 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 08:16:28.788705 12622 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 08:16:28.788723 12622 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:16:28.788758 12622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:28.788786 12622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:28.788815 12622 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:16:28.788838 12622 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:16:28.790387 12622 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:37253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:38617
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:38617
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12622
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:28.790686 12622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:28.790930 12622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:16:28.796455 12622 server_base.cc:1034] running on GCE node
W20260811 08:16:28.796557 12633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:28.796571 12638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:28.796710 12640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:28.796998 12622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:28.797328 12622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:28.798503 12622 hybrid_clock.cc:648] HybridClock initialized: now 1786436188798465 us; error 49 us; skew 500 ppm
Aug 11 08:16:28 dist-test-slave-gkw7 krb5kdc[12602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436188, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:28.801205 12622 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:16:28.801760 12622 webserver.cc:460] Webserver started at http://127.20.158.190:40649/ using document root <none> and password file <none>
I20260811 08:16:28.802011 12622 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:28.802081 12622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:16:28.802237 12622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:16:28.803323 12622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "8b8244231d1c4c4aad6f7c454cf833df"
format_stamp: "Formatted at 2026-08-11 08:16:28 on dist-test-slave-gkw7"
server_key: "a57b1c0386b0ad69b94ff9312fae32db"
server_key_iv: "cd10224d95f8c0de439cb4fa43fa2427"
server_key_version: "encryptionkey@0"
I20260811 08:16:28.803709 12622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "8b8244231d1c4c4aad6f7c454cf833df"
format_stamp: "Formatted at 2026-08-11 08:16:28 on dist-test-slave-gkw7"
server_key: "a57b1c0386b0ad69b94ff9312fae32db"
server_key_iv: "cd10224d95f8c0de439cb4fa43fa2427"
server_key_version: "encryptionkey@0"
I20260811 08:16:28.805087 12622 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:16:28.805967 12653 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:28.806174 12622 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:16:28.806294 12622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "8b8244231d1c4c4aad6f7c454cf833df"
format_stamp: "Formatted at 2026-08-11 08:16:28 on dist-test-slave-gkw7"
server_key: "a57b1c0386b0ad69b94ff9312fae32db"
server_key_iv: "cd10224d95f8c0de439cb4fa43fa2427"
server_key_version: "encryptionkey@0"
I20260811 08:16:28.806372 12622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:28.826411 12622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:28.828999 12622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:28.829180 12622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:28.833731 12622 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:38617
I20260811 08:16:28.833777 12736 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:38617 every 8 connection(s)
I20260811 08:16:28.834173 12622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:16:28.835096 12737 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:16:28.837376 12737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df: Bootstrap starting.
I20260811 08:16:28.837445 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 12622
I20260811 08:16:28.837572 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:16:28.837778 21114 external_mini_cluster.cc:1428] Setting key 8f513629ac9a87439365d31b058418f1
I20260811 08:16:28.838181 12737 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df: Neither blocks nor log segments found. Creating new log.
I20260811 08:16:28.838557 12737 log.cc:824] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df: Log is configured to *not* fsync() on all Append() calls
I20260811 08:16:28.839375 12737 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df: No bootstrap required, opened a new log
I20260811 08:16:28.841835 12737 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8244231d1c4c4aad6f7c454cf833df" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38617 } }
I20260811 08:16:28.842021 12737 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:16:28.842067 12737 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b8244231d1c4c4aad6f7c454cf833df, State: Initialized, Role: FOLLOWER
I20260811 08:16:28.842231 12737 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8244231d1c4c4aad6f7c454cf833df" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38617 } }
I20260811 08:16:28.842309 12737 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:16:28.842334 12737 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:16:28.842401 12737 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:16:28.843037 12737 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8244231d1c4c4aad6f7c454cf833df" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38617 } }
I20260811 08:16:28.843142 12737 leader_election.cc:302] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b8244231d1c4c4aad6f7c454cf833df; no voters:
I20260811 08:16:28.843307 12737 leader_election.cc:288] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:16:28.843392 12756 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:16:28.843580 12737 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:16:28.843608 12756 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [term 1 LEADER]: Becoming Leader. State: Replica: 8b8244231d1c4c4aad6f7c454cf833df, State: Running, Role: LEADER
I20260811 08:16:28.843809 12756 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8244231d1c4c4aad6f7c454cf833df" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38617 } }
I20260811 08:16:28.844296 12757 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8b8244231d1c4c4aad6f7c454cf833df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8244231d1c4c4aad6f7c454cf833df" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38617 } } }
I20260811 08:16:28.844386 12757 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [sys.catalog]: This master's current role is: LEADER
I20260811 08:16:28.844635 12772 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:16:28.844921 12758 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b8244231d1c4c4aad6f7c454cf833df. Latest consensus state: current_term: 1 leader_uuid: "8b8244231d1c4c4aad6f7c454cf833df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8244231d1c4c4aad6f7c454cf833df" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38617 } } }
I20260811 08:16:28.845091 12758 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [sys.catalog]: This master's current role is: LEADER
I20260811 08:16:28.845253 12772 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 08:16:28 dist-test-slave-gkw7 krb5kdc[12602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436188, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:16:28.847263 12772 catalog_manager.cc:1347] Generated new cluster ID: 7dbfc7cacaac41969a87505b86607ad3
I20260811 08:16:28.847348 12772 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:16:28.851018 12748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:28.838456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57692 (local address 127.20.158.190:38617)
0811 08:16:28.838705 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:28.838715 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:28.838756 (+ 41us) server_negotiation.cc:407] Connection header received
0811 08:16:28.839316 (+ 560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:28.839326 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:28.839388 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:28.839591 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:28.840341 (+ 750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:28.841873 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:28.842965 (+ 1092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:28.843622 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:28.844115 (+ 493us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:28.846956 (+ 2841us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:28.846961 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:28.846961 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:28.846976 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:28.849200 (+ 2224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:28.849655 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:28.849660 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:28.849660 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:28.849784 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:28.850013 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:28.850014 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:28.850015 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:28.850361 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:28.850529 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:28.850611 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 08:16:28.850777 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":121,"threads_started":1}
I20260811 08:16:28.853911 12772 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:16:28.854676 12772 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:16:28.859266 12772 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df: Generated new TSK 0
I20260811 08:16:28.859473 12772 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.158.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
I20260811 08:16:28.892189 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:0
--local_ip_for_outbound_sockets=127.20.158.129
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:38617
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:37253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:16:28.986756 12785 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:28.987017 12785 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:28.987066 12785 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:28.988370 12785 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:28.988440 12785 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:28.988490 12785 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:16:28.990219 12785 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:37253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:38617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12785
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:28.990512 12785 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:28.990777 12785 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:28.996551 12796 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:28.996592 12795 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:28.996577 12798 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:28.996830 12785 server_base.cc:1034] running on GCE node
I20260811 08:16:28.997097 12785 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:28.997375 12785 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:28.998565 12785 hybrid_clock.cc:648] HybridClock initialized: now 1786436188998543 us; error 33 us; skew 500 ppm
Aug 11 08:16:28 dist-test-slave-gkw7 krb5kdc[12602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436188, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:29.001446 12785 init.cc:377] Logged in from keytab as kudu/127.20.158.129@KRBTEST.COM (short username kudu)
I20260811 08:16:29.001992 12785 webserver.cc:460] Webserver started at http://127.20.158.129:46383/ using document root <none> and password file <none>
I20260811 08:16:29.002279 12785 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:29.002358 12785 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:16:29.002521 12785 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:16:29.003736 12785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/data/instance:
uuid: "53c154683fce4bb3ae4f8abb0ca372ab"
format_stamp: "Formatted at 2026-08-11 08:16:28 on dist-test-slave-gkw7"
server_key: "620179adc743f31ccd7e26041d4ef5a4"
server_key_iv: "a0663d1c683eec122aebfda50bd2ee28"
server_key_version: "encryptionkey@0"
I20260811 08:16:29.004151 12785 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance:
uuid: "53c154683fce4bb3ae4f8abb0ca372ab"
format_stamp: "Formatted at 2026-08-11 08:16:28 on dist-test-slave-gkw7"
server_key: "620179adc743f31ccd7e26041d4ef5a4"
server_key_iv: "a0663d1c683eec122aebfda50bd2ee28"
server_key_version: "encryptionkey@0"
I20260811 08:16:29.005674 12785 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:16:29.006587 12809 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:29.006778 12785 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:29.006891 12785 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "53c154683fce4bb3ae4f8abb0ca372ab"
format_stamp: "Formatted at 2026-08-11 08:16:28 on dist-test-slave-gkw7"
server_key: "620179adc743f31ccd7e26041d4ef5a4"
server_key_iv: "a0663d1c683eec122aebfda50bd2ee28"
server_key_version: "encryptionkey@0"
I20260811 08:16:29.006978 12785 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:29.030854 12785 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:29.033007 12785 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:29.033206 12785 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:29.033468 12785 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:16:29.033839 12785 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:16:29.033900 12785 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:29.033937 12785 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:16:29.033967 12785 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:29.040179 12785 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:44133
I20260811 08:16:29.040225 12980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:44133 every 8 connection(s)
I20260811 08:16:29.040550 12785 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
Aug 11 08:16:29 dist-test-slave-gkw7 krb5kdc[12602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436188, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:16:29.048998 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 12785
I20260811 08:16:29.049190 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance
I20260811 08:16:29.049474 21114 external_mini_cluster.cc:1428] Setting key 482b5387ed69d936e7540c2e3764df8e
I20260811 08:16:29.051075 12748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:29.041351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:58343 (local address 127.20.158.190:38617)
0811 08:16:29.041431 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:29.041433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:29.041685 (+ 252us) server_negotiation.cc:407] Connection header received
0811 08:16:29.042172 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:29.042173 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:29.042182 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:29.042243 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:29.043190 (+ 947us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.043830 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.044954 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.045192 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.045253 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:29.047669 (+ 2416us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:29.047671 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:29.047672 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:29.047680 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:29.049303 (+ 1623us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:29.049924 (+ 621us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:29.049926 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:29.049926 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:29.049998 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:29.050334 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:29.050335 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:29.050335 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:29.050473 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:29.050527 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:29.050929 (+ 402us) server_negotiation.cc:299] Negotiation successful
0811 08:16:29.051007 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260811 08:16:29.051421 12984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:29.041313 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.129:58343)
0811 08:16:29.041518 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:29.041580 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:29.042085 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:29.042296 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:29.042300 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:29.042896 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:29.043092 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:29.043096 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.043926 (+ 830us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.043928 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:29.044874 (+ 946us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:29.044877 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.045305 (+ 428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.045306 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:29.045433 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:29.045955 (+ 522us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:29.045967 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:29.047555 (+ 1588us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:29.049401 (+ 1846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:29.049410 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:29.049413 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:29.049829 (+ 416us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:29.050071 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:29.050072 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:29.050072 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:29.050242 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:29.050545 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:29.050553 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:29.050762 (+ 209us) client_negotiation.cc:769] Sending connection context
0811 08:16:29.050892 (+ 130us) client_negotiation.cc:240] Negotiation successful
0811 08:16:29.051100 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":116,"threads_started":1}
I20260811 08:16:29.052021 12982 heartbeater.cc:347] Connected to a master server at 127.20.158.190:38617
I20260811 08:16:29.052120 12982 heartbeater.cc:464] Registering TS with master...
I20260811 08:16:29.052332 12982 heartbeater.cc:511] Master 127.20.158.190:38617 requested a full tablet report, sending...
I20260811 08:16:29.052896 12679 ts_manager.cc:194] Registered new tserver with Master: 53c154683fce4bb3ae4f8abb0ca372ab (127.20.158.129:44133)
I20260811 08:16:29.053517 12679 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.129@KRBTEST.COM'} at 127.20.158.129:58343
WARNING: no policy specified for kudu/127.20.158.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
I20260811 08:16:29.076562 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:0
--local_ip_for_outbound_sockets=127.20.158.130
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:38617
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:37253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:16:29.164041 12988 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:29.164312 12988 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:29.164352 12988 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:29.165561 12988 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:29.165635 12988 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:29.165678 12988 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:16:29.167210 12988 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:37253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:38617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12988
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:29.167514 12988 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:29.167768 12988 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:29.173185 12998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:29.173207 13001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:29.173461 12988 server_base.cc:1034] running on GCE node
W20260811 08:16:29.173185 12997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:29.173839 12988 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:29.174108 12988 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:29.175288 12988 hybrid_clock.cc:648] HybridClock initialized: now 1786436189175274 us; error 48 us; skew 500 ppm
Aug 11 08:16:29 dist-test-slave-gkw7 krb5kdc[12602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436189, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:29.178180 12988 init.cc:377] Logged in from keytab as kudu/127.20.158.130@KRBTEST.COM (short username kudu)
I20260811 08:16:29.178679 12988 webserver.cc:460] Webserver started at http://127.20.158.130:43371/ using document root <none> and password file <none>
I20260811 08:16:29.178928 12988 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:29.178980 12988 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:16:29.179172 12988 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:16:29.180315 12988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/data/instance:
uuid: "844793d7f02646ffa042a3888f11ccbc"
format_stamp: "Formatted at 2026-08-11 08:16:29 on dist-test-slave-gkw7"
server_key: "25abb781201d38825fd3cf8a309a3601"
server_key_iv: "2b3598f9be7a6c3219be666a7c0f103c"
server_key_version: "encryptionkey@0"
I20260811 08:16:29.180719 12988 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance:
uuid: "844793d7f02646ffa042a3888f11ccbc"
format_stamp: "Formatted at 2026-08-11 08:16:29 on dist-test-slave-gkw7"
server_key: "25abb781201d38825fd3cf8a309a3601"
server_key_iv: "2b3598f9be7a6c3219be666a7c0f103c"
server_key_version: "encryptionkey@0"
I20260811 08:16:29.182418 12988 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:16:29.183296 13012 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:29.183552 12988 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:16:29.183730 12988 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "844793d7f02646ffa042a3888f11ccbc"
format_stamp: "Formatted at 2026-08-11 08:16:29 on dist-test-slave-gkw7"
server_key: "25abb781201d38825fd3cf8a309a3601"
server_key_iv: "2b3598f9be7a6c3219be666a7c0f103c"
server_key_version: "encryptionkey@0"
I20260811 08:16:29.183836 12988 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:29.204339 12988 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:29.206841 12988 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:29.207012 12988 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:29.207288 12988 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:16:29.207619 12988 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:16:29.207675 12988 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:29.207720 12988 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:16:29.207758 12988 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:29.214203 12988 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:36933
I20260811 08:16:29.214246 13185 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:36933 every 8 connection(s)
I20260811 08:16:29.214604 12988 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
Aug 11 08:16:29 dist-test-slave-gkw7 krb5kdc[12602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436189, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:16:29.222594 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 12988
I20260811 08:16:29.222728 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance
I20260811 08:16:29.222929 21114 external_mini_cluster.cc:1428] Setting key 0f819dab0a3712a875f9e5a01ab01c2b
I20260811 08:16:29.224310 12748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:29.215377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:50913 (local address 127.20.158.190:38617)
0811 08:16:29.215424 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:29.215426 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:29.215659 (+ 233us) server_negotiation.cc:407] Connection header received
0811 08:16:29.216214 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:29.216215 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:29.216228 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:29.216293 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:29.217278 (+ 985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.217847 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.218986 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.219192 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.219271 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:29.221405 (+ 2134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:29.221407 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:29.221408 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:29.221416 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:29.222832 (+ 1416us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:29.223287 (+ 455us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:29.223288 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:29.223289 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:29.223357 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:29.223617 (+ 260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:29.223618 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:29.223618 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:29.223740 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:29.223819 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:29.224130 (+ 311us) server_negotiation.cc:299] Negotiation successful
0811 08:16:29.224215 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:16:29.224521 13189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:29.215351 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.130:50913)
0811 08:16:29.215530 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:29.215569 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:29.216100 (+ 531us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:29.216363 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:29.216368 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:29.216961 (+ 593us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:29.217172 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:29.217177 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.217947 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.217949 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:29.218884 (+ 935us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:29.218887 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.219279 (+ 392us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.219280 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:29.219418 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:29.219892 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:29.219901 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:29.221304 (+ 1403us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:29.222907 (+ 1603us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:29.222915 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:29.222917 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:29.223206 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:29.223427 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:29.223428 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:29.223429 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:29.223544 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:29.223811 (+ 267us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:29.223818 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:29.223968 (+ 150us) client_negotiation.cc:769] Sending connection context
0811 08:16:29.224107 (+ 139us) client_negotiation.cc:240] Negotiation successful
0811 08:16:29.224275 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":86,"threads_started":1}
I20260811 08:16:29.224995 13187 heartbeater.cc:347] Connected to a master server at 127.20.158.190:38617
I20260811 08:16:29.225092 13187 heartbeater.cc:464] Registering TS with master...
I20260811 08:16:29.225332 13187 heartbeater.cc:511] Master 127.20.158.190:38617 requested a full tablet report, sending...
I20260811 08:16:29.225812 12679 ts_manager.cc:194] Registered new tserver with Master: 844793d7f02646ffa042a3888f11ccbc (127.20.158.130:36933)
I20260811 08:16:29.226217 12679 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.130@KRBTEST.COM'} at 127.20.158.130:50913
WARNING: no policy specified for kudu/127.20.158.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
I20260811 08:16:29.252079 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:0
--local_ip_for_outbound_sockets=127.20.158.131
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:38617
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:37253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:16:29.350167 13192 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:29.350435 13192 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:29.350482 13192 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:29.351811 13192 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:29.351888 13192 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:29.351943 13192 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:16:29.353662 13192 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:37253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:38617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13192
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:29.353967 13192 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:29.354229 13192 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:29.359879 13202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:29.359928 13205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:29.359880 13199 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:29.360056 13192 server_base.cc:1034] running on GCE node
I20260811 08:16:29.360337 13192 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:29.360548 13192 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:29.361699 13192 hybrid_clock.cc:648] HybridClock initialized: now 1786436189361673 us; error 48 us; skew 500 ppm
Aug 11 08:16:29 dist-test-slave-gkw7 krb5kdc[12602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436189, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:29.364465 13192 init.cc:377] Logged in from keytab as kudu/127.20.158.131@KRBTEST.COM (short username kudu)
I20260811 08:16:29.364912 13192 webserver.cc:460] Webserver started at http://127.20.158.131:34915/ using document root <none> and password file <none>
I20260811 08:16:29.365154 13192 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:29.365197 13192 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:16:29.365360 13192 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:16:29.366441 13192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/data/instance:
uuid: "bedb5adb9c09417eab890cd89e0085dd"
format_stamp: "Formatted at 2026-08-11 08:16:29 on dist-test-slave-gkw7"
server_key: "9136ab82d006c9569d08343a23ac6e42"
server_key_iv: "45b49049f728931510941b0b67fc2559"
server_key_version: "encryptionkey@0"
I20260811 08:16:29.366806 13192 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance:
uuid: "bedb5adb9c09417eab890cd89e0085dd"
format_stamp: "Formatted at 2026-08-11 08:16:29 on dist-test-slave-gkw7"
server_key: "9136ab82d006c9569d08343a23ac6e42"
server_key_iv: "45b49049f728931510941b0b67fc2559"
server_key_version: "encryptionkey@0"
I20260811 08:16:29.368257 13192 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:16:29.368966 13214 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:29.369184 13192 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:16:29.369257 13192 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "bedb5adb9c09417eab890cd89e0085dd"
format_stamp: "Formatted at 2026-08-11 08:16:29 on dist-test-slave-gkw7"
server_key: "9136ab82d006c9569d08343a23ac6e42"
server_key_iv: "45b49049f728931510941b0b67fc2559"
server_key_version: "encryptionkey@0"
I20260811 08:16:29.369303 13192 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:29.381399 13192 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:29.383802 13192 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:29.383956 13192 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:29.384200 13192 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:16:29.384537 13192 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:16:29.384595 13192 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:29.384635 13192 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:16:29.384663 13192 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:29.390872 13192 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:46457
I20260811 08:16:29.390964 13377 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:46457 every 8 connection(s)
I20260811 08:16:29.391273 13192 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
Aug 11 08:16:29 dist-test-slave-gkw7 krb5kdc[12602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436189, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:16:29.398237 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 13192
I20260811 08:16:29.398350 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance
I20260811 08:16:29.398537 21114 external_mini_cluster.cc:1428] Setting key bb1c81a8fa2ce37cb7221e1009864468
I20260811 08:16:29.400825 12748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:29.392033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:54847 (local address 127.20.158.190:38617)
0811 08:16:29.392102 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:29.392104 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:29.392300 (+ 196us) server_negotiation.cc:407] Connection header received
0811 08:16:29.392765 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:29.392767 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:29.392777 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:29.392826 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:29.393843 (+ 1017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.394343 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.395385 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.395747 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.395831 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:29.398112 (+ 2281us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:29.398113 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:29.398113 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:29.398143 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:29.399583 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:29.400005 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:29.400006 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:29.400006 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:29.400062 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:29.400255 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:29.400256 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:29.400256 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:29.400361 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:29.400413 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:29.400694 (+ 281us) server_negotiation.cc:299] Negotiation successful
0811 08:16:29.400761 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 08:16:29.400938 13384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:29.391996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.131:54847)
0811 08:16:29.392173 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:29.392209 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:29.392675 (+ 466us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:29.392910 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:29.392915 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:29.393502 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:29.393761 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:29.393765 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.394424 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.394424 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:29.395300 (+ 876us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:29.395302 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.395843 (+ 541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.395844 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:29.395984 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:29.396558 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:29.396566 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:29.398009 (+ 1443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:29.399682 (+ 1673us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:29.399689 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:29.399691 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:29.399925 (+ 234us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:29.400111 (+ 186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:29.400112 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:29.400112 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:29.400201 (+ 89us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:29.400426 (+ 225us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:29.400431 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:29.400550 (+ 119us) client_negotiation.cc:769] Sending connection context
0811 08:16:29.400637 (+ 87us) client_negotiation.cc:240] Negotiation successful
0811 08:16:29.400778 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":110,"threads_started":1}
I20260811 08:16:29.401472 13380 heartbeater.cc:347] Connected to a master server at 127.20.158.190:38617
I20260811 08:16:29.401614 13380 heartbeater.cc:464] Registering TS with master...
I20260811 08:16:29.401820 13380 heartbeater.cc:511] Master 127.20.158.190:38617 requested a full tablet report, sending...
I20260811 08:16:29.402226 12679 ts_manager.cc:194] Registered new tserver with Master: bedb5adb9c09417eab890cd89e0085dd (127.20.158.131:46457)
I20260811 08:16:29.402663 12679 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.131@KRBTEST.COM'} at 127.20.158.131:54847
I20260811 08:16:29.410279 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:16:29.417584 12748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:29.411723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57696 (local address 127.20.158.190:38617)
0811 08:16:29.411786 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:29.411788 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:29.411891 (+ 103us) server_negotiation.cc:407] Connection header received
0811 08:16:29.411931 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:29.411931 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:29.411940 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:29.411988 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:29.412508 (+ 520us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.412992 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.413778 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.413958 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.414013 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:29.415139 (+ 1126us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:29.415140 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:29.415141 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:29.415147 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:29.416361 (+ 1214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:29.416773 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:29.416773 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:29.416774 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:29.416825 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:29.417022 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:29.417023 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:29.417023 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:29.417160 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:29.417238 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:29.417402 (+ 164us) server_negotiation.cc:299] Negotiation successful
0811 08:16:29.417468 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 08:16:29.419480 12679 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57696:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:16:29.421303 12679 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:16:29.428490 13405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:29.424276 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36526 (local address 127.20.158.131:46457)
0811 08:16:29.424514 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:29.424518 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:29.424529 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:16:29.424570 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:29.424572 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:29.424587 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:29.424664 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:16:29.424830 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.425973 (+ 1143us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.427527 (+ 1554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.428023 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.428122 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:29.428189 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:29.428342 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 08:16:29.428396 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":206,"thread_start_us":92,"threads_started":1}
I20260811 08:16:29.428468 13399 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:29.423989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:46457 (local address 127.0.0.1:36526)
0811 08:16:29.424383 (+ 394us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:29.424428 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:29.424472 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:29.424676 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:29.424676 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:29.424678 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:16:29.424743 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:29.424744 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.426106 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.426107 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:29.427421 (+ 1314us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:29.427424 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.428122 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.428123 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:29.428209 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:29.428224 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 08:16:29.428302 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 08:16:29.428357 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":376,"mutex_wait_us":52,"thread_start_us":111,"threads_started":1}
I20260811 08:16:29.428593 13402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:29.423970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:36933 (local address 127.0.0.1:58352)
0811 08:16:29.424164 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:29.424205 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:29.424276 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:29.424598 (+ 322us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:29.424601 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:29.424603 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:16:29.424704 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:29.424706 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.426114 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.426114 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:29.427422 (+ 1308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:29.427424 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.428327 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.428328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:29.428392 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:29.428395 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:16:29.428454 (+ 59us) client_negotiation.cc:240] Negotiation successful
0811 08:16:29.428495 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"mutex_wait_us":127,"thread_start_us":47,"threads_started":1}
I20260811 08:16:29.428854 13398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:29.423995 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:44133 (local address 127.0.0.1:35524)
0811 08:16:29.424441 (+ 446us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:29.424453 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:29.424514 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:29.425020 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:29.425021 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:29.425023 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:16:29.425066 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:29.425067 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.426084 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.426085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:29.427204 (+ 1119us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:29.427207 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.428613 (+ 1406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.428614 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:29.428688 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:29.428693 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:16:29.428743 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 08:16:29.428780 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":430,"mutex_wait_us":29,"spinlock_wait_cycles":384,"thread_start_us":109,"threads_started":1}
I20260811 08:16:29.429033 13403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:29.424085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58352 (local address 127.20.158.130:36933)
0811 08:16:29.424333 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:29.424338 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:29.424349 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:16:29.424394 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:29.424396 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:29.424411 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:29.424504 (+ 93us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:16:29.424799 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.426009 (+ 1210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.427517 (+ 1508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.428216 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.428329 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:29.428382 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:29.428467 (+ 85us) server_negotiation.cc:299] Negotiation successful
0811 08:16:29.428511 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":215,"thread_start_us":120,"threads_started":1}
I20260811 08:16:29.429087 13404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:29.424261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35524 (local address 127.20.158.129:44133)
0811 08:16:29.424797 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:29.424801 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:29.424811 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:16:29.424850 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:29.424852 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:29.424867 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:29.424940 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:16:29.425150 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.425960 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.427301 (+ 1341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.428021 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.428128 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:29.428186 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:29.428958 (+ 772us) server_negotiation.cc:299] Negotiation successful
0811 08:16:29.429009 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":500,"thread_start_us":95,"threads_started":1}
I20260811 08:16:29.429482 13286 tablet_service.cc:1467] Processing CreateTablet for tablet 1f6436e938e7462f90f6924d627bb115 (DEFAULT_TABLE table=test-table [id=e522a0f0c8df4415ac14113c1558eb4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:16:29.429728 13084 tablet_service.cc:1467] Processing CreateTablet for tablet 1f6436e938e7462f90f6924d627bb115 (DEFAULT_TABLE table=test-table [id=e522a0f0c8df4415ac14113c1558eb4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:16:29.429913 13286 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f6436e938e7462f90f6924d627bb115. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:16:29.429824 12887 tablet_service.cc:1467] Processing CreateTablet for tablet 1f6436e938e7462f90f6924d627bb115 (DEFAULT_TABLE table=test-table [id=e522a0f0c8df4415ac14113c1558eb4d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:16:29.430018 13084 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f6436e938e7462f90f6924d627bb115. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:16:29.430132 12887 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1f6436e938e7462f90f6924d627bb115. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:16:29.432667 13407 tablet_bootstrap.cc:492] T 1f6436e938e7462f90f6924d627bb115 P 844793d7f02646ffa042a3888f11ccbc: Bootstrap starting.
I20260811 08:16:29.433332 13411 tablet_bootstrap.cc:492] T 1f6436e938e7462f90f6924d627bb115 P bedb5adb9c09417eab890cd89e0085dd: Bootstrap starting.
I20260811 08:16:29.433501 13407 tablet_bootstrap.cc:654] T 1f6436e938e7462f90f6924d627bb115 P 844793d7f02646ffa042a3888f11ccbc: Neither blocks nor log segments found. Creating new log.
I20260811 08:16:29.434079 13411 tablet_bootstrap.cc:654] T 1f6436e938e7462f90f6924d627bb115 P bedb5adb9c09417eab890cd89e0085dd: Neither blocks nor log segments found. Creating new log.
I20260811 08:16:29.434129 13407 log.cc:824] T 1f6436e938e7462f90f6924d627bb115 P 844793d7f02646ffa042a3888f11ccbc: Log is configured to *not* fsync() on all Append() calls
I20260811 08:16:29.434528 13410 tablet_bootstrap.cc:492] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab: Bootstrap starting.
I20260811 08:16:29.434706 13411 log.cc:824] T 1f6436e938e7462f90f6924d627bb115 P bedb5adb9c09417eab890cd89e0085dd: Log is configured to *not* fsync() on all Append() calls
I20260811 08:16:29.434973 13407 tablet_bootstrap.cc:492] T 1f6436e938e7462f90f6924d627bb115 P 844793d7f02646ffa042a3888f11ccbc: No bootstrap required, opened a new log
I20260811 08:16:29.435058 13407 ts_tablet_manager.cc:1397] T 1f6436e938e7462f90f6924d627bb115 P 844793d7f02646ffa042a3888f11ccbc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:16:29.435273 13410 tablet_bootstrap.cc:654] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab: Neither blocks nor log segments found. Creating new log.
I20260811 08:16:29.435459 13411 tablet_bootstrap.cc:492] T 1f6436e938e7462f90f6924d627bb115 P bedb5adb9c09417eab890cd89e0085dd: No bootstrap required, opened a new log
I20260811 08:16:29.435595 13411 ts_tablet_manager.cc:1397] T 1f6436e938e7462f90f6924d627bb115 P bedb5adb9c09417eab890cd89e0085dd: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:16:29.435923 13410 log.cc:824] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab: Log is configured to *not* fsync() on all Append() calls
I20260811 08:16:29.436623 13410 tablet_bootstrap.cc:492] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab: No bootstrap required, opened a new log
I20260811 08:16:29.436705 13410 ts_tablet_manager.cc:1397] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:16:29.437117 13407 raft_consensus.cc:348] T 1f6436e938e7462f90f6924d627bb115 P 844793d7f02646ffa042a3888f11ccbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:16:29.437322 13407 raft_consensus.cc:374] T 1f6436e938e7462f90f6924d627bb115 P 844793d7f02646ffa042a3888f11ccbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:16:29.437363 13407 raft_consensus.cc:729] T 1f6436e938e7462f90f6924d627bb115 P 844793d7f02646ffa042a3888f11ccbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 844793d7f02646ffa042a3888f11ccbc, State: Initialized, Role: FOLLOWER
I20260811 08:16:29.437520 13407 consensus_queue.cc:260] T 1f6436e938e7462f90f6924d627bb115 P 844793d7f02646ffa042a3888f11ccbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:16:29.437602 13411 raft_consensus.cc:348] T 1f6436e938e7462f90f6924d627bb115 P bedb5adb9c09417eab890cd89e0085dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:16:29.437811 13411 raft_consensus.cc:374] T 1f6436e938e7462f90f6924d627bb115 P bedb5adb9c09417eab890cd89e0085dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:16:29.437875 13407 ts_tablet_manager.cc:1428] T 1f6436e938e7462f90f6924d627bb115 P 844793d7f02646ffa042a3888f11ccbc: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260811 08:16:29.437892 13411 raft_consensus.cc:729] T 1f6436e938e7462f90f6924d627bb115 P bedb5adb9c09417eab890cd89e0085dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bedb5adb9c09417eab890cd89e0085dd, State: Initialized, Role: FOLLOWER
I20260811 08:16:29.438014 13187 heartbeater.cc:503] Master 127.20.158.190:38617 was elected leader, sending a full tablet report...
I20260811 08:16:29.438041 13411 consensus_queue.cc:260] T 1f6436e938e7462f90f6924d627bb115 P bedb5adb9c09417eab890cd89e0085dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:16:29.438267 13411 ts_tablet_manager.cc:1428] T 1f6436e938e7462f90f6924d627bb115 P bedb5adb9c09417eab890cd89e0085dd: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260811 08:16:29.438354 13380 heartbeater.cc:503] Master 127.20.158.190:38617 was elected leader, sending a full tablet report...
I20260811 08:16:29.438913 13410 raft_consensus.cc:348] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:16:29.439059 13410 raft_consensus.cc:374] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:16:29.439110 13410 raft_consensus.cc:729] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53c154683fce4bb3ae4f8abb0ca372ab, State: Initialized, Role: FOLLOWER
I20260811 08:16:29.439251 13410 consensus_queue.cc:260] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:16:29.439570 13410 ts_tablet_manager.cc:1428] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:16:29.439596 12982 heartbeater.cc:503] Master 127.20.158.190:38617 was elected leader, sending a full tablet report...
W20260811 08:16:29.465197 13188 tablet.cc:2369] T 1f6436e938e7462f90f6924d627bb115 P 844793d7f02646ffa042a3888f11ccbc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:16:29.541317 12983 tablet.cc:2369] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:16:29.603922 13420 raft_consensus.cc:482] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:16:29.604068 13420 raft_consensus.cc:504] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:16:29.604513 13420 leader_election.cc:288] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 844793d7f02646ffa042a3888f11ccbc (127.20.158.130:36933), bedb5adb9c09417eab890cd89e0085dd (127.20.158.131:46457)
I20260811 08:16:29.607896 13403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:29.604822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:37355 (local address 127.20.158.130:36933)
0811 08:16:29.604890 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:29.604893 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:29.605011 (+ 118us) server_negotiation.cc:407] Connection header received
0811 08:16:29.605171 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:29.605173 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:29.605185 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:29.605256 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:16:29.605469 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.606036 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.607152 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.607520 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.607606 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:29.607616 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:29.607778 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 08:16:29.607820 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 08:16:29.607908 13405 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:29.604899 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:36665 (local address 127.20.158.131:46457)
0811 08:16:29.604989 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:29.604991 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:29.605037 (+ 46us) server_negotiation.cc:407] Connection header received
0811 08:16:29.605316 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:29.605317 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:29.605325 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:29.605403 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:16:29.605648 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.606150 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.607122 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.607528 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.607619 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:29.607627 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:29.607806 (+ 179us) server_negotiation.cc:299] Negotiation successful
0811 08:16:29.607846 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 08:16:29.607920 13421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:29.604724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:36933 (local address 127.20.158.129:37355)
0811 08:16:29.604928 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:29.604940 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:29.605048 (+ 108us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:29.605305 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:29.605306 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:29.605309 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:16:29.605402 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:29.605404 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.606126 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.606127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:29.607007 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:29.607009 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.607614 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.607616 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:29.607700 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:29.607704 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:16:29.607749 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 08:16:29.607813 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"mutex_wait_us":2,"thread_start_us":93,"threads_started":1}
I20260811 08:16:29.607923 13422 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:29.604769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:46457 (local address 127.20.158.129:36665)
0811 08:16:29.604975 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:29.604985 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:29.605051 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:29.605413 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:29.605414 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:29.605416 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:16:29.605503 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:29.605506 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.606230 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.606230 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:29.607010 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:29.607012 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.607645 (+ 633us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.607646 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:29.607711 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:29.607714 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:16:29.607789 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 08:16:29.607829 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":193,"mutex_wait_us":1,"thread_start_us":75,"threads_started":1}
I20260811 08:16:29.608265 13111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f6436e938e7462f90f6924d627bb115" candidate_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "844793d7f02646ffa042a3888f11ccbc" is_pre_election: true
I20260811 08:16:29.608276 13319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f6436e938e7462f90f6924d627bb115" candidate_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedb5adb9c09417eab890cd89e0085dd" is_pre_election: true
I20260811 08:16:29.608439 13319 raft_consensus.cc:2454] T 1f6436e938e7462f90f6924d627bb115 P bedb5adb9c09417eab890cd89e0085dd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53c154683fce4bb3ae4f8abb0ca372ab in term 0.
I20260811 08:16:29.608439 13111 raft_consensus.cc:2454] T 1f6436e938e7462f90f6924d627bb115 P 844793d7f02646ffa042a3888f11ccbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53c154683fce4bb3ae4f8abb0ca372ab in term 0.
I20260811 08:16:29.608702 12812 leader_election.cc:302] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53c154683fce4bb3ae4f8abb0ca372ab, bedb5adb9c09417eab890cd89e0085dd; no voters:
I20260811 08:16:29.608853 13420 raft_consensus.cc:2781] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:16:29.608916 13420 raft_consensus.cc:482] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:16:29.608946 13420 raft_consensus.cc:3037] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:16:29.609789 13420 raft_consensus.cc:504] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:16:29.609939 13420 leader_election.cc:288] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 1 election: Requested vote from peers 844793d7f02646ffa042a3888f11ccbc (127.20.158.130:36933), bedb5adb9c09417eab890cd89e0085dd (127.20.158.131:46457)
I20260811 08:16:29.610143 13111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f6436e938e7462f90f6924d627bb115" candidate_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "844793d7f02646ffa042a3888f11ccbc"
I20260811 08:16:29.610203 13319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1f6436e938e7462f90f6924d627bb115" candidate_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bedb5adb9c09417eab890cd89e0085dd"
I20260811 08:16:29.610270 13111 raft_consensus.cc:3037] T 1f6436e938e7462f90f6924d627bb115 P 844793d7f02646ffa042a3888f11ccbc [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:16:29.610297 13319 raft_consensus.cc:3037] T 1f6436e938e7462f90f6924d627bb115 P bedb5adb9c09417eab890cd89e0085dd [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:16:29.611156 13319 raft_consensus.cc:2454] T 1f6436e938e7462f90f6924d627bb115 P bedb5adb9c09417eab890cd89e0085dd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53c154683fce4bb3ae4f8abb0ca372ab in term 1.
I20260811 08:16:29.611294 13111 raft_consensus.cc:2454] T 1f6436e938e7462f90f6924d627bb115 P 844793d7f02646ffa042a3888f11ccbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53c154683fce4bb3ae4f8abb0ca372ab in term 1.
I20260811 08:16:29.611367 12812 leader_election.cc:302] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53c154683fce4bb3ae4f8abb0ca372ab, bedb5adb9c09417eab890cd89e0085dd; no voters:
I20260811 08:16:29.611490 13420 raft_consensus.cc:2781] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:16:29.611672 13420 raft_consensus.cc:686] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 LEADER]: Becoming Leader. State: Replica: 53c154683fce4bb3ae4f8abb0ca372ab, State: Running, Role: LEADER
I20260811 08:16:29.611800 13420 consensus_queue.cc:237] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:16:29.612715 12677 catalog_manager.cc:5495] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 53c154683fce4bb3ae4f8abb0ca372ab (127.20.158.129). New cstate: current_term: 1 leader_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } health_report { overall_health: HEALTHY } } }
W20260811 08:16:29.641924 13382 tablet.cc:2369] T 1f6436e938e7462f90f6924d627bb115 P bedb5adb9c09417eab890cd89e0085dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:16:29.655542 13404 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:29.652969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35532 (local address 127.20.158.129:44133)
0811 08:16:29.653040 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:29.653043 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:29.653073 (+ 30us) server_negotiation.cc:407] Connection header received
0811 08:16:29.653116 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:29.653117 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:29.653138 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:29.653196 (+ 58us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:16:29.653334 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.653921 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.654700 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:29.654911 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:29.654975 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:29.655135 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:16:29.655247 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:16:29.655320 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:29.655400 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 08:16:29.655420 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 08:16:29.657701 13111 raft_consensus.cc:1261] T 1f6436e938e7462f90f6924d627bb115 P 844793d7f02646ffa042a3888f11ccbc [term 1 FOLLOWER]: Refusing update from remote peer 53c154683fce4bb3ae4f8abb0ca372ab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:16:29.657743 13319 raft_consensus.cc:1261] T 1f6436e938e7462f90f6924d627bb115 P bedb5adb9c09417eab890cd89e0085dd [term 1 FOLLOWER]: Refusing update from remote peer 53c154683fce4bb3ae4f8abb0ca372ab: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:16:29.658119 13420 consensus_queue.cc:1035] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:16:29.658298 13423 consensus_queue.cc:1035] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:16:29.664433 12677 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57696:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:16:29.664544 12677 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57696:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:16:29.665427 12677 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df: Sending DeleteTablet for 3 replicas of tablet 1f6436e938e7462f90f6924d627bb115
I20260811 08:16:29.665805 13286 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f6436e938e7462f90f6924d627bb115 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:16:29 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:36526
I20260811 08:16:29.665899 12887 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f6436e938e7462f90f6924d627bb115 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:16:29 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:35524
I20260811 08:16:29.665897 13084 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f6436e938e7462f90f6924d627bb115 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:16:29 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:58352
I20260811 08:16:29.666163 13443 tablet_replica.cc:330] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab: stopping tablet replica
I20260811 08:16:29.666240 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 12785
I20260811 08:16:29.666273 13443 raft_consensus.cc:2229] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:16:29.666393 13443 raft_consensus.cc:2258] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:16:29.666527 13448 tablet_replica.cc:330] T 1f6436e938e7462f90f6924d627bb115 P 844793d7f02646ffa042a3888f11ccbc: stopping tablet replica
I20260811 08:16:29.666616 13448 raft_consensus.cc:2229] T 1f6436e938e7462f90f6924d627bb115 P 844793d7f02646ffa042a3888f11ccbc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:16:29.666692 13448 raft_consensus.cc:2258] T 1f6436e938e7462f90f6924d627bb115 P 844793d7f02646ffa042a3888f11ccbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:16:29.676035 13448 ts_tablet_manager.cc:1905] T 1f6436e938e7462f90f6924d627bb115 P 844793d7f02646ffa042a3888f11ccbc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:16:29.678406 13448 ts_tablet_manager.cc:1918] T 1f6436e938e7462f90f6924d627bb115 P 844793d7f02646ffa042a3888f11ccbc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:16:29.678504 13448 log.cc:1196] T 1f6436e938e7462f90f6924d627bb115 P 844793d7f02646ffa042a3888f11ccbc: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/wal/wals/1f6436e938e7462f90f6924d627bb115
I20260811 08:16:29.678830 13448 ts_tablet_manager.cc:1939] T 1f6436e938e7462f90f6924d627bb115 P 844793d7f02646ffa042a3888f11ccbc: Deleting consensus metadata
I20260811 08:16:29.679316 12659 catalog_manager.cc:4841] TS 844793d7f02646ffa042a3888f11ccbc (127.20.158.130:36933): tablet 1f6436e938e7462f90f6924d627bb115 (table test-table [id=e522a0f0c8df4415ac14113c1558eb4d]) successfully deleted
I20260811 08:16:29.679911 13442 tablet_replica.cc:330] T 1f6436e938e7462f90f6924d627bb115 P bedb5adb9c09417eab890cd89e0085dd: stopping tablet replica
I20260811 08:16:29.680063 13442 raft_consensus.cc:2229] T 1f6436e938e7462f90f6924d627bb115 P bedb5adb9c09417eab890cd89e0085dd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:16:29.680200 13442 raft_consensus.cc:2258] T 1f6436e938e7462f90f6924d627bb115 P bedb5adb9c09417eab890cd89e0085dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:16:29.680687 13442 ts_tablet_manager.cc:1905] T 1f6436e938e7462f90f6924d627bb115 P bedb5adb9c09417eab890cd89e0085dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:16:29.682683 13442 ts_tablet_manager.cc:1918] T 1f6436e938e7462f90f6924d627bb115 P bedb5adb9c09417eab890cd89e0085dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:16:29.682776 13442 log.cc:1196] T 1f6436e938e7462f90f6924d627bb115 P bedb5adb9c09417eab890cd89e0085dd: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/wal/wals/1f6436e938e7462f90f6924d627bb115
I20260811 08:16:29.683061 13442 ts_tablet_manager.cc:1939] T 1f6436e938e7462f90f6924d627bb115 P bedb5adb9c09417eab890cd89e0085dd: Deleting consensus metadata
I20260811 08:16:29.683568 12654 catalog_manager.cc:4841] TS bedb5adb9c09417eab890cd89e0085dd (127.20.158.131:46457): tablet 1f6436e938e7462f90f6924d627bb115 (table test-table [id=e522a0f0c8df4415ac14113c1558eb4d]) successfully deleted
W20260811 08:16:29.685129 12655 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.158.129:44133 (error 108)
I20260811 08:16:29.685310 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 12988
I20260811 08:16:29.690975 13398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:29.690828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:44133 (local address 127.0.0.1:35536)
0811 08:16:29.690889 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:29.690931 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.129:44133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 08:16:29.691097 12655 catalog_manager.cc:4584] TS 53c154683fce4bb3ae4f8abb0ca372ab (127.20.158.129:44133): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1f6436e938e7462f90f6924d627bb115: Network error: Client connection negotiation failed: client connection to 127.20.158.129:44133: connect: Connection refused (error 111)
I20260811 08:16:29.696842 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 13192
I20260811 08:16:29.708506 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 12622
I20260811 08:16:49.721071 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:38617
--webserver_interface=127.20.158.190
--webserver_port=40649
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:37253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:38617
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:16:49.807250 13450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:49.807476 13450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:49.807500 13450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:49.808699 13450 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 08:16:49.808743 13450 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 08:16:49.808756 13450 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 08:16:49.808768 13450 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:16:49.808807 13450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:49.808840 13450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:49.808866 13450 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:16:49.808892 13450 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:16:49.810609 13450 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:37253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:38617
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:38617
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=40649
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:49.810940 13450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:49.811239 13450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:49.821424 13465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:49.821455 13462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:49.821552 13450 server_base.cc:1034] running on GCE node
W20260811 08:16:49.821470 13463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:49.821983 13450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:49.822335 13450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:49.823498 13450 hybrid_clock.cc:648] HybridClock initialized: now 1786436209823474 us; error 33 us; skew 500 ppm
Aug 11 08:16:49 dist-test-slave-gkw7 krb5kdc[12602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436209, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:49.832357 13450 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:16:49.832974 13450 webserver.cc:460] Webserver started at http://127.20.158.190:40649/ using document root <none> and password file <none>
I20260811 08:16:49.833278 13450 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:49.833392 13450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:16:49.835160 13450 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:49.836000 13474 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:49.836298 13450 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:49.836439 13450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "8b8244231d1c4c4aad6f7c454cf833df"
format_stamp: "Formatted at 2026-08-11 08:16:28 on dist-test-slave-gkw7"
server_key: "a57b1c0386b0ad69b94ff9312fae32db"
server_key_iv: "cd10224d95f8c0de439cb4fa43fa2427"
server_key_version: "encryptionkey@0"
I20260811 08:16:49.836874 13450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:49.853297 13450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:49.855367 13450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:49.855535 13450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:49.859978 13450 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:38617
I20260811 08:16:49.860018 13558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:38617 every 8 connection(s)
I20260811 08:16:49.860455 13450 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:16:49.862095 13559 sys_catalog.cc:263] Verifying existing consensus state
I20260811 08:16:49.862754 13559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df: Bootstrap starting.
I20260811 08:16:49.867982 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 13450
I20260811 08:16:49.868290 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:44133
--local_ip_for_outbound_sockets=127.20.158.129
--tserver_master_addrs=127.20.158.190:38617
--webserver_port=46383
--webserver_interface=127.20.158.129
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:37253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:16:49.871678 13559 log.cc:824] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df: Log is configured to *not* fsync() on all Append() calls
I20260811 08:16:49.874017 13559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:16:49.874351 13559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df: Bootstrap complete.
I20260811 08:16:49.876708 13559 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8244231d1c4c4aad6f7c454cf833df" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38617 } }
I20260811 08:16:49.876960 13559 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b8244231d1c4c4aad6f7c454cf833df, State: Initialized, Role: FOLLOWER
I20260811 08:16:49.877148 13559 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8244231d1c4c4aad6f7c454cf833df" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38617 } }
I20260811 08:16:49.877238 13559 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:16:49.877301 13559 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:16:49.877354 13559 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [term 1 FOLLOWER]: Advancing to term 2
I20260811 08:16:49.878443 13559 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8244231d1c4c4aad6f7c454cf833df" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38617 } }
I20260811 08:16:49.878562 13559 leader_election.cc:302] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b8244231d1c4c4aad6f7c454cf833df; no voters:
I20260811 08:16:49.878747 13559 leader_election.cc:288] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [CANDIDATE]: Term 2 election: Requested vote from peers
I20260811 08:16:49.878814 13566 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [term 2 FOLLOWER]: Leader election won for term 2
I20260811 08:16:49.878984 13566 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [term 2 LEADER]: Becoming Leader. State: Replica: 8b8244231d1c4c4aad6f7c454cf833df, State: Running, Role: LEADER
I20260811 08:16:49.879015 13559 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:16:49.880280 13566 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8244231d1c4c4aad6f7c454cf833df" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38617 } }
I20260811 08:16:49.880908 13568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b8244231d1c4c4aad6f7c454cf833df. Latest consensus state: current_term: 2 leader_uuid: "8b8244231d1c4c4aad6f7c454cf833df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8244231d1c4c4aad6f7c454cf833df" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38617 } } }
I20260811 08:16:49.881014 13567 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "8b8244231d1c4c4aad6f7c454cf833df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8244231d1c4c4aad6f7c454cf833df" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38617 } } }
I20260811 08:16:49.881147 13568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [sys.catalog]: This master's current role is: LEADER
I20260811 08:16:49.881155 13567 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [sys.catalog]: This master's current role is: LEADER
I20260811 08:16:49.881656 13590 catalog_manager.cc:1259] Loaded cluster ID: 7dbfc7cacaac41969a87505b86607ad3
I20260811 08:16:49.881717 13590 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df: loading cluster ID for follower catalog manager: success
I20260811 08:16:49.882815 13590 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df: acquiring CA information for follower catalog manager: success
I20260811 08:16:49.883190 13590 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 08:16:49.883277 13592 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:16:49.883646 13592 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:16:49.883757 13592 catalog_manager.cc:1259] Loaded cluster ID: 7dbfc7cacaac41969a87505b86607ad3
I20260811 08:16:49.883795 13592 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:16:49.883980 13592 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:16:49.884081 13592 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df: Loaded TSK: 0
I20260811 08:16:49.893733 13592 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df: Generated new TSK 1
I20260811 08:16:49.893829 13592 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 08:16:49.966857 13562 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:49.967069 13562 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:49.967093 13562 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:49.968403 13562 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:49.968448 13562 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:49.968475 13562 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:16:49.969964 13562 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:37253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:44133
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=46383
--tserver_master_addrs=127.20.158.190:38617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13562
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:49.970211 13562 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:49.970472 13562 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:49.975910 13600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:49.975939 13606 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:49.976225 13602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:49.976409 13562 server_base.cc:1034] running on GCE node
I20260811 08:16:49.976610 13562 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:49.976889 13562 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:49.978058 13562 hybrid_clock.cc:648] HybridClock initialized: now 1786436209978034 us; error 39 us; skew 500 ppm
Aug 11 08:16:49 dist-test-slave-gkw7 krb5kdc[12602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436209, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:49.980968 13562 init.cc:377] Logged in from keytab as kudu/127.20.158.129@KRBTEST.COM (short username kudu)
I20260811 08:16:49.981521 13562 webserver.cc:460] Webserver started at http://127.20.158.129:46383/ using document root <none> and password file <none>
I20260811 08:16:49.981817 13562 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:49.981901 13562 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:16:49.983376 13562 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 08:16:49.984059 13613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:49.984309 13562 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:16:49.984428 13562 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "53c154683fce4bb3ae4f8abb0ca372ab"
format_stamp: "Formatted at 2026-08-11 08:16:28 on dist-test-slave-gkw7"
server_key: "620179adc743f31ccd7e26041d4ef5a4"
server_key_iv: "a0663d1c683eec122aebfda50bd2ee28"
server_key_version: "encryptionkey@0"
I20260811 08:16:49.984921 13562 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:50.032114 13562 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:50.034982 13562 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:50.035161 13562 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:50.035451 13562 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:16:50.035989 13621 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 08:16:50.037671 13562 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 08:16:50.037739 13562 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 08:16:50.037777 13562 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 08:16:50.038744 13562 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 08:16:50.038791 13562 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 08:16:50.038890 13621 tablet_bootstrap.cc:492] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab: Bootstrap starting.
I20260811 08:16:50.047482 13562 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:44133
I20260811 08:16:50.047569 13813 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:44133 every 8 connection(s)
I20260811 08:16:50.048084 13562 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:16:50.050151 13621 log.cc:824] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab: Log is configured to *not* fsync() on all Append() calls
I20260811 08:16:50.052815 13621 tablet_bootstrap.cc:492] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:16:50.053122 13621 tablet_bootstrap.cc:492] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab: Bootstrap complete.
I20260811 08:16:50.054167 13621 ts_tablet_manager.cc:1397] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab: Time spent bootstrapping tablet: real 0.015s user 0.003s sys 0.011s
I20260811 08:16:50.055430 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 13562
I20260811 08:16:50.055414 13621 raft_consensus.cc:348] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:16:50.055758 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:36933
--local_ip_for_outbound_sockets=127.20.158.130
--tserver_master_addrs=127.20.158.190:38617
--webserver_port=43371
--webserver_interface=127.20.158.130
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:37253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:16:50.055763 13621 raft_consensus.cc:729] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53c154683fce4bb3ae4f8abb0ca372ab, State: Initialized, Role: FOLLOWER
I20260811 08:16:50.055904 13621 consensus_queue.cc:260] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:16:50.056195 13621 ts_tablet_manager.cc:1428] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
Aug 11 08:16:50 dist-test-slave-gkw7 krb5kdc[12602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436209, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:16:50.062405 13821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:50.049243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:59009 (local address 127.20.158.190:38617)
0811 08:16:50.050559 (+ 1316us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:50.050567 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:50.050599 (+ 32us) server_negotiation.cc:407] Connection header received
0811 08:16:50.050733 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:50.050740 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:50.050797 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:50.050957 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:50.051833 (+ 876us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.053208 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.054787 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.055398 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.056990 (+ 1592us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:50.058182 (+ 1192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:50.058186 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:50.058186 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:50.058198 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:50.060104 (+ 1906us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:50.060694 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:50.060698 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:50.060698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:50.060799 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:50.061275 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:50.061276 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:50.061277 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:50.061511 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:50.061679 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:50.062097 (+ 418us) server_negotiation.cc:299] Negotiation successful
0811 08:16:50.062242 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1267,"thread_start_us":108,"threads_started":1}
I20260811 08:16:50.062474 13817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:50.048901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.129:59009)
0811 08:16:50.049122 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:50.049174 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:50.049889 (+ 715us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:50.051016 (+ 1127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:50.051021 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:50.051394 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:50.051681 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:50.051687 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.053332 (+ 1645us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.053333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:50.054690 (+ 1357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:50.054693 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.055517 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.055518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:50.055656 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:50.056377 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:50.056386 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:50.058038 (+ 1652us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:50.060203 (+ 2165us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:50.060213 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:50.060215 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:50.060575 (+ 360us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:50.060872 (+ 297us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:50.060874 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:50.060874 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:50.061034 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:50.061661 (+ 627us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:50.061677 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:50.061874 (+ 197us) client_negotiation.cc:769] Sending connection context
0811 08:16:50.061998 (+ 124us) client_negotiation.cc:240] Negotiation successful
0811 08:16:50.062206 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":165,"thread_start_us":118,"threads_started":1}
I20260811 08:16:50.063344 13815 heartbeater.cc:347] Connected to a master server at 127.20.158.190:38617
I20260811 08:16:50.063498 13815 heartbeater.cc:464] Registering TS with master...
I20260811 08:16:50.063719 13815 heartbeater.cc:511] Master 127.20.158.190:38617 requested a full tablet report, sending...
I20260811 08:16:50.064561 13503 ts_manager.cc:194] Registered new tserver with Master: 53c154683fce4bb3ae4f8abb0ca372ab (127.20.158.129:44133)
I20260811 08:16:50.066004 13503 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.129@KRBTEST.COM'} at 127.20.158.129:59009
I20260811 08:16:50.066972 13815 heartbeater.cc:503] Master 127.20.158.190:38617 was elected leader, sending a full tablet report...
Aug 11 08:16:50 dist-test-slave-gkw7 krb5kdc[12602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436209, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for kudu/127.20.158.129@KRBTEST.COM
I20260811 08:16:50.074393 13830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:50.065396 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46038 (local address 127.20.158.129:44133)
0811 08:16:50.065633 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:50.065638 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:50.065748 (+ 110us) server_negotiation.cc:407] Connection header received
0811 08:16:50.065875 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:50.065878 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:50.065899 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:50.065983 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:50.066552 (+ 569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.067716 (+ 1164us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.068513 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.068983 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.069058 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:50.071365 (+ 2307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:50.071373 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:50.071373 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:50.071379 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:50.073066 (+ 1687us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:50.073502 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:50.073504 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:50.073504 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:50.073610 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:50.073821 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:50.073822 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:50.073822 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:50.073973 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:50.074042 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:50.074232 (+ 190us) server_negotiation.cc:299] Negotiation successful
0811 08:16:50.074319 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":202,"thread_start_us":84,"threads_started":1}
I20260811 08:16:50.074486 13828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:50.065335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:44133 (local address 127.0.0.1:46038)
0811 08:16:50.065626 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:50.065668 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:50.065771 (+ 103us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:50.065985 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:50.065992 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:50.066392 (+ 400us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:50.066461 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:50.066464 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.067800 (+ 1336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.067801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:50.068426 (+ 625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:50.068429 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.069064 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.069065 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:50.069125 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:50.069703 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:50.069709 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:50.071280 (+ 1571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:50.073147 (+ 1867us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:50.073153 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:50.073156 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:50.073419 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:50.073682 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:50.073683 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:50.073683 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:50.073756 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:50.074036 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:50.074043 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:50.074100 (+ 57us) client_negotiation.cc:769] Sending connection context
0811 08:16:50.074190 (+ 90us) client_negotiation.cc:240] Negotiation successful
0811 08:16:50.074341 (+ 151us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"thread_start_us":111,"threads_started":1}
I20260811 08:16:50.074909 13679 tablet_service.cc:1514] Processing DeleteTablet for tablet 1f6436e938e7462f90f6924d627bb115 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:16:29 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:46038
I20260811 08:16:50.075542 13831 tablet_replica.cc:330] stopping tablet replica
I20260811 08:16:50.075668 13831 raft_consensus.cc:2229] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:16:50.075748 13831 raft_consensus.cc:2258] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:16:50.076103 13831 ts_tablet_manager.cc:1905] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:16:50.078406 13831 ts_tablet_manager.cc:1918] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:16:50.078481 13831 log.cc:1196] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/wal/wals/1f6436e938e7462f90f6924d627bb115
I20260811 08:16:50.078766 13831 ts_tablet_manager.cc:1939] T 1f6436e938e7462f90f6924d627bb115 P 53c154683fce4bb3ae4f8abb0ca372ab: Deleting consensus metadata
I20260811 08:16:50.079371 13476 catalog_manager.cc:4841] TS 53c154683fce4bb3ae4f8abb0ca372ab (127.20.158.129:44133): tablet 1f6436e938e7462f90f6924d627bb115 (table test-table [id=e522a0f0c8df4415ac14113c1558eb4d]) successfully deleted
W20260811 08:16:50.144280 13825 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:50.144492 13825 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:50.144518 13825 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:50.145623 13825 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:50.145658 13825 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:50.145682 13825 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:16:50.147054 13825 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:37253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:36933
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=43371
--tserver_master_addrs=127.20.158.190:38617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13825
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:50.147245 13825 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:50.147424 13825 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:16:50.152503 13839 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:50.152665 13838 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:50.152652 13841 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:50.152779 13825 server_base.cc:1034] running on GCE node
I20260811 08:16:50.153012 13825 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:50.153254 13825 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:50.154413 13825 hybrid_clock.cc:648] HybridClock initialized: now 1786436210154392 us; error 40 us; skew 500 ppm
Aug 11 08:16:50 dist-test-slave-gkw7 krb5kdc[12602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436210, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:50.156901 13825 init.cc:377] Logged in from keytab as kudu/127.20.158.130@KRBTEST.COM (short username kudu)
I20260811 08:16:50.157363 13825 webserver.cc:460] Webserver started at http://127.20.158.130:43371/ using document root <none> and password file <none>
I20260811 08:16:50.157603 13825 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:50.157668 13825 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:16:50.158954 13825 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:50.159559 13851 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:50.159749 13825 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:16:50.159843 13825 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "844793d7f02646ffa042a3888f11ccbc"
format_stamp: "Formatted at 2026-08-11 08:16:29 on dist-test-slave-gkw7"
server_key: "25abb781201d38825fd3cf8a309a3601"
server_key_iv: "2b3598f9be7a6c3219be666a7c0f103c"
server_key_version: "encryptionkey@0"
I20260811 08:16:50.160176 13825 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:50.185614 13825 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:50.187508 13825 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:50.187671 13825 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:50.187920 13825 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:16:50.188244 13825 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:16:50.188279 13825 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:50.188320 13825 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:16:50.188347 13825 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:50.194535 13825 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:36933
I20260811 08:16:50.194587 14017 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:36933 every 8 connection(s)
I20260811 08:16:50.194926 13825 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
Aug 11 08:16:50 dist-test-slave-gkw7 krb5kdc[12602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436210, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:16:50.202694 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 13825
I20260811 08:16:50.202983 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:46457
--local_ip_for_outbound_sockets=127.20.158.131
--tserver_master_addrs=127.20.158.190:38617
--webserver_port=34915
--webserver_interface=127.20.158.131
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:37253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:16:50.204942 13821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:50.195631 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:47937 (local address 127.20.158.190:38617)
0811 08:16:50.195718 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:50.195721 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:50.195937 (+ 216us) server_negotiation.cc:407] Connection header received
0811 08:16:50.196506 (+ 569us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:50.196507 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:50.196518 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:50.196573 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:50.197524 (+ 951us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.198042 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.199028 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.199257 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.199324 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:50.201512 (+ 2188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:50.201513 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:50.201514 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:50.201522 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:50.203402 (+ 1880us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:50.203867 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:50.203869 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:50.203870 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:50.203938 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:50.204224 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:50.204225 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:50.204226 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:50.204351 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:50.204433 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:50.204732 (+ 299us) server_negotiation.cc:299] Negotiation successful
0811 08:16:50.204838 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 08:16:50.205175 14021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:50.195609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.130:47937)
0811 08:16:50.195816 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:50.195853 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:50.196415 (+ 562us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:50.196640 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:50.196643 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:50.197253 (+ 610us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:50.197445 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:50.197450 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.198120 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.198121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:50.198947 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:50.198949 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.199365 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.199366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:50.199477 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:50.199931 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:50.199939 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:50.201402 (+ 1463us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:50.203498 (+ 2096us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:50.203507 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:50.203510 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:50.203760 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:50.204018 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:50.204018 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:50.204019 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:50.204143 (+ 124us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:50.204431 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:50.204440 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:50.204589 (+ 149us) client_negotiation.cc:769] Sending connection context
0811 08:16:50.204707 (+ 118us) client_negotiation.cc:240] Negotiation successful
0811 08:16:50.204891 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":128,"threads_started":1}
I20260811 08:16:50.205766 14019 heartbeater.cc:347] Connected to a master server at 127.20.158.190:38617
I20260811 08:16:50.205892 14019 heartbeater.cc:464] Registering TS with master...
I20260811 08:16:50.206084 14019 heartbeater.cc:511] Master 127.20.158.190:38617 requested a full tablet report, sending...
I20260811 08:16:50.206475 13503 ts_manager.cc:194] Registered new tserver with Master: 844793d7f02646ffa042a3888f11ccbc (127.20.158.130:36933)
I20260811 08:16:50.207015 13503 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.130@KRBTEST.COM'} at 127.20.158.130:47937
W20260811 08:16:50.288954 14024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:16:50.289160 14024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:16:50.289183 14024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:16:50.290387 14024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:16:50.290431 14024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:16:50.290457 14024 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:16:50.291900 14024 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:37253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:46457
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=34915
--tserver_master_addrs=127.20.158.190:38617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14024
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:16:50.292093 14024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:16:50.292279 14024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:16:50.297708 14024 server_base.cc:1034] running on GCE node
W20260811 08:16:50.297631 14034 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:50.297698 14032 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:16:50.297626 14031 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:16:50.298128 14024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:16:50.298353 14024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:16:50.299525 14024 hybrid_clock.cc:648] HybridClock initialized: now 1786436210299503 us; error 37 us; skew 500 ppm
Aug 11 08:16:50 dist-test-slave-gkw7 krb5kdc[12602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436210, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:16:50.302191 14024 init.cc:377] Logged in from keytab as kudu/127.20.158.131@KRBTEST.COM (short username kudu)
I20260811 08:16:50.302671 14024 webserver.cc:460] Webserver started at http://127.20.158.131:34915/ using document root <none> and password file <none>
I20260811 08:16:50.302873 14024 fs_manager.cc:359] Metadata directory not provided
I20260811 08:16:50.302938 14024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:16:50.304265 14024 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 08:16:50.304843 14042 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:50.305011 14024 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:50.305115 14024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "bedb5adb9c09417eab890cd89e0085dd"
format_stamp: "Formatted at 2026-08-11 08:16:29 on dist-test-slave-gkw7"
server_key: "9136ab82d006c9569d08343a23ac6e42"
server_key_iv: "45b49049f728931510941b0b67fc2559"
server_key_version: "encryptionkey@0"
I20260811 08:16:50.305471 14024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:16:50.323112 14024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:16:50.325328 14024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:16:50.325574 14024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:16:50.325867 14024 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:16:50.326231 14024 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:16:50.326300 14024 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:50.326347 14024 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:16:50.326383 14024 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:16:50.332948 14024 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:46457
I20260811 08:16:50.332993 14217 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:46457 every 8 connection(s)
I20260811 08:16:50.333398 14024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
I20260811 08:16:50.339869 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 14024
Aug 11 08:16:50 dist-test-slave-gkw7 krb5kdc[12602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436210, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:16:50.343482 13821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:50.334269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:35305 (local address 127.20.158.190:38617)
0811 08:16:50.334340 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:50.334342 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:50.334569 (+ 227us) server_negotiation.cc:407] Connection header received
0811 08:16:50.335105 (+ 536us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:50.335106 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:50.335119 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:50.335175 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:50.336187 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.336701 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.337760 (+ 1059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.337980 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.338066 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:50.340556 (+ 2490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:50.340558 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:50.340558 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:50.340565 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:50.342038 (+ 1473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:50.342503 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:50.342504 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:50.342504 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:50.342556 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:50.342817 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:50.342818 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:50.342818 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:50.342920 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:50.342971 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:50.343292 (+ 321us) server_negotiation.cc:299] Negotiation successful
0811 08:16:50.343385 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 08:16:50.343686 14222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:50.334259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.131:35305)
0811 08:16:50.334438 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:50.334476 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:50.334996 (+ 520us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:50.335272 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:50.335275 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:50.335861 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:16:50.336083 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:50.336087 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.336809 (+ 722us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.336811 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:50.337662 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:50.337665 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.338079 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.338080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:50.338217 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:50.338764 (+ 547us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:16:50.338773 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:16:50.340389 (+ 1616us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:16:50.342110 (+ 1721us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:50.342117 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:50.342120 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:50.342430 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:50.342618 (+ 188us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:16:50.342619 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:16:50.342619 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:16:50.342756 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:16:50.342993 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:16:50.342999 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:16:50.343155 (+ 156us) client_negotiation.cc:769] Sending connection context
0811 08:16:50.343250 (+ 95us) client_negotiation.cc:240] Negotiation successful
0811 08:16:50.343414 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":95,"threads_started":1}
I20260811 08:16:50.344220 14218 heartbeater.cc:347] Connected to a master server at 127.20.158.190:38617
I20260811 08:16:50.344337 14218 heartbeater.cc:464] Registering TS with master...
I20260811 08:16:50.344535 14218 heartbeater.cc:511] Master 127.20.158.190:38617 requested a full tablet report, sending...
I20260811 08:16:50.344973 13503 ts_manager.cc:194] Registered new tserver with Master: bedb5adb9c09417eab890cd89e0085dd (127.20.158.131:46457)
I20260811 08:16:50.345347 13503 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.131@KRBTEST.COM'} at 127.20.158.131:35305
I20260811 08:16:50.347232 14224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:50.340363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52520 (local address 127.20.158.190:38617)
0811 08:16:50.340500 (+ 137us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:50.340516 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:50.340598 (+ 82us) server_negotiation.cc:407] Connection header received
0811 08:16:50.340683 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:50.340684 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:50.340697 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:50.340784 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:50.341373 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.341941 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.343047 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.343282 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.343358 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:50.344785 (+ 1427us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:50.344786 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:50.344787 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:50.344793 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:50.346376 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:50.346677 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:50.346677 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:50.346677 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:50.346720 (+ 43us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:50.346837 (+ 117us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:50.346837 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:50.346837 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:50.346929 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:50.347051 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:50.347082 (+ 31us) server_negotiation.cc:299] Negotiation successful
0811 08:16:50.347146 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":64,"threads_started":1}
I20260811 08:16:50.347905 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:16:50.350529 14224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:50.348265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52522 (local address 127.20.158.190:38617)
0811 08:16:50.348313 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:50.348315 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:50.348418 (+ 103us) server_negotiation.cc:407] Connection header received
0811 08:16:50.348478 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:50.348478 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:50.348506 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:50.348567 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:16:50.348639 (+ 72us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.349208 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.349977 (+ 769us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.350167 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.350215 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:50.350340 (+ 125us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:16:50.350382 (+ 42us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0811 08:16:50.350489 (+ 107us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:52522: token expired
Metrics: {"server-negotiator.queue_time_us":28}
W20260811 08:16:50.350613 14224 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:52522: token expired
W20260811 08:16:50.351406 13390 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.20.158.190:38617)
I20260811 08:16:50.357048 14224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:50.351678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52524 (local address 127.20.158.190:38617)
0811 08:16:50.351736 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:50.351738 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:50.351756 (+ 18us) server_negotiation.cc:407] Connection header received
0811 08:16:50.351773 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:50.351774 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:50.351780 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:50.351820 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:16:50.352270 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.352691 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.353378 (+ 687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.353588 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.353644 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:50.354701 (+ 1057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:16:50.354702 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:16:50.354702 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:16:50.354708 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:16:50.355962 (+ 1254us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:50.356306 (+ 344us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:50.356307 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:50.356307 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:50.356385 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:16:50.356621 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:16:50.356621 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:16:50.356621 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:16:50.356715 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:16:50.356789 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:50.356899 (+ 110us) server_negotiation.cc:299] Negotiation successful
0811 08:16:50.356959 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 08:16:50.358260 13503 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52524:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:16:50.359841 13503 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:16:50.362397 13679 tablet_service.cc:1467] Processing CreateTablet for tablet f06bca70e5fe4f32bc0b0ec459fe8af6 (DEFAULT_TABLE table=test-table [id=26d82b7524954f0197cab5fb456c1f97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:16:50.362644 13679 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f06bca70e5fe4f32bc0b0ec459fe8af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:16:50.364349 13621 tablet_bootstrap.cc:492] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab: Bootstrap starting.
I20260811 08:16:50.364696 13621 tablet_bootstrap.cc:654] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab: Neither blocks nor log segments found. Creating new log.
I20260811 08:16:50.365363 13621 tablet_bootstrap.cc:492] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab: No bootstrap required, opened a new log
I20260811 08:16:50.365446 13621 ts_tablet_manager.cc:1397] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260811 08:16:50.365805 13621 raft_consensus.cc:348] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:16:50.365863 13621 raft_consensus.cc:374] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:16:50.365890 13621 raft_consensus.cc:729] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53c154683fce4bb3ae4f8abb0ca372ab, State: Initialized, Role: FOLLOWER
I20260811 08:16:50.365962 13621 consensus_queue.cc:260] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:16:50.366060 13621 ts_tablet_manager.cc:1428] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260811 08:16:50.366254 13828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:50.361782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:46457 (local address 127.0.0.1:40076)
0811 08:16:50.361857 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:50.361867 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:50.361904 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:50.362655 (+ 751us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:50.362656 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:50.362658 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:16:50.362693 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:50.362694 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.363979 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.363980 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:50.365027 (+ 1047us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:50.365029 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.365961 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.365962 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:50.366046 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:50.366051 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:16:50.366086 (+ 35us) client_negotiation.cc:240] Negotiation successful
0811 08:16:50.366127 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260811 08:16:50.366264 14228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:50.361825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:36933 (local address 127.0.0.1:38314)
0811 08:16:50.361968 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:50.361981 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:50.362026 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:50.362484 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:50.362486 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:50.362489 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:16:50.362547 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:50.362549 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.363647 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.363649 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:50.364897 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:50.364900 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.365951 (+ 1051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.365953 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:50.366026 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:50.366051 (+ 25us) client_negotiation.cc:769] Sending connection context
0811 08:16:50.366116 (+ 65us) client_negotiation.cc:240] Negotiation successful
0811 08:16:50.366169 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":90,"threads_started":1}
I20260811 08:16:50.366475 14229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:50.362056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38314 (local address 127.20.158.130:36933)
0811 08:16:50.362287 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:50.362292 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:50.362304 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:16:50.362350 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:50.362352 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:50.362369 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:50.362463 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:16:50.362629 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.363566 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.365112 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.365855 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.365940 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:50.366001 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:50.366307 (+ 306us) server_negotiation.cc:299] Negotiation successful
0811 08:16:50.366383 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":184,"thread_start_us":120,"threads_started":1}
I20260811 08:16:50.366933 14230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:50.362080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40076 (local address 127.20.158.131:46457)
0811 08:16:50.362303 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:50.362307 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:50.362317 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:16:50.362353 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:50.362355 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:50.362369 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:50.362463 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:16:50.362776 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.363899 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.365099 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.365855 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.366474 (+ 619us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:50.366543 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:50.366571 (+ 28us) server_negotiation.cc:299] Negotiation successful
0811 08:16:50.366828 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":186,"thread_start_us":120,"threads_started":1}
I20260811 08:16:50.367283 13916 tablet_service.cc:1467] Processing CreateTablet for tablet f06bca70e5fe4f32bc0b0ec459fe8af6 (DEFAULT_TABLE table=test-table [id=26d82b7524954f0197cab5fb456c1f97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:16:50.367731 13916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f06bca70e5fe4f32bc0b0ec459fe8af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:16:50.367660 14117 tablet_service.cc:1467] Processing CreateTablet for tablet f06bca70e5fe4f32bc0b0ec459fe8af6 (DEFAULT_TABLE table=test-table [id=26d82b7524954f0197cab5fb456c1f97]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:16:50.367980 14117 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f06bca70e5fe4f32bc0b0ec459fe8af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:16:50.370653 14234 tablet_bootstrap.cc:492] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 844793d7f02646ffa042a3888f11ccbc: Bootstrap starting.
I20260811 08:16:50.370841 14235 tablet_bootstrap.cc:492] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd: Bootstrap starting.
I20260811 08:16:50.371281 14234 tablet_bootstrap.cc:654] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 844793d7f02646ffa042a3888f11ccbc: Neither blocks nor log segments found. Creating new log.
I20260811 08:16:50.371443 14235 tablet_bootstrap.cc:654] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd: Neither blocks nor log segments found. Creating new log.
I20260811 08:16:50.371836 14234 log.cc:824] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 844793d7f02646ffa042a3888f11ccbc: Log is configured to *not* fsync() on all Append() calls
I20260811 08:16:50.371974 14235 log.cc:824] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd: Log is configured to *not* fsync() on all Append() calls
I20260811 08:16:50.372620 14234 tablet_bootstrap.cc:492] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 844793d7f02646ffa042a3888f11ccbc: No bootstrap required, opened a new log
I20260811 08:16:50.372678 14234 ts_tablet_manager.cc:1397] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 844793d7f02646ffa042a3888f11ccbc: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:16:50.372694 14235 tablet_bootstrap.cc:492] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd: No bootstrap required, opened a new log
I20260811 08:16:50.372762 14235 ts_tablet_manager.cc:1397] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:16:50.374254 14234 raft_consensus.cc:348] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 844793d7f02646ffa042a3888f11ccbc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:16:50.374394 14234 raft_consensus.cc:374] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 844793d7f02646ffa042a3888f11ccbc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:16:50.374416 14234 raft_consensus.cc:729] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 844793d7f02646ffa042a3888f11ccbc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 844793d7f02646ffa042a3888f11ccbc, State: Initialized, Role: FOLLOWER
I20260811 08:16:50.374477 14235 raft_consensus.cc:348] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:16:50.374549 14234 consensus_queue.cc:260] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 844793d7f02646ffa042a3888f11ccbc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:16:50.374641 14235 raft_consensus.cc:374] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:16:50.374691 14235 raft_consensus.cc:729] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bedb5adb9c09417eab890cd89e0085dd, State: Initialized, Role: FOLLOWER
I20260811 08:16:50.374821 14235 consensus_queue.cc:260] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:16:50.374863 14234 ts_tablet_manager.cc:1428] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 844793d7f02646ffa042a3888f11ccbc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:16:50.374871 14019 heartbeater.cc:503] Master 127.20.158.190:38617 was elected leader, sending a full tablet report...
I20260811 08:16:50.375128 14235 ts_tablet_manager.cc:1428] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:16:50.375135 14218 heartbeater.cc:503] Master 127.20.158.190:38617 was elected leader, sending a full tablet report...
W20260811 08:16:50.445518 14020 tablet.cc:2369] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 844793d7f02646ffa042a3888f11ccbc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:16:50.550824 13816 tablet.cc:2369] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:16:50.584060 14219 tablet.cc:2369] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:16:50.721021 14239 raft_consensus.cc:482] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:16:50.721155 14239 raft_consensus.cc:504] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:16:50.721482 14239 leader_election.cc:288] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 844793d7f02646ffa042a3888f11ccbc (127.20.158.130:36933), 53c154683fce4bb3ae4f8abb0ca372ab (127.20.158.129:44133)
I20260811 08:16:50.725260 14229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:50.721788 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:44689 (local address 127.20.158.130:36933)
0811 08:16:50.721867 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:50.721869 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:50.721880 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:16:50.721911 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:50.721912 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:50.721923 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:50.722015 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:16:50.722174 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.722937 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.724340 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.724885 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.724968 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:50.724979 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:50.725151 (+ 172us) server_negotiation.cc:299] Negotiation successful
0811 08:16:50.725188 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 08:16:50.725272 14241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:50.721779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:40001 (local address 127.20.158.129:44133)
0811 08:16:50.721914 (+ 135us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:50.721916 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:50.721989 (+ 73us) server_negotiation.cc:407] Connection header received
0811 08:16:50.722048 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:50.722049 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:50.722083 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:50.722169 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:16:50.722328 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.723018 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.724333 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.724923 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.724992 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:50.725062 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:50.725144 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 08:16:50.725191 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":72,"threads_started":1}
I20260811 08:16:50.725281 14222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:50.721708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:36933 (local address 127.20.158.131:44689)
0811 08:16:50.721768 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:50.721781 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:50.721839 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:50.722029 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:50.722031 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:50.722033 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:16:50.722101 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:50.722103 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.723009 (+ 906us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.723009 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:50.724249 (+ 1240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:50.724252 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.724985 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.724986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:50.725069 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:50.725071 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:16:50.725131 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 08:16:50.725180 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":4}
I20260811 08:16:50.725288 14240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:50.721708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:44133 (local address 127.20.158.131:40001)
0811 08:16:50.721921 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:50.721930 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:16:50.721978 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:16:50.722199 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:16:50.722200 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:16:50.722201 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:16:50.722264 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:50.722265 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.723082 (+ 817us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.723083 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:50.724249 (+ 1166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:16:50.724252 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.724992 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.724993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:16:50.725066 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:50.725071 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:16:50.725131 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 08:16:50.725181 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"mutex_wait_us":23,"thread_start_us":126,"threads_started":1}
I20260811 08:16:50.725698 13953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f06bca70e5fe4f32bc0b0ec459fe8af6" candidate_uuid: "bedb5adb9c09417eab890cd89e0085dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "844793d7f02646ffa042a3888f11ccbc" is_pre_election: true
I20260811 08:16:50.725824 13953 raft_consensus.cc:2454] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 844793d7f02646ffa042a3888f11ccbc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bedb5adb9c09417eab890cd89e0085dd in term 0.
I20260811 08:16:50.725772 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f06bca70e5fe4f32bc0b0ec459fe8af6" candidate_uuid: "bedb5adb9c09417eab890cd89e0085dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" is_pre_election: true
I20260811 08:16:50.725891 13738 raft_consensus.cc:2454] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bedb5adb9c09417eab890cd89e0085dd in term 0.
I20260811 08:16:50.726085 14046 leader_election.cc:302] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 844793d7f02646ffa042a3888f11ccbc, bedb5adb9c09417eab890cd89e0085dd; no voters:
I20260811 08:16:50.726243 14239 raft_consensus.cc:2781] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:16:50.726300 14239 raft_consensus.cc:482] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:16:50.726317 14239 raft_consensus.cc:3037] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:16:50.727013 14239 raft_consensus.cc:504] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:16:50.727149 14239 leader_election.cc:288] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd [CANDIDATE]: Term 1 election: Requested vote from peers 844793d7f02646ffa042a3888f11ccbc (127.20.158.130:36933), 53c154683fce4bb3ae4f8abb0ca372ab (127.20.158.129:44133)
I20260811 08:16:50.727321 13953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f06bca70e5fe4f32bc0b0ec459fe8af6" candidate_uuid: "bedb5adb9c09417eab890cd89e0085dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "844793d7f02646ffa042a3888f11ccbc"
I20260811 08:16:50.727351 13738 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f06bca70e5fe4f32bc0b0ec459fe8af6" candidate_uuid: "bedb5adb9c09417eab890cd89e0085dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "53c154683fce4bb3ae4f8abb0ca372ab"
I20260811 08:16:50.727401 13953 raft_consensus.cc:3037] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 844793d7f02646ffa042a3888f11ccbc [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:16:50.727438 13738 raft_consensus.cc:3037] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:16:50.728098 13953 raft_consensus.cc:2454] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 844793d7f02646ffa042a3888f11ccbc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bedb5adb9c09417eab890cd89e0085dd in term 1.
I20260811 08:16:50.728128 13738 raft_consensus.cc:2454] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate bedb5adb9c09417eab890cd89e0085dd in term 1.
I20260811 08:16:50.728281 14046 leader_election.cc:302] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 844793d7f02646ffa042a3888f11ccbc, bedb5adb9c09417eab890cd89e0085dd; no voters:
I20260811 08:16:50.728372 14239 raft_consensus.cc:2781] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:16:50.728494 14239 raft_consensus.cc:686] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd [term 1 LEADER]: Becoming Leader. State: Replica: bedb5adb9c09417eab890cd89e0085dd, State: Running, Role: LEADER
I20260811 08:16:50.728600 14239 consensus_queue.cc:237] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:16:50.729502 13502 catalog_manager.cc:5495] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd reported cstate change: term changed from 0 to 1, leader changed from <none> to bedb5adb9c09417eab890cd89e0085dd (127.20.158.131). New cstate: current_term: 1 leader_uuid: "bedb5adb9c09417eab890cd89e0085dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } health_report { overall_health: UNKNOWN } } }
I20260811 08:16:50.807363 14230 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:50.804830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40088 (local address 127.20.158.131:46457)
0811 08:16:50.804892 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0811 08:16:50.804894 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:16:50.804902 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:16:50.804939 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:16:50.804940 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:16:50.804958 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:16:50.805025 (+ 67us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:16:50.805152 (+ 127us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.805697 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.806623 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:16:50.806822 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:16:50.806878 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:16:50.807040 (+ 162us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:16:50.807148 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:16:50.807211 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 08:16:50.807267 (+ 56us) server_negotiation.cc:299] Negotiation successful
0811 08:16:50.807285 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 08:16:50.809399 13953 raft_consensus.cc:1261] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 844793d7f02646ffa042a3888f11ccbc [term 1 FOLLOWER]: Refusing update from remote peer bedb5adb9c09417eab890cd89e0085dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:16:50.809417 13738 raft_consensus.cc:1261] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Refusing update from remote peer bedb5adb9c09417eab890cd89e0085dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:16:50.809787 14239 consensus_queue.cc:1035] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:16:50.809964 14242 consensus_queue.cc:1035] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:16:50.812173 14245 mvcc.cc:205] Tried to move back new op lower bound from 7317242719472365568 to 7317242719144972288. Current Snapshot: MvccSnapshot[applied={T|T < 7317242719472365568}]
I20260811 08:16:50.814921 13503 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52524:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:16:50.815037 13503 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52524:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:16:50.815847 13503 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df: Sending DeleteTablet for 3 replicas of tablet f06bca70e5fe4f32bc0b0ec459fe8af6
I20260811 08:16:50.816258 13679 tablet_service.cc:1514] Processing DeleteTablet for tablet f06bca70e5fe4f32bc0b0ec459fe8af6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:16:50 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:46038
I20260811 08:16:50.816256 13916 tablet_service.cc:1514] Processing DeleteTablet for tablet f06bca70e5fe4f32bc0b0ec459fe8af6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:16:50 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:38314
I20260811 08:16:50.816260 14117 tablet_service.cc:1514] Processing DeleteTablet for tablet f06bca70e5fe4f32bc0b0ec459fe8af6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:16:50 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:40076
I20260811 08:16:50.816557 14259 tablet_replica.cc:330] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab: stopping tablet replica
I20260811 08:16:50.816569 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 13562
I20260811 08:16:50.816634 14259 raft_consensus.cc:2229] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:16:50.816715 14259 raft_consensus.cc:2258] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:16:50.816860 14256 tablet_replica.cc:330] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd: stopping tablet replica
I20260811 08:16:50.816975 14256 raft_consensus.cc:2229] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:16:50.821102 14256 raft_consensus.cc:2258] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:16:50.827026 14256 ts_tablet_manager.cc:1905] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:16:50.829043 14256 ts_tablet_manager.cc:1918] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:16:50.829219 14256 log.cc:1196] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/wal/wals/f06bca70e5fe4f32bc0b0ec459fe8af6
I20260811 08:16:50.829771 14256 ts_tablet_manager.cc:1939] T f06bca70e5fe4f32bc0b0ec459fe8af6 P bedb5adb9c09417eab890cd89e0085dd: Deleting consensus metadata
I20260811 08:16:50.830389 13475 catalog_manager.cc:4841] TS bedb5adb9c09417eab890cd89e0085dd (127.20.158.131:46457): tablet f06bca70e5fe4f32bc0b0ec459fe8af6 (table test-table [id=26d82b7524954f0197cab5fb456c1f97]) successfully deleted
I20260811 08:16:50.841470 14255 tablet_replica.cc:330] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 844793d7f02646ffa042a3888f11ccbc: stopping tablet replica
I20260811 08:16:50.841820 14255 raft_consensus.cc:2229] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 844793d7f02646ffa042a3888f11ccbc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:16:50.842036 14255 raft_consensus.cc:2258] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 844793d7f02646ffa042a3888f11ccbc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:16:50.846056 14255 ts_tablet_manager.cc:1905] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 844793d7f02646ffa042a3888f11ccbc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:16:50.847903 14255 ts_tablet_manager.cc:1918] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 844793d7f02646ffa042a3888f11ccbc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:16:50.847998 14255 log.cc:1196] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 844793d7f02646ffa042a3888f11ccbc: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/wal/wals/f06bca70e5fe4f32bc0b0ec459fe8af6
I20260811 08:16:50.848282 14255 ts_tablet_manager.cc:1939] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 844793d7f02646ffa042a3888f11ccbc: Deleting consensus metadata
I20260811 08:16:50.848969 13481 catalog_manager.cc:4841] TS 844793d7f02646ffa042a3888f11ccbc (127.20.158.130:36933): tablet f06bca70e5fe4f32bc0b0ec459fe8af6 (table test-table [id=26d82b7524954f0197cab5fb456c1f97]) successfully deleted
W20260811 08:16:50.849610 13476 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.158.129:44133 (error 108)
I20260811 08:16:50.850193 14228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:16:50.850041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:44133 (local address 127.0.0.1:46040)
0811 08:16:50.850109 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 08:16:50.850159 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.129:44133: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 08:16:50.850181 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 13825
W20260811 08:16:50.863129 13476 catalog_manager.cc:4584] TS 53c154683fce4bb3ae4f8abb0ca372ab (127.20.158.129:44133): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f06bca70e5fe4f32bc0b0ec459fe8af6: Network error: Client connection negotiation failed: client connection to 127.20.158.129:44133: connect: Connection refused (error 111)
I20260811 08:16:50.877569 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 14024
I20260811 08:16:50.890221 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 13450
I20260811 08:17:10.902283 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:38617
--webserver_interface=127.20.158.190
--webserver_port=40649
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:37253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:38617
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:10.986649 14261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:10.986924 14261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:10.986960 14261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:10.988129 14261 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260811 08:17:10.988200 14261 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260811 08:17:10.988220 14261 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260811 08:17:10.988236 14261 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:17:10.988255 14261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:10.988276 14261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:10.988296 14261 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:17:10.988317 14261 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:17:10.989876 14261 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:37253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:38617
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:38617
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=40649
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14261
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:10.990164 14261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:10.990399 14261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:10.995463 14274 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:10.995452 14270 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:10.995532 14272 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:10.995646 14261 server_base.cc:1034] running on GCE node
I20260811 08:17:10.995995 14261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:10.996358 14261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:10.997623 14261 hybrid_clock.cc:648] HybridClock initialized: now 1786436230997588 us; error 37 us; skew 500 ppm
Aug 11 08:17:10 dist-test-slave-gkw7 krb5kdc[12602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436230, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:11.005786 14261 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:17:11.006284 14261 webserver.cc:460] Webserver started at http://127.20.158.190:40649/ using document root <none> and password file <none>
I20260811 08:17:11.006542 14261 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:11.006592 14261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:11.008009 14261 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:17:11.008765 14287 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:11.008957 14261 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:17:11.009030 14261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "8b8244231d1c4c4aad6f7c454cf833df"
format_stamp: "Formatted at 2026-08-11 08:16:28 on dist-test-slave-gkw7"
server_key: "a57b1c0386b0ad69b94ff9312fae32db"
server_key_iv: "cd10224d95f8c0de439cb4fa43fa2427"
server_key_version: "encryptionkey@0"
I20260811 08:17:11.009430 14261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:11.018148 14261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:11.020156 14261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:11.020269 14261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:11.024430 14261 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:38617
I20260811 08:17:11.024482 14370 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:38617 every 8 connection(s)
I20260811 08:17:11.024878 14261 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:17:11.026439 14371 sys_catalog.cc:263] Verifying existing consensus state
I20260811 08:17:11.027145 14371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df: Bootstrap starting.
I20260811 08:17:11.028647 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 14261
I20260811 08:17:11.028935 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:44133
--local_ip_for_outbound_sockets=127.20.158.129
--tserver_master_addrs=127.20.158.190:38617
--webserver_port=46383
--webserver_interface=127.20.158.129
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:37253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:17:11.037284 14371 log.cc:824] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:11.039868 14371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:17:11.040236 14371 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df: Bootstrap complete.
I20260811 08:17:11.042867 14371 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8244231d1c4c4aad6f7c454cf833df" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38617 } }
I20260811 08:17:11.043144 14371 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b8244231d1c4c4aad6f7c454cf833df, State: Initialized, Role: FOLLOWER
I20260811 08:17:11.043358 14371 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8244231d1c4c4aad6f7c454cf833df" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38617 } }
I20260811 08:17:11.043450 14371 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:17:11.043511 14371 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:17:11.043563 14371 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [term 2 FOLLOWER]: Advancing to term 3
I20260811 08:17:11.044766 14371 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8244231d1c4c4aad6f7c454cf833df" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38617 } }
I20260811 08:17:11.044898 14371 leader_election.cc:302] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8b8244231d1c4c4aad6f7c454cf833df; no voters:
I20260811 08:17:11.045164 14371 leader_election.cc:288] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [CANDIDATE]: Term 3 election: Requested vote from peers
I20260811 08:17:11.045213 14383 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [term 3 FOLLOWER]: Leader election won for term 3
I20260811 08:17:11.045356 14383 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [term 3 LEADER]: Becoming Leader. State: Replica: 8b8244231d1c4c4aad6f7c454cf833df, State: Running, Role: LEADER
I20260811 08:17:11.045516 14371 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:17:11.045552 14383 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8244231d1c4c4aad6f7c454cf833df" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38617 } }
I20260811 08:17:11.046060 14385 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8b8244231d1c4c4aad6f7c454cf833df. Latest consensus state: current_term: 3 leader_uuid: "8b8244231d1c4c4aad6f7c454cf833df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8244231d1c4c4aad6f7c454cf833df" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38617 } } }
I20260811 08:17:11.046172 14385 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:11.046630 14393 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:17:11.047577 14393 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:17:11.047679 14393 catalog_manager.cc:1259] Loaded cluster ID: 7dbfc7cacaac41969a87505b86607ad3
I20260811 08:17:11.047705 14393 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:17:11.048936 14393 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:17:11.049139 14393 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df: Loaded TSK: 0
I20260811 08:17:11.049182 14393 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df: Loaded TSK: 1
F20260811 08:17:11.049444 14393 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
I20260811 08:17:11.049630 14387 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "8b8244231d1c4c4aad6f7c454cf833df" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8b8244231d1c4c4aad6f7c454cf833df" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38617 } } }
I20260811 08:17:11.050143 14387 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8b8244231d1c4c4aad6f7c454cf833df [sys.catalog]: This master's current role is: LEADER
@ 0x7f8d24a3f9ad google::LogMessage::Fail() at ??:0
@ 0x7f8d24a4288a google::LogMessage::SendToLog() at ??:0
@ 0x7f8d24a3f4de google::LogMessage::Flush() at ??:0
@ 0x7f8d24a40a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7f8d271ac104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7f8d271a9d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7f8d2c99d1cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7f8d2c99d48e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7f8d2c99d594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7f8d2c963c48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7f8d2c96dad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7f8d2690d0d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7f8d26902954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7f8d277666db start_thread at ??:0
@ 0x7f8d2353d61f clone at ??:0
W20260811 08:17:11.143394 14381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:11.143702 14381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:11.143743 14381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:11.145478 14381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:11.145569 14381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:11.145623 14381 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:17:11.147861 14381 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:37253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:44133
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=46383
--tserver_master_addrs=127.20.158.190:38617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14381
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:11.148187 14381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:11.148469 14381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:17:11.154350 14381 server_base.cc:1034] running on GCE node
W20260811 08:17:11.154404 14436 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:11.154304 14434 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:11.154314 14433 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:11.154767 14381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:11.155047 14381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:11.156215 14381 hybrid_clock.cc:648] HybridClock initialized: now 1786436231156196 us; error 33 us; skew 500 ppm
Aug 11 08:17:11 dist-test-slave-gkw7 krb5kdc[12602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436231, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:11.159276 14381 init.cc:377] Logged in from keytab as kudu/127.20.158.129@KRBTEST.COM (short username kudu)
I20260811 08:17:11.159828 14381 webserver.cc:460] Webserver started at http://127.20.158.129:46383/ using document root <none> and password file <none>
I20260811 08:17:11.160121 14381 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:11.160204 14381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:11.161751 14381 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 08:17:11.162564 14449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:11.162779 14381 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:17:11.162899 14381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "53c154683fce4bb3ae4f8abb0ca372ab"
format_stamp: "Formatted at 2026-08-11 08:16:28 on dist-test-slave-gkw7"
server_key: "620179adc743f31ccd7e26041d4ef5a4"
server_key_iv: "a0663d1c683eec122aebfda50bd2ee28"
server_key_version: "encryptionkey@0"
I20260811 08:17:11.163295 14381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:11.188448 14381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:11.191356 14381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:11.191553 14381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:11.191838 14381 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:17:11.192345 14460 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260811 08:17:11.194417 14381 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260811 08:17:11.194518 14381 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260811 08:17:11.194608 14381 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260811 08:17:11.195291 14381 ts_tablet_manager.cc:610] Registered 1 tablets
I20260811 08:17:11.195356 14381 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260811 08:17:11.195430 14460 tablet_bootstrap.cc:492] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab: Bootstrap starting.
I20260811 08:17:11.203827 14381 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:44133
I20260811 08:17:11.203966 14637 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:44133 every 8 connection(s)
I20260811 08:17:11.204303 14381 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:17:11.206772 14460 log.cc:824] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:11.206923 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 14381
I20260811 08:17:11.207358 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:36933
--local_ip_for_outbound_sockets=127.20.158.130
--tserver_master_addrs=127.20.158.190:38617
--webserver_port=43371
--webserver_interface=127.20.158.130
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:37253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:17:11.209746 14460 tablet_bootstrap.cc:492] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260811 08:17:11.210094 14460 tablet_bootstrap.cc:492] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab: Bootstrap complete.
I20260811 08:17:11.211484 14460 ts_tablet_manager.cc:1397] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab: Time spent bootstrapping tablet: real 0.016s user 0.014s sys 0.001s
I20260811 08:17:11.213032 14460 raft_consensus.cc:348] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:17:11.213363 14460 raft_consensus.cc:729] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53c154683fce4bb3ae4f8abb0ca372ab, State: Initialized, Role: FOLLOWER
I20260811 08:17:11.213505 14460 consensus_queue.cc:260] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:17:11.213812 14460 ts_tablet_manager.cc:1428] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
W20260811 08:17:11.278959 14641 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:17:11.205018 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.129:51899)
0811 08:17:11.205224 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:11.205271 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:11.205881 (+ 610us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:11.278731 (+ 72850us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":126,"threads_started":1}
W20260811 08:17:11.279286 14638 heartbeater.cc:644] Failed to heartbeat to 127.20.158.190:38617 (0 consecutive failures): Network error: Failed to ping master at 127.20.158.190:38617: Client connection negotiation failed: client connection to 127.20.158.190:38617: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260811 08:17:11.279734 14641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:11.279592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.129:54309)
0811 08:17:11.279647 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:11.279702 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 08:17:11.280350 14641 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:11.280130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.129:59879)
0811 08:17:11.280250 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:11.280293 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
W20260811 08:17:11.280550 14638 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260811 08:17:11.301771 14643 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:11.302012 14643 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:11.302038 14643 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:11.303248 14643 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:11.303298 14643 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:11.303360 14643 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:17:11.305003 14643 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:37253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:36933
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=43371
--tserver_master_addrs=127.20.158.190:38617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14643
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:11.305280 14643 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:11.305630 14643 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:11.310877 14655 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:11.310916 14650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:11.310925 14643 server_base.cc:1034] running on GCE node
W20260811 08:17:11.310891 14651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:11.311298 14643 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:11.311497 14643 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:11.312629 14643 hybrid_clock.cc:648] HybridClock initialized: now 1786436231312609 us; error 42 us; skew 500 ppm
Aug 11 08:17:11 dist-test-slave-gkw7 krb5kdc[12602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436231, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:11.315080 14643 init.cc:377] Logged in from keytab as kudu/127.20.158.130@KRBTEST.COM (short username kudu)
I20260811 08:17:11.315514 14643 webserver.cc:460] Webserver started at http://127.20.158.130:43371/ using document root <none> and password file <none>
I20260811 08:17:11.315765 14643 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:11.315840 14643 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:11.317209 14643 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:17:11.317924 14667 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:11.318104 14643 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:17:11.318213 14643 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "844793d7f02646ffa042a3888f11ccbc"
format_stamp: "Formatted at 2026-08-11 08:16:29 on dist-test-slave-gkw7"
server_key: "25abb781201d38825fd3cf8a309a3601"
server_key_iv: "2b3598f9be7a6c3219be666a7c0f103c"
server_key_version: "encryptionkey@0"
I20260811 08:17:11.318557 14643 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:11.331278 14643 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:11.333227 14643 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:11.333396 14643 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:11.333709 14643 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:17:11.334035 14643 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:17:11.334090 14643 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:11.334131 14643 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:17:11.334158 14643 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:11.340076 14643 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:36933
I20260811 08:17:11.340137 14841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:36933 every 8 connection(s)
I20260811 08:17:11.340530 14643 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
I20260811 08:17:11.341977 14848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:11.341233 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.130:35869)
0811 08:17:11.341400 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:11.341518 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":72,"threads_started":1}
W20260811 08:17:11.342236 14843 heartbeater.cc:644] Failed to heartbeat to 127.20.158.190:38617 (0 consecutive failures): Network error: Failed to ping master at 127.20.158.190:38617: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
I20260811 08:17:11.342514 14848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:11.342418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.130:59145)
0811 08:17:11.342465 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:11.342496 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 08:17:11.342796 14848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:11.342717 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.130:55973)
0811 08:17:11.342757 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:11.342782 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260811 08:17:11.342914 14843 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 08:17:11.344393 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 14643
I20260811 08:17:11.344694 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:46457
--local_ip_for_outbound_sockets=127.20.158.131
--tserver_master_addrs=127.20.158.190:38617
--webserver_port=34915
--webserver_interface=127.20.158.131
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:37253
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:11.431902 14851 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:11.432196 14851 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:11.432241 14851 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:11.433426 14851 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:11.433493 14851 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:11.433535 14851 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:17:11.435022 14851 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:37253
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:46457
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=34915
--tserver_master_addrs=127.20.158.190:38617
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14851
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:11.435309 14851 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:11.435550 14851 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:11.440912 14863 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:11.440918 14860 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:11.440920 14859 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:11.441215 14851 server_base.cc:1034] running on GCE node
I20260811 08:17:11.441439 14851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:11.441709 14851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:11.442876 14851 hybrid_clock.cc:648] HybridClock initialized: now 1786436231442867 us; error 30 us; skew 500 ppm
Aug 11 08:17:11 dist-test-slave-gkw7 krb5kdc[12602](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436231, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:11.445467 14851 init.cc:377] Logged in from keytab as kudu/127.20.158.131@KRBTEST.COM (short username kudu)
I20260811 08:17:11.445940 14851 webserver.cc:460] Webserver started at http://127.20.158.131:34915/ using document root <none> and password file <none>
I20260811 08:17:11.446183 14851 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:11.446257 14851 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:11.447640 14851 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:17:11.448220 14871 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:11.448393 14851 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:17:11.448501 14851 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "bedb5adb9c09417eab890cd89e0085dd"
format_stamp: "Formatted at 2026-08-11 08:16:29 on dist-test-slave-gkw7"
server_key: "9136ab82d006c9569d08343a23ac6e42"
server_key_iv: "45b49049f728931510941b0b67fc2559"
server_key_version: "encryptionkey@0"
I20260811 08:17:11.448910 14851 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:11.463752 14851 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:11.466154 14851 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:11.466316 14851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:11.466583 14851 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:17:11.466898 14851 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:17:11.466952 14851 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:11.466995 14851 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:17:11.467023 14851 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:11.473047 14851 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:46457
I20260811 08:17:11.473102 15061 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:46457 every 8 connection(s)
I20260811 08:17:11.473441 14851 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
I20260811 08:17:11.474524 15065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:11.474158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.131:40011)
0811 08:17:11.474320 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:11.474388 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":74,"threads_started":1}
W20260811 08:17:11.474921 15062 heartbeater.cc:644] Failed to heartbeat to 127.20.158.190:38617 (0 consecutive failures): Network error: Failed to ping master at 127.20.158.190:38617: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
I20260811 08:17:11.475220 15065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:11.475109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.131:38729)
0811 08:17:11.475160 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:11.475186 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 08:17:11.475493 15065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:11.475408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.131:48289)
0811 08:17:11.475451 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:11.475474 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260811 08:17:11.475601 15062 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260811 08:17:11.480824 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 14851
I20260811 08:17:12.281261 15068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:12.280983 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.129:49009)
0811 08:17:12.281155 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:12.281200 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":96,"threads_started":1}
I20260811 08:17:12.343508 15069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:12.343287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.130:45249)
0811 08:17:12.343406 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:12.343449 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101,"thread_start_us":59,"threads_started":1}
I20260811 08:17:12.476161 15070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:12.475910 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.131:59059)
0811 08:17:12.476049 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:12.476106 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":57,"threads_started":1}
I20260811 08:17:12.656391 15071 raft_consensus.cc:482] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:17:12.656517 15071 raft_consensus.cc:504] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:17:12.656842 15071 leader_election.cc:288] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bedb5adb9c09417eab890cd89e0085dd (127.20.158.131:46457), 844793d7f02646ffa042a3888f11ccbc (127.20.158.130:36933)
Aug 11 08:17:12 dist-test-slave-gkw7 krb5kdc[12602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436231, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for kudu/127.20.158.131@KRBTEST.COM
Aug 11 08:17:12 dist-test-slave-gkw7 krb5kdc[12602](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436231, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for kudu/127.20.158.130@KRBTEST.COM
I20260811 08:17:12.667586 15075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:12.657101 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:36765 (local address 127.20.158.131:46457)
0811 08:17:12.657310 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:12.657323 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:12.657363 (+ 40us) server_negotiation.cc:407] Connection header received
0811 08:17:12.657883 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:12.657886 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:12.657930 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:12.658078 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:12.658849 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:12.659714 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:12.660742 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:12.661150 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:12.661270 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:12.663773 (+ 2503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:12.663794 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:12.663795 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:17:12.663809 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:12.665725 (+ 1916us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:12.666193 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:12.666229 (+ 36us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:12.666229 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:12.666351 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:12.666617 (+ 266us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:12.666619 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:12.666619 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:12.666877 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:12.666977 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:12.667302 (+ 325us) server_negotiation.cc:299] Negotiation successful
0811 08:17:12.667446 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":172,"thread_start_us":92,"threads_started":1}
I20260811 08:17:12.667587 15068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:12.656994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:46457 (local address 127.20.158.129:36765)
0811 08:17:12.657051 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:12.657063 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:12.657124 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:12.658140 (+ 1016us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:12.658143 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:12.658540 (+ 397us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:17:12.658725 (+ 185us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:12.658731 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:12.659834 (+ 1103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:12.659835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:12.660639 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:12.660641 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:12.661246 (+ 605us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:12.661247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:12.661362 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:12.662023 (+ 661us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:17:12.662032 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:17:12.663659 (+ 1627us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:17:12.665805 (+ 2146us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:17:12.665812 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:17:12.665814 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:17:12.666107 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:17:12.666433 (+ 326us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:17:12.666434 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:17:12.666435 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:17:12.666546 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:17:12.666957 (+ 411us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:17:12.666964 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:17:12.667098 (+ 134us) client_negotiation.cc:769] Sending connection context
0811 08:17:12.667240 (+ 142us) client_negotiation.cc:240] Negotiation successful
0811 08:17:12.667456 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":39,"mutex_wait_us":5}
I20260811 08:17:12.667838 15076 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:12.657196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:59233 (local address 127.20.158.130:36933)
0811 08:17:12.657339 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:12.657350 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:12.657384 (+ 34us) server_negotiation.cc:407] Connection header received
0811 08:17:12.657884 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:12.657886 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:12.657930 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:12.658070 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:12.658853 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:12.659776 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:12.660736 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:12.661140 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:12.661268 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:12.664195 (+ 2927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:12.664199 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:12.664200 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:17:12.664213 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:12.666322 (+ 2109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:12.666671 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:12.666674 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:12.666675 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:12.666771 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:12.666981 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:12.666982 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:12.666982 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:12.667246 (+ 264us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:12.667324 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:12.667499 (+ 175us) server_negotiation.cc:299] Negotiation successful
0811 08:17:12.667629 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":76,"threads_started":1}
I20260811 08:17:12.667682 15074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:12.657049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:36933 (local address 127.20.158.129:59233)
0811 08:17:12.657165 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:12.657177 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:12.657235 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:12.658175 (+ 940us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:12.658176 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:12.658542 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:17:12.658725 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:12.658731 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:12.659956 (+ 1225us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:12.659957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:12.660638 (+ 681us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:12.660640 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:12.661242 (+ 602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:12.661243 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:12.661364 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:12.662072 (+ 708us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:17:12.662076 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:17:12.664028 (+ 1952us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:17:12.666399 (+ 2371us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:17:12.666400 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:17:12.666401 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:17:12.666570 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:17:12.666848 (+ 278us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:17:12.666849 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:17:12.666849 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:17:12.666916 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:17:12.667306 (+ 390us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:17:12.667307 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:17:12.667351 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 08:17:12.667421 (+ 70us) client_negotiation.cc:240] Negotiation successful
0811 08:17:12.667536 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"mutex_wait_us":1,"thread_start_us":61,"threads_started":1}
W20260811 08:17:12.668779 14455 leader_election.cc:341] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 844793d7f02646ffa042a3888f11ccbc (127.20.158.130:36933): Not found: Tablet not found: f06bca70e5fe4f32bc0b0ec459fe8af6
W20260811 08:17:12.668982 14450 leader_election.cc:341] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bedb5adb9c09417eab890cd89e0085dd (127.20.158.131:46457): Not found: Tablet not found: f06bca70e5fe4f32bc0b0ec459fe8af6
I20260811 08:17:12.669030 14450 leader_election.cc:302] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53c154683fce4bb3ae4f8abb0ca372ab; no voters: 844793d7f02646ffa042a3888f11ccbc, bedb5adb9c09417eab890cd89e0085dd
I20260811 08:17:12.669142 15071 raft_consensus.cc:2726] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 08:17:13.282027 15077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:13.281769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.129:36885)
0811 08:17:13.281941 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:13.281980 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":84,"threads_started":1}
I20260811 08:17:13.344326 15078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:13.344039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.130:44697)
0811 08:17:13.344229 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:13.344278 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":80,"threads_started":1}
I20260811 08:17:13.476933 15079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:13.476691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.131:34823)
0811 08:17:13.476851 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:13.476890 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":78,"threads_started":1}
I20260811 08:17:14.282833 15080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:14.282586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.129:43361)
0811 08:17:14.282744 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:14.282782 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":80,"threads_started":1}
I20260811 08:17:14.345113 15084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:14.344874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.130:54199)
0811 08:17:14.345031 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:14.345070 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":80,"threads_started":1}
I20260811 08:17:14.477741 15087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:14.477523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.131:41321)
0811 08:17:14.477668 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:14.477703 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":67,"threads_started":1}
I20260811 08:17:14.831725 15088 raft_consensus.cc:482] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:17:14.831832 15088 raft_consensus.cc:504] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:17:14.832084 15088 leader_election.cc:288] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bedb5adb9c09417eab890cd89e0085dd (127.20.158.131:46457), 844793d7f02646ffa042a3888f11ccbc (127.20.158.130:36933)
W20260811 08:17:14.832618 14450 leader_election.cc:341] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bedb5adb9c09417eab890cd89e0085dd (127.20.158.131:46457): Not found: Tablet not found: f06bca70e5fe4f32bc0b0ec459fe8af6
W20260811 08:17:14.832726 14455 leader_election.cc:341] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 844793d7f02646ffa042a3888f11ccbc (127.20.158.130:36933): Not found: Tablet not found: f06bca70e5fe4f32bc0b0ec459fe8af6
I20260811 08:17:14.832844 14455 leader_election.cc:302] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53c154683fce4bb3ae4f8abb0ca372ab; no voters: 844793d7f02646ffa042a3888f11ccbc, bedb5adb9c09417eab890cd89e0085dd
I20260811 08:17:14.832998 15088 raft_consensus.cc:2726] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 08:17:15.283519 15089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:15.283305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.129:50869)
0811 08:17:15.283431 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:15.283471 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":67,"threads_started":1}
I20260811 08:17:15.345906 15090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:15.345675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.130:57445)
0811 08:17:15.345816 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:15.345859 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":71,"threads_started":1}
I20260811 08:17:15.478430 15091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:15.478198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.131:50131)
0811 08:17:15.478353 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:15.478389 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":98,"threads_started":1}
I20260811 08:17:16.284297 15092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:16.284012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.129:37095)
0811 08:17:16.284187 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:16.284229 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":106,"threads_started":1}
I20260811 08:17:16.346599 15094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:16.346388 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.130:43133)
0811 08:17:16.346511 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:16.346553 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":62,"threads_started":1}
I20260811 08:17:16.479279 15095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:16.478953 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.131:52193)
0811 08:17:16.479142 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:16.479180 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":101,"threads_started":1}
I20260811 08:17:17.285022 15096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:17.284793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.129:42867)
0811 08:17:17.284935 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:17.284974 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":65,"threads_started":1}
I20260811 08:17:17.347419 15098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:17.347191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.130:40433)
0811 08:17:17.347336 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:17.347374 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":73,"threads_started":1}
I20260811 08:17:17.391809 15099 raft_consensus.cc:482] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:17:17.391906 15099 raft_consensus.cc:504] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:17:17.392088 15099 leader_election.cc:288] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bedb5adb9c09417eab890cd89e0085dd (127.20.158.131:46457), 844793d7f02646ffa042a3888f11ccbc (127.20.158.130:36933)
W20260811 08:17:17.392473 14450 leader_election.cc:341] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bedb5adb9c09417eab890cd89e0085dd (127.20.158.131:46457): Not found: Tablet not found: f06bca70e5fe4f32bc0b0ec459fe8af6
W20260811 08:17:17.392558 14455 leader_election.cc:341] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 844793d7f02646ffa042a3888f11ccbc (127.20.158.130:36933): Not found: Tablet not found: f06bca70e5fe4f32bc0b0ec459fe8af6
I20260811 08:17:17.392683 14455 leader_election.cc:302] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53c154683fce4bb3ae4f8abb0ca372ab; no voters: 844793d7f02646ffa042a3888f11ccbc, bedb5adb9c09417eab890cd89e0085dd
I20260811 08:17:17.392782 15099 raft_consensus.cc:2726] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 08:17:17.480028 15100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:17.479809 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.131:56267)
0811 08:17:17.479940 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:17.479981 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":66,"threads_started":1}
I20260811 08:17:18.285897 15101 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:18.285639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.129:56265)
0811 08:17:18.285803 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:18.285847 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":83,"threads_started":1}
I20260811 08:17:18.348146 15102 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:18.347927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.130:53163)
0811 08:17:18.348060 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:18.348100 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":65,"threads_started":1}
I20260811 08:17:18.480748 15103 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:18.480523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.131:54619)
0811 08:17:18.480663 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:18.480703 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":60,"threads_started":1}
I20260811 08:17:19.286788 15104 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:19.286512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.129:37581)
0811 08:17:19.286687 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:19.286737 (+ 50us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":154,"thread_start_us":84,"threads_started":1}
I20260811 08:17:19.348961 15105 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:19.348708 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.130:57663)
0811 08:17:19.348869 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:19.348912 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":96,"threads_started":1}
I20260811 08:17:19.481519 15106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:19.481293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.131:54963)
0811 08:17:19.481439 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:19.481474 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":83,"threads_started":1}
I20260811 08:17:20.287530 15108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:20.287303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.129:47213)
0811 08:17:20.287443 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:20.287483 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":62,"threads_started":1}
I20260811 08:17:20.349754 15111 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:20.349462 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.130:58241)
0811 08:17:20.349673 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:20.349708 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":194,"thread_start_us":155,"threads_started":1}
I20260811 08:17:20.482324 15112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:20.482081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.131:54897)
0811 08:17:20.482241 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:20.482280 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":89,"threads_started":1}
I20260811 08:17:21.176048 15114 raft_consensus.cc:482] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:17:21.176205 15114 raft_consensus.cc:504] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:17:21.176437 15114 leader_election.cc:288] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bedb5adb9c09417eab890cd89e0085dd (127.20.158.131:46457), 844793d7f02646ffa042a3888f11ccbc (127.20.158.130:36933)
W20260811 08:17:21.176884 14450 leader_election.cc:341] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bedb5adb9c09417eab890cd89e0085dd (127.20.158.131:46457): Not found: Tablet not found: f06bca70e5fe4f32bc0b0ec459fe8af6
W20260811 08:17:21.176940 14455 leader_election.cc:341] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 844793d7f02646ffa042a3888f11ccbc (127.20.158.130:36933): Not found: Tablet not found: f06bca70e5fe4f32bc0b0ec459fe8af6
I20260811 08:17:21.176970 14450 leader_election.cc:302] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53c154683fce4bb3ae4f8abb0ca372ab; no voters: 844793d7f02646ffa042a3888f11ccbc, bedb5adb9c09417eab890cd89e0085dd
I20260811 08:17:21.177031 15114 raft_consensus.cc:2726] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 08:17:21.288224 15117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:21.288008 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.129:59533)
0811 08:17:21.288138 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:21.288171 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":62,"threads_started":1}
I20260811 08:17:21.350560 15120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:21.350302 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.130:38869)
0811 08:17:21.350438 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:21.350501 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":64,"threads_started":1}
I20260811 08:17:21.483155 15121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:21.482890 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.131:52543)
0811 08:17:21.483023 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:21.483103 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":61,"threads_started":1}
I20260811 08:17:22.288965 15123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:22.288747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.129:36557)
0811 08:17:22.288873 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:22.288916 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":66,"threads_started":1}
I20260811 08:17:22.351282 15127 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:22.351038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.130:35733)
0811 08:17:22.351196 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:22.351236 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":64,"threads_started":1}
I20260811 08:17:22.483971 15128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:22.483700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.131:38075)
0811 08:17:22.483857 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:22.483913 (+ 56us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":77,"threads_started":1}
I20260811 08:17:23.148442 15129 raft_consensus.cc:482] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:17:23.148550 15129 raft_consensus.cc:504] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:17:23.148803 15129 leader_election.cc:288] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bedb5adb9c09417eab890cd89e0085dd (127.20.158.131:46457), 844793d7f02646ffa042a3888f11ccbc (127.20.158.130:36933)
W20260811 08:17:23.149264 14450 leader_election.cc:341] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bedb5adb9c09417eab890cd89e0085dd (127.20.158.131:46457): Not found: Tablet not found: f06bca70e5fe4f32bc0b0ec459fe8af6
W20260811 08:17:23.149395 14455 leader_election.cc:341] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 844793d7f02646ffa042a3888f11ccbc (127.20.158.130:36933): Not found: Tablet not found: f06bca70e5fe4f32bc0b0ec459fe8af6
I20260811 08:17:23.149475 14455 leader_election.cc:302] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53c154683fce4bb3ae4f8abb0ca372ab; no voters: 844793d7f02646ffa042a3888f11ccbc, bedb5adb9c09417eab890cd89e0085dd
I20260811 08:17:23.149570 15129 raft_consensus.cc:2726] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 08:17:23.289738 15131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:23.289478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.129:47085)
0811 08:17:23.289641 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:23.289677 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":102,"threads_started":1}
I20260811 08:17:23.352010 15134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:23.351785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.130:58379)
0811 08:17:23.351917 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:23.351960 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":63,"threads_started":1}
I20260811 08:17:23.484731 15135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:23.484497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.131:35163)
0811 08:17:23.484636 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:23.484684 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":65,"threads_started":1}
I20260811 08:17:24.290570 15136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:24.290315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.129:55447)
0811 08:17:24.290471 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:24.290519 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":72,"threads_started":1}
I20260811 08:17:24.352874 15137 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:24.352636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.130:48941)
0811 08:17:24.352784 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:24.352826 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":80,"threads_started":1}
I20260811 08:17:24.485671 15138 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:24.485366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.131:48531)
0811 08:17:24.485521 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:24.485624 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":64,"threads_started":1}
I20260811 08:17:25.291361 15139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:25.291106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.129:42503)
0811 08:17:25.291274 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:25.291312 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":102,"threads_started":1}
I20260811 08:17:25.353631 15141 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:25.353335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.130:58701)
0811 08:17:25.353491 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:25.353573 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":77,"threads_started":1}
I20260811 08:17:25.484834 15142 raft_consensus.cc:482] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:17:25.484943 15142 raft_consensus.cc:504] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bedb5adb9c09417eab890cd89e0085dd" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46457 } } peers { permanent_uuid: "844793d7f02646ffa042a3888f11ccbc" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36933 } } peers { permanent_uuid: "53c154683fce4bb3ae4f8abb0ca372ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 44133 } }
I20260811 08:17:25.485195 15142 leader_election.cc:288] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bedb5adb9c09417eab890cd89e0085dd (127.20.158.131:46457), 844793d7f02646ffa042a3888f11ccbc (127.20.158.130:36933)
W20260811 08:17:25.485625 14455 leader_election.cc:341] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 844793d7f02646ffa042a3888f11ccbc (127.20.158.130:36933): Not found: Tablet not found: f06bca70e5fe4f32bc0b0ec459fe8af6
W20260811 08:17:25.485718 14450 leader_election.cc:341] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer bedb5adb9c09417eab890cd89e0085dd (127.20.158.131:46457): Not found: Tablet not found: f06bca70e5fe4f32bc0b0ec459fe8af6
I20260811 08:17:25.485814 14450 leader_election.cc:302] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53c154683fce4bb3ae4f8abb0ca372ab; no voters: 844793d7f02646ffa042a3888f11ccbc, bedb5adb9c09417eab890cd89e0085dd
I20260811 08:17:25.485939 15142 raft_consensus.cc:2726] T f06bca70e5fe4f32bc0b0ec459fe8af6 P 53c154683fce4bb3ae4f8abb0ca372ab [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260811 08:17:25.486361 15143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:25.486128 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.131:42057)
0811 08:17:25.486254 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:25.486303 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":78,"threads_started":1}
I20260811 08:17:26.292241 15145 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:26.291947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.129:47867)
0811 08:17:26.292150 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:26.292192 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":183,"thread_start_us":66,"threads_started":1}
I20260811 08:17:26.354375 15147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:26.354160 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.130:45261)
0811 08:17:26.354290 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:26.354329 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":59,"threads_started":1}
I20260811 08:17:26.483400 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 14381
I20260811 08:17:26.489831 15148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:26.489568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:38617 (local address 127.20.158.131:47655)
0811 08:17:26.489732 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:26.489768 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.190:38617: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":56,"threads_started":1}
I20260811 08:17:26.496423 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 14643
I20260811 08:17:26.513060 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 14851
2026-08-11T08:17:26Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (59220 ms)
[----------] 30 tests from SecurityITest (242695 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:17:26 dist-test-slave-gkw7 krb5kdc[15152](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:17:26 dist-test-slave-gkw7 krb5kdc[15152](info): set up 2 sockets
Aug 11 08:17:26 dist-test-slave-gkw7 krb5kdc[15152](info): commencing operation
krb5kdc: starting...
W20260811 08:17:27.813679 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.270s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:17:27 dist-test-slave-gkw7 krb5kdc[15152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436247, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:17:27Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:17:27Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:17:27.944636 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:40625
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:34719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:40625
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:28.029093 15178 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:28.029368 15178 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:28.029408 15178 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:28.030580 15178 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:17:28.030659 15178 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:28.030687 15178 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:28.030709 15178 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:17:28.030738 15178 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:17:28.032251 15178 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:34719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:40625
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:40625
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15178
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:28.032545 15178 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:28.032788 15178 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:28.038256 15184 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:28.038300 15178 server_base.cc:1034] running on GCE node
W20260811 08:17:28.038280 15188 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:28.038266 15185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:28.038820 15178 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:28.039132 15178 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:28.040290 15178 hybrid_clock.cc:648] HybridClock initialized: now 1786436248040263 us; error 47 us; skew 500 ppm
Aug 11 08:17:28 dist-test-slave-gkw7 krb5kdc[15152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436248, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:28.047938 15178 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:17:28.048477 15178 webserver.cc:460] Webserver started at http://127.20.158.190:39421/ using document root <none> and password file <none>
I20260811 08:17:28.048691 15178 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:28.048736 15178 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:28.048837 15178 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:28.050021 15178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "6fc7f44d069346c8ab2df678c7e56bff"
format_stamp: "Formatted at 2026-08-11 08:17:28 on dist-test-slave-gkw7"
server_key: "e1218739051e6df9d995643b1215b010"
server_key_iv: "1369c2f77cd5828be62cf9771722f1b4"
server_key_version: "encryptionkey@0"
I20260811 08:17:28.050354 15178 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "6fc7f44d069346c8ab2df678c7e56bff"
format_stamp: "Formatted at 2026-08-11 08:17:28 on dist-test-slave-gkw7"
server_key: "e1218739051e6df9d995643b1215b010"
server_key_iv: "1369c2f77cd5828be62cf9771722f1b4"
server_key_version: "encryptionkey@0"
I20260811 08:17:28.051772 15178 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:17:28.052592 15196 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:28.052834 15178 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:17:28.052934 15178 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "6fc7f44d069346c8ab2df678c7e56bff"
format_stamp: "Formatted at 2026-08-11 08:17:28 on dist-test-slave-gkw7"
server_key: "e1218739051e6df9d995643b1215b010"
server_key_iv: "1369c2f77cd5828be62cf9771722f1b4"
server_key_version: "encryptionkey@0"
I20260811 08:17:28.052996 15178 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:28.064739 15178 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:28.067265 15178 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:28.067390 15178 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:28.071674 15178 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:40625
I20260811 08:17:28.071710 15269 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:40625 every 8 connection(s)
I20260811 08:17:28.072090 15178 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:17:28.073221 15271 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:28.075884 15271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fc7f44d069346c8ab2df678c7e56bff: Bootstrap starting.
I20260811 08:17:28.076565 15271 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6fc7f44d069346c8ab2df678c7e56bff: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:28.076908 15271 log.cc:824] T 00000000000000000000000000000000 P 6fc7f44d069346c8ab2df678c7e56bff: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:28.077852 15271 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6fc7f44d069346c8ab2df678c7e56bff: No bootstrap required, opened a new log
I20260811 08:17:28.079480 15271 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6fc7f44d069346c8ab2df678c7e56bff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fc7f44d069346c8ab2df678c7e56bff" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 40625 } }
I20260811 08:17:28.079648 15271 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6fc7f44d069346c8ab2df678c7e56bff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:28.079701 15271 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6fc7f44d069346c8ab2df678c7e56bff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6fc7f44d069346c8ab2df678c7e56bff, State: Initialized, Role: FOLLOWER
I20260811 08:17:28.079851 15271 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6fc7f44d069346c8ab2df678c7e56bff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fc7f44d069346c8ab2df678c7e56bff" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 40625 } }
I20260811 08:17:28.079937 15271 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6fc7f44d069346c8ab2df678c7e56bff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:17:28.079982 15271 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6fc7f44d069346c8ab2df678c7e56bff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:17:28.080035 15271 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6fc7f44d069346c8ab2df678c7e56bff [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:28.080322 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 15178
I20260811 08:17:28.080454 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:17:28.080674 21114 external_mini_cluster.cc:1428] Setting key cb0bad132f3447d3f3bf4e11383f9a3a
I20260811 08:17:28.080718 15271 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6fc7f44d069346c8ab2df678c7e56bff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fc7f44d069346c8ab2df678c7e56bff" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 40625 } }
I20260811 08:17:28.080828 15271 leader_election.cc:302] T 00000000000000000000000000000000 P 6fc7f44d069346c8ab2df678c7e56bff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6fc7f44d069346c8ab2df678c7e56bff; no voters:
I20260811 08:17:28.081004 15271 leader_election.cc:288] T 00000000000000000000000000000000 P 6fc7f44d069346c8ab2df678c7e56bff [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:17:28.081040 15278 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6fc7f44d069346c8ab2df678c7e56bff [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:17:28.081506 15278 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6fc7f44d069346c8ab2df678c7e56bff [term 1 LEADER]: Becoming Leader. State: Replica: 6fc7f44d069346c8ab2df678c7e56bff, State: Running, Role: LEADER
I20260811 08:17:28.081579 15271 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6fc7f44d069346c8ab2df678c7e56bff [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:17:28.081676 15278 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6fc7f44d069346c8ab2df678c7e56bff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fc7f44d069346c8ab2df678c7e56bff" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 40625 } }
I20260811 08:17:28.082216 15283 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fc7f44d069346c8ab2df678c7e56bff [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6fc7f44d069346c8ab2df678c7e56bff. Latest consensus state: current_term: 1 leader_uuid: "6fc7f44d069346c8ab2df678c7e56bff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fc7f44d069346c8ab2df678c7e56bff" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 40625 } } }
I20260811 08:17:28.082324 15283 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fc7f44d069346c8ab2df678c7e56bff [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:28.082635 15294 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:17:28.083209 15294 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:17:28.084812 15282 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6fc7f44d069346c8ab2df678c7e56bff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6fc7f44d069346c8ab2df678c7e56bff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6fc7f44d069346c8ab2df678c7e56bff" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 40625 } } }
I20260811 08:17:28.085036 15282 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6fc7f44d069346c8ab2df678c7e56bff [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:28.085045 15294 catalog_manager.cc:1347] Generated new cluster ID: f2a1f28d6fb94591953b9df14b7a5ed9
I20260811 08:17:28.085206 15294 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:17:28 dist-test-slave-gkw7 krb5kdc[15152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436247, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:17:28.092720 15280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:28.081195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59242 (local address 127.20.158.190:40625)
0811 08:17:28.081370 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:28.081382 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:28.081425 (+ 43us) server_negotiation.cc:407] Connection header received
0811 08:17:28.081626 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:28.081634 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:28.081702 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:28.081887 (+ 185us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:28.082789 (+ 902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.084176 (+ 1387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.085263 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.085913 (+ 650us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.086005 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:28.088795 (+ 2790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:28.088799 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:28.088799 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:17:28.088811 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:28.090851 (+ 2040us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:28.091216 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:28.091219 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:28.091219 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:28.091329 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:28.091511 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:28.091512 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:28.091512 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:28.091812 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:28.091949 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:28.092357 (+ 408us) server_negotiation.cc:299] Negotiation successful
0811 08:17:28.092487 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":81,"threads_started":1}
I20260811 08:17:28.101495 15294 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:17:28.102293 15294 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:17:28.116225 15294 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6fc7f44d069346c8ab2df678c7e56bff: Generated new TSK 0
I20260811 08:17:28.116466 15294 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.158.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
I20260811 08:17:28.148891 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:0
--local_ip_for_outbound_sockets=127.20.158.129
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:40625
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:34719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:28.236989 15311 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:28.237239 15311 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:28.237282 15311 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:28.238507 15311 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:28.238586 15311 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:28.238633 15311 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:17:28.240130 15311 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:34719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:40625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15311
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:28.240396 15311 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:28.240659 15311 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:28.245973 15326 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:28.245980 15329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:28.246047 15311 server_base.cc:1034] running on GCE node
W20260811 08:17:28.245994 15324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:28.246418 15311 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:28.246662 15311 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:28.247824 15311 hybrid_clock.cc:648] HybridClock initialized: now 1786436248247803 us; error 34 us; skew 500 ppm
Aug 11 08:17:28 dist-test-slave-gkw7 krb5kdc[15152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436248, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:28.250509 15311 init.cc:377] Logged in from keytab as kudu/127.20.158.129@KRBTEST.COM (short username kudu)
I20260811 08:17:28.250968 15311 webserver.cc:460] Webserver started at http://127.20.158.129:38565/ using document root <none> and password file <none>
I20260811 08:17:28.251222 15311 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:28.251295 15311 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:28.251448 15311 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:28.252559 15311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-0/data/instance:
uuid: "369ef2b94ac34df683609026ad7718ab"
format_stamp: "Formatted at 2026-08-11 08:17:28 on dist-test-slave-gkw7"
server_key: "cea7e791238a31879488fa2ddac192a8"
server_key_iv: "c31d86f286c4dc5552ecdf326897fc7c"
server_key_version: "encryptionkey@0"
I20260811 08:17:28.252938 15311 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance:
uuid: "369ef2b94ac34df683609026ad7718ab"
format_stamp: "Formatted at 2026-08-11 08:17:28 on dist-test-slave-gkw7"
server_key: "cea7e791238a31879488fa2ddac192a8"
server_key_iv: "c31d86f286c4dc5552ecdf326897fc7c"
server_key_version: "encryptionkey@0"
I20260811 08:17:28.254426 15311 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.002s
I20260811 08:17:28.255290 15338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:28.255507 15311 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:17:28.255637 15311 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "369ef2b94ac34df683609026ad7718ab"
format_stamp: "Formatted at 2026-08-11 08:17:28 on dist-test-slave-gkw7"
server_key: "cea7e791238a31879488fa2ddac192a8"
server_key_iv: "c31d86f286c4dc5552ecdf326897fc7c"
server_key_version: "encryptionkey@0"
I20260811 08:17:28.255721 15311 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:28.263757 15311 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:28.265841 15311 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:28.266033 15311 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:28.266304 15311 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:17:28.266645 15311 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:17:28.266707 15311 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:28.266754 15311 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:17:28.266790 15311 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:28.273535 15311 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:41117
I20260811 08:17:28.273615 15513 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:41117 every 8 connection(s)
I20260811 08:17:28.273959 15311 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:17:28.274933 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 15311
I20260811 08:17:28.275113 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance
I20260811 08:17:28.275362 21114 external_mini_cluster.cc:1428] Setting key e48dcdbb09a01badbea2d007f0ebb882
Aug 11 08:17:28 dist-test-slave-gkw7 krb5kdc[15152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436248, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:17:28.284754 15280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:28.274741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:34461 (local address 127.20.158.190:40625)
0811 08:17:28.274829 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:28.274832 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:28.274990 (+ 158us) server_negotiation.cc:407] Connection header received
0811 08:17:28.275660 (+ 670us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:28.275662 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:28.275681 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:28.275781 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:28.276830 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.277350 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.278436 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.278647 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.278730 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:28.281353 (+ 2623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:28.281354 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:28.281354 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:17:28.281362 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:28.283104 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:28.283625 (+ 521us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:28.283626 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:28.283626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:28.283686 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:28.284012 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:28.284014 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:28.284014 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:28.284152 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:28.284221 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:28.284611 (+ 390us) server_negotiation.cc:299] Negotiation successful
0811 08:17:28.284687 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260811 08:17:28.285003 15518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:28.274678 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:40625 (local address 127.20.158.129:34461)
0811 08:17:28.274848 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:28.274891 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:28.275546 (+ 655us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:28.275852 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:28.275856 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:28.276514 (+ 658us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:17:28.276717 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:28.276722 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.277457 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.277458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:28.278338 (+ 880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:28.278340 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.278738 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.278739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:28.278877 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:28.279413 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:17:28.279422 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:17:28.281244 (+ 1822us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:17:28.283201 (+ 1957us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:17:28.283209 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:17:28.283211 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:17:28.283540 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:17:28.283760 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:17:28.283761 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:17:28.283762 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:17:28.283915 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:17:28.284237 (+ 322us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:17:28.284245 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:17:28.284420 (+ 175us) client_negotiation.cc:769] Sending connection context
0811 08:17:28.284552 (+ 132us) client_negotiation.cc:240] Negotiation successful
0811 08:17:28.284735 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":91,"threads_started":1}
I20260811 08:17:28.285706 15515 heartbeater.cc:347] Connected to a master server at 127.20.158.190:40625
I20260811 08:17:28.285815 15515 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.20.158.130@KRBTEST.COM; defaulting to no policy
I20260811 08:17:28.286031 15515 heartbeater.cc:511] Master 127.20.158.190:40625 requested a full tablet report, sending...
I20260811 08:17:28.286597 15224 ts_manager.cc:194] Registered new tserver with Master: 369ef2b94ac34df683609026ad7718ab (127.20.158.129:41117)
I20260811 08:17:28.287356 15224 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.129@KRBTEST.COM'} at 127.20.158.129:34461
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
I20260811 08:17:28.304737 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:0
--local_ip_for_outbound_sockets=127.20.158.130
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:40625
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:34719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:28.389767 15522 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:28.390000 15522 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:28.390039 15522 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:28.391248 15522 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:28.391323 15522 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:28.391369 15522 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:17:28.392935 15522 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:34719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:40625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15522
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:28.393203 15522 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:28.393445 15522 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:28.398620 15528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:28.398630 15531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:28.398630 15529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:28.398960 15522 server_base.cc:1034] running on GCE node
I20260811 08:17:28.399178 15522 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:28.399466 15522 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:28.400636 15522 hybrid_clock.cc:648] HybridClock initialized: now 1786436248400624 us; error 32 us; skew 500 ppm
Aug 11 08:17:28 dist-test-slave-gkw7 krb5kdc[15152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436248, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:28.403234 15522 init.cc:377] Logged in from keytab as kudu/127.20.158.130@KRBTEST.COM (short username kudu)
I20260811 08:17:28.403702 15522 webserver.cc:460] Webserver started at http://127.20.158.130:36411/ using document root <none> and password file <none>
I20260811 08:17:28.403941 15522 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:28.404013 15522 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:28.404175 15522 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:28.405257 15522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-1/data/instance:
uuid: "887f286a55fe42c4a545effd3f4316da"
format_stamp: "Formatted at 2026-08-11 08:17:28 on dist-test-slave-gkw7"
server_key: "e98edeb63b31feb30badc7091248f99a"
server_key_iv: "4572a07d34699e8ec0de7f0115147107"
server_key_version: "encryptionkey@0"
I20260811 08:17:28.405701 15522 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance:
uuid: "887f286a55fe42c4a545effd3f4316da"
format_stamp: "Formatted at 2026-08-11 08:17:28 on dist-test-slave-gkw7"
server_key: "e98edeb63b31feb30badc7091248f99a"
server_key_iv: "4572a07d34699e8ec0de7f0115147107"
server_key_version: "encryptionkey@0"
I20260811 08:17:28.407135 15522 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:17:28.407949 15539 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:28.408149 15522 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:17:28.408255 15522 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "887f286a55fe42c4a545effd3f4316da"
format_stamp: "Formatted at 2026-08-11 08:17:28 on dist-test-slave-gkw7"
server_key: "e98edeb63b31feb30badc7091248f99a"
server_key_iv: "4572a07d34699e8ec0de7f0115147107"
server_key_version: "encryptionkey@0"
I20260811 08:17:28.408342 15522 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:28.429153 15522 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:28.431274 15522 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:28.431459 15522 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:28.431738 15522 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:17:28.432085 15522 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:17:28.432147 15522 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:28.432190 15522 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:17:28.432216 15522 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:28.438480 15522 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:37569
I20260811 08:17:28.438534 15694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:37569 every 8 connection(s)
I20260811 08:17:28.438876 15522 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
I20260811 08:17:28.441335 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 15522
I20260811 08:17:28.441469 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance
I20260811 08:17:28.441728 21114 external_mini_cluster.cc:1428] Setting key c3a4f49c111bd4992187ed233862d3b0
Aug 11 08:17:28 dist-test-slave-gkw7 krb5kdc[15152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436248, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:17:28.449790 15280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:28.439675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:48277 (local address 127.20.158.190:40625)
0811 08:17:28.439753 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:28.439755 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:28.439958 (+ 203us) server_negotiation.cc:407] Connection header received
0811 08:17:28.440446 (+ 488us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:28.440448 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:28.440459 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:28.440527 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:28.441556 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.442231 (+ 675us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.443779 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.444064 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.444140 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:28.446560 (+ 2420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:28.446561 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:28.446562 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:17:28.446570 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:28.448318 (+ 1748us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:28.448704 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:28.448705 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:28.448706 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:28.448771 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:28.449024 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:28.449026 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:28.449026 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:28.449186 (+ 160us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:28.449261 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:28.449513 (+ 252us) server_negotiation.cc:299] Negotiation successful
0811 08:17:28.449651 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 08:17:28.449811 15699 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:28.439648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:40625 (local address 127.20.158.130:48277)
0811 08:17:28.439823 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:28.439867 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:28.440343 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:28.440582 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:28.440585 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:28.441169 (+ 584us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:17:28.441424 (+ 255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:28.441431 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.442346 (+ 915us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.442348 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:28.443669 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:28.443673 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.444169 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.444170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:28.444334 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:28.444953 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:17:28.444961 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:17:28.446466 (+ 1505us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:17:28.448400 (+ 1934us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:17:28.448406 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:17:28.448408 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:17:28.448624 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:17:28.448841 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:17:28.448841 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:17:28.448841 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:17:28.448942 (+ 101us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:17:28.449254 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:17:28.449260 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:17:28.449377 (+ 117us) client_negotiation.cc:769] Sending connection context
0811 08:17:28.449463 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 08:17:28.449644 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":98,"threads_started":1}
I20260811 08:17:28.450361 15696 heartbeater.cc:347] Connected to a master server at 127.20.158.190:40625
I20260811 08:17:28.450479 15696 heartbeater.cc:464] Registering TS with master...
I20260811 08:17:28.450691 15696 heartbeater.cc:511] Master 127.20.158.190:40625 requested a full tablet report, sending...
I20260811 08:17:28.451107 15224 ts_manager.cc:194] Registered new tserver with Master: 887f286a55fe42c4a545effd3f4316da (127.20.158.130:37569)
I20260811 08:17:28.451510 15224 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.130@KRBTEST.COM'} at 127.20.158.130:48277
WARNING: no policy specified for kudu/127.20.158.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
I20260811 08:17:28.472855 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:0
--local_ip_for_outbound_sockets=127.20.158.131
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:40625
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:34719
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:28.558640 15702 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:28.558902 15702 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:28.558943 15702 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:28.560148 15702 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:28.560216 15702 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:28.560261 15702 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:17:28.561825 15702 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:34719
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:40625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15702
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:28.562093 15702 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:28.562336 15702 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:28.567459 15714 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:28.567495 15716 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:28.567458 15712 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:28.567829 15702 server_base.cc:1034] running on GCE node
I20260811 08:17:28.568048 15702 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:28.568315 15702 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:28.569473 15702 hybrid_clock.cc:648] HybridClock initialized: now 1786436248569452 us; error 45 us; skew 500 ppm
Aug 11 08:17:28 dist-test-slave-gkw7 krb5kdc[15152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436248, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:28.571965 15702 init.cc:377] Logged in from keytab as kudu/127.20.158.131@KRBTEST.COM (short username kudu)
I20260811 08:17:28.572422 15702 webserver.cc:460] Webserver started at http://127.20.158.131:40059/ using document root <none> and password file <none>
I20260811 08:17:28.572628 15702 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:28.572675 15702 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:28.572769 15702 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:28.573884 15702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-2/data/instance:
uuid: "90a77fe0d781455e97f35934e4a701c1"
format_stamp: "Formatted at 2026-08-11 08:17:28 on dist-test-slave-gkw7"
server_key: "b3f67ed22f7e0d59ffd389fb445e8ead"
server_key_iv: "c9fa978700e2fc3375bd38597d73ca91"
server_key_version: "encryptionkey@0"
I20260811 08:17:28.574213 15702 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance:
uuid: "90a77fe0d781455e97f35934e4a701c1"
format_stamp: "Formatted at 2026-08-11 08:17:28 on dist-test-slave-gkw7"
server_key: "b3f67ed22f7e0d59ffd389fb445e8ead"
server_key_iv: "c9fa978700e2fc3375bd38597d73ca91"
server_key_version: "encryptionkey@0"
I20260811 08:17:28.575493 15702 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 08:17:28.576293 15726 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:28.576504 15702 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:17:28.576596 15702 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "90a77fe0d781455e97f35934e4a701c1"
format_stamp: "Formatted at 2026-08-11 08:17:28 on dist-test-slave-gkw7"
server_key: "b3f67ed22f7e0d59ffd389fb445e8ead"
server_key_iv: "c9fa978700e2fc3375bd38597d73ca91"
server_key_version: "encryptionkey@0"
I20260811 08:17:28.576650 15702 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:28.584537 15702 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:28.586443 15702 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:28.586553 15702 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:28.586732 15702 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:17:28.586978 15702 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:17:28.587008 15702 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:28.587028 15702 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:17:28.587040 15702 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:28.593044 15702 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:46251
I20260811 08:17:28.593127 15897 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:46251 every 8 connection(s)
I20260811 08:17:28.593446 15702 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
I20260811 08:17:28.598634 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 15702
I20260811 08:17:28.598769 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance
I20260811 08:17:28.598977 21114 external_mini_cluster.cc:1428] Setting key 99dc54f805542773d5f9a3d16e74a487
Aug 11 08:17:28 dist-test-slave-gkw7 krb5kdc[15152](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436248, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:17:28.602726 15280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:28.594255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:51651 (local address 127.20.158.190:40625)
0811 08:17:28.594324 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:28.594326 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:28.594523 (+ 197us) server_negotiation.cc:407] Connection header received
0811 08:17:28.595031 (+ 508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:28.595033 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:28.595053 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:28.595108 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:28.596073 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.596583 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.597701 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.597914 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.597972 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:28.600298 (+ 2326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:28.600299 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:28.600299 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:17:28.600306 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:28.601523 (+ 1217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:28.601938 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:28.601939 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:28.601939 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:28.601993 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:28.602209 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:28.602210 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:28.602210 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:28.602316 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:28.602368 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:28.602594 (+ 226us) server_negotiation.cc:299] Negotiation successful
0811 08:17:28.602662 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 08:17:28.602908 15900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:28.594253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:40625 (local address 127.20.158.131:51651)
0811 08:17:28.594419 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:28.594454 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:28.594930 (+ 476us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:28.595206 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:28.595209 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:28.595792 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:17:28.595989 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:28.595993 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.596693 (+ 700us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.596694 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:28.597516 (+ 822us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:28.597518 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.597985 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.597986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:28.598102 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:28.598618 (+ 516us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:17:28.598629 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:17:28.600216 (+ 1587us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:17:28.601634 (+ 1418us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:17:28.601640 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:17:28.601642 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:17:28.601874 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:17:28.602051 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:17:28.602052 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:17:28.602052 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:17:28.602155 (+ 103us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:17:28.602371 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:17:28.602375 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:17:28.602489 (+ 114us) client_negotiation.cc:769] Sending connection context
0811 08:17:28.602570 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 08:17:28.602692 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":88,"threads_started":1}
I20260811 08:17:28.603456 15898 heartbeater.cc:347] Connected to a master server at 127.20.158.190:40625
I20260811 08:17:28.603572 15898 heartbeater.cc:464] Registering TS with master...
I20260811 08:17:28.603770 15898 heartbeater.cc:511] Master 127.20.158.190:40625 requested a full tablet report, sending...
I20260811 08:17:28.604197 15224 ts_manager.cc:194] Registered new tserver with Master: 90a77fe0d781455e97f35934e4a701c1 (127.20.158.131:46251)
I20260811 08:17:28.604580 15224 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.131@KRBTEST.COM'} at 127.20.158.131:51651
I20260811 08:17:28.610765 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:17:28.619083 15280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:28.612239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59248 (local address 127.20.158.190:40625)
0811 08:17:28.612304 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:28.612306 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:28.612481 (+ 175us) server_negotiation.cc:407] Connection header received
0811 08:17:28.612551 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:28.612552 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:28.612563 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:28.612621 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:28.613216 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.613807 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.614551 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.614769 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.614847 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:28.616115 (+ 1268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:28.616116 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:28.616117 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:17:28.616125 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:28.617809 (+ 1684us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:28.618220 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:28.618222 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:28.618222 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:28.618289 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:28.618499 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:28.618500 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:28.618501 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:28.618666 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:28.618776 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:28.618899 (+ 123us) server_negotiation.cc:299] Negotiation successful
0811 08:17:28.618981 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260811 08:17:28.620726 15224 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59248:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:17:28.622562 15224 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:17:28.629392 15913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:28.625108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:41117 (local address 127.0.0.1:54706)
0811 08:17:28.625265 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:28.625312 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:28.625390 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:28.625955 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:28.625959 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:28.625961 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:28.626040 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:28.626042 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.626959 (+ 917us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.626961 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:28.628183 (+ 1222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:28.628186 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.629040 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.629041 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:28.629126 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:28.629141 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 08:17:28.629252 (+ 111us) client_negotiation.cc:240] Negotiation successful
0811 08:17:28.629315 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":85,"threads_started":1}
I20260811 08:17:28.629411 15915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:28.625248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54706 (local address 127.20.158.129:41117)
0811 08:17:28.625689 (+ 441us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:28.625694 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:28.625706 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:17:28.625749 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:28.625751 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:28.625768 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:28.625848 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:28.626128 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.626851 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.628279 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.628927 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.629037 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:28.629113 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:28.629272 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 08:17:28.629317 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":400,"thread_start_us":107,"threads_started":1}
I20260811 08:17:28.629832 15921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:28.625700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33698 (local address 127.20.158.130:37569)
0811 08:17:28.625881 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:28.625886 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:28.625897 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:17:28.625942 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:28.625944 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:28.625962 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:28.626056 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:28.626152 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.627288 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.628526 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.629279 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.629615 (+ 336us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:28.629686 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:28.629713 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 08:17:28.629755 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":106,"threads_started":1}
I20260811 08:17:28.630193 15918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:28.625442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40624 (local address 127.20.158.131:46251)
0811 08:17:28.625945 (+ 503us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:28.625949 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:28.625959 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:17:28.626001 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:28.626003 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:28.626019 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:28.626296 (+ 277us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:28.626361 (+ 65us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.627417 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.628651 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.629318 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.629978 (+ 660us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:28.630042 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:28.630067 (+ 25us) server_negotiation.cc:299] Negotiation successful
0811 08:17:28.630112 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":80,"threads_started":1}
I20260811 08:17:28.629812 15916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:28.625336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:46251 (local address 127.0.0.1:40624)
0811 08:17:28.625473 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:28.625484 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:28.625569 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:28.626144 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:28.626145 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:28.626147 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:28.626206 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:28.626208 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.627533 (+ 1325us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.627534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:28.628538 (+ 1004us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:28.628553 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.629405 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.629406 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:28.629459 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:28.629466 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 08:17:28.629498 (+ 32us) client_negotiation.cc:240] Negotiation successful
0811 08:17:28.629563 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"mutex_wait_us":1,"thread_start_us":93,"threads_started":1}
I20260811 08:17:28.629911 15919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:28.625556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:37569 (local address 127.0.0.1:33698)
0811 08:17:28.625687 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:28.625697 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:28.625740 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:28.626049 (+ 309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:28.626050 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:28.626052 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:28.626086 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:28.626087 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.627410 (+ 1323us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.627412 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:28.628435 (+ 1023us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:28.628437 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.629391 (+ 954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.629392 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:28.629459 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:28.629467 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 08:17:28.629498 (+ 31us) client_negotiation.cc:240] Negotiation successful
0811 08:17:28.629564 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":111,"mutex_wait_us":2,"thread_start_us":91,"threads_started":1}
I20260811 08:17:28.631901 15415 tablet_service.cc:1467] Processing CreateTablet for tablet 8ada9920e4c14c5caf66cba11934e4cc (DEFAULT_TABLE table=test-table [id=39497d0b442241648b3362ee4c6d7ff7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:17:28.631968 15603 tablet_service.cc:1467] Processing CreateTablet for tablet 8ada9920e4c14c5caf66cba11934e4cc (DEFAULT_TABLE table=test-table [id=39497d0b442241648b3362ee4c6d7ff7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:17:28.632316 15415 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ada9920e4c14c5caf66cba11934e4cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:28.632349 15603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ada9920e4c14c5caf66cba11934e4cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:28.633989 15798 tablet_service.cc:1467] Processing CreateTablet for tablet 8ada9920e4c14c5caf66cba11934e4cc (DEFAULT_TABLE table=test-table [id=39497d0b442241648b3362ee4c6d7ff7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:17:28.634461 15798 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ada9920e4c14c5caf66cba11934e4cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:28.635572 15922 tablet_bootstrap.cc:492] T 8ada9920e4c14c5caf66cba11934e4cc P 887f286a55fe42c4a545effd3f4316da: Bootstrap starting.
I20260811 08:17:28.635900 15924 tablet_bootstrap.cc:492] T 8ada9920e4c14c5caf66cba11934e4cc P 369ef2b94ac34df683609026ad7718ab: Bootstrap starting.
I20260811 08:17:28.636343 15922 tablet_bootstrap.cc:654] T 8ada9920e4c14c5caf66cba11934e4cc P 887f286a55fe42c4a545effd3f4316da: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:28.636656 15924 tablet_bootstrap.cc:654] T 8ada9920e4c14c5caf66cba11934e4cc P 369ef2b94ac34df683609026ad7718ab: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:28.637125 15922 log.cc:824] T 8ada9920e4c14c5caf66cba11934e4cc P 887f286a55fe42c4a545effd3f4316da: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:28.637362 15924 log.cc:824] T 8ada9920e4c14c5caf66cba11934e4cc P 369ef2b94ac34df683609026ad7718ab: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:28.637913 15927 tablet_bootstrap.cc:492] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1: Bootstrap starting.
I20260811 08:17:28.638067 15922 tablet_bootstrap.cc:492] T 8ada9920e4c14c5caf66cba11934e4cc P 887f286a55fe42c4a545effd3f4316da: No bootstrap required, opened a new log
I20260811 08:17:28.638142 15922 ts_tablet_manager.cc:1397] T 8ada9920e4c14c5caf66cba11934e4cc P 887f286a55fe42c4a545effd3f4316da: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260811 08:17:28.638630 15927 tablet_bootstrap.cc:654] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:28.639235 15927 log.cc:824] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:28.640058 15927 tablet_bootstrap.cc:492] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1: No bootstrap required, opened a new log
I20260811 08:17:28.640146 15927 ts_tablet_manager.cc:1397] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:17:28.640374 15922 raft_consensus.cc:348] T 8ada9920e4c14c5caf66cba11934e4cc P 887f286a55fe42c4a545effd3f4316da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369ef2b94ac34df683609026ad7718ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41117 } } peers { permanent_uuid: "90a77fe0d781455e97f35934e4a701c1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46251 } } peers { permanent_uuid: "887f286a55fe42c4a545effd3f4316da" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37569 } }
I20260811 08:17:28.640594 15922 raft_consensus.cc:374] T 8ada9920e4c14c5caf66cba11934e4cc P 887f286a55fe42c4a545effd3f4316da [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:28.640645 15922 raft_consensus.cc:729] T 8ada9920e4c14c5caf66cba11934e4cc P 887f286a55fe42c4a545effd3f4316da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 887f286a55fe42c4a545effd3f4316da, State: Initialized, Role: FOLLOWER
I20260811 08:17:28.640774 15922 consensus_queue.cc:260] T 8ada9920e4c14c5caf66cba11934e4cc P 887f286a55fe42c4a545effd3f4316da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369ef2b94ac34df683609026ad7718ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41117 } } peers { permanent_uuid: "90a77fe0d781455e97f35934e4a701c1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46251 } } peers { permanent_uuid: "887f286a55fe42c4a545effd3f4316da" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37569 } }
I20260811 08:17:28.641113 15922 ts_tablet_manager.cc:1428] T 8ada9920e4c14c5caf66cba11934e4cc P 887f286a55fe42c4a545effd3f4316da: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:17:28.641134 15696 heartbeater.cc:503] Master 127.20.158.190:40625 was elected leader, sending a full tablet report...
I20260811 08:17:28.641927 15924 tablet_bootstrap.cc:492] T 8ada9920e4c14c5caf66cba11934e4cc P 369ef2b94ac34df683609026ad7718ab: No bootstrap required, opened a new log
I20260811 08:17:28.642009 15924 ts_tablet_manager.cc:1397] T 8ada9920e4c14c5caf66cba11934e4cc P 369ef2b94ac34df683609026ad7718ab: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s
I20260811 08:17:28.642215 15927 raft_consensus.cc:348] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369ef2b94ac34df683609026ad7718ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41117 } } peers { permanent_uuid: "90a77fe0d781455e97f35934e4a701c1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46251 } } peers { permanent_uuid: "887f286a55fe42c4a545effd3f4316da" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37569 } }
I20260811 08:17:28.642367 15927 raft_consensus.cc:374] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:28.642393 15927 raft_consensus.cc:729] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90a77fe0d781455e97f35934e4a701c1, State: Initialized, Role: FOLLOWER
I20260811 08:17:28.642509 15927 consensus_queue.cc:260] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369ef2b94ac34df683609026ad7718ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41117 } } peers { permanent_uuid: "90a77fe0d781455e97f35934e4a701c1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46251 } } peers { permanent_uuid: "887f286a55fe42c4a545effd3f4316da" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37569 } }
I20260811 08:17:28.642817 15927 ts_tablet_manager.cc:1428] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:17:28.642856 15898 heartbeater.cc:503] Master 127.20.158.190:40625 was elected leader, sending a full tablet report...
I20260811 08:17:28.644179 15924 raft_consensus.cc:348] T 8ada9920e4c14c5caf66cba11934e4cc P 369ef2b94ac34df683609026ad7718ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369ef2b94ac34df683609026ad7718ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41117 } } peers { permanent_uuid: "90a77fe0d781455e97f35934e4a701c1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46251 } } peers { permanent_uuid: "887f286a55fe42c4a545effd3f4316da" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37569 } }
I20260811 08:17:28.644299 15924 raft_consensus.cc:374] T 8ada9920e4c14c5caf66cba11934e4cc P 369ef2b94ac34df683609026ad7718ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:28.644320 15924 raft_consensus.cc:729] T 8ada9920e4c14c5caf66cba11934e4cc P 369ef2b94ac34df683609026ad7718ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369ef2b94ac34df683609026ad7718ab, State: Initialized, Role: FOLLOWER
I20260811 08:17:28.644429 15924 consensus_queue.cc:260] T 8ada9920e4c14c5caf66cba11934e4cc P 369ef2b94ac34df683609026ad7718ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369ef2b94ac34df683609026ad7718ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41117 } } peers { permanent_uuid: "90a77fe0d781455e97f35934e4a701c1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46251 } } peers { permanent_uuid: "887f286a55fe42c4a545effd3f4316da" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37569 } }
I20260811 08:17:28.644681 15924 ts_tablet_manager.cc:1428] T 8ada9920e4c14c5caf66cba11934e4cc P 369ef2b94ac34df683609026ad7718ab: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:17:28.644786 15515 heartbeater.cc:503] Master 127.20.158.190:40625 was elected leader, sending a full tablet report...
W20260811 08:17:28.689468 15698 tablet.cc:2369] T 8ada9920e4c14c5caf66cba11934e4cc P 887f286a55fe42c4a545effd3f4316da: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:17:28.747671 15939 raft_consensus.cc:482] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:17:28.747803 15939 raft_consensus.cc:504] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369ef2b94ac34df683609026ad7718ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41117 } } peers { permanent_uuid: "90a77fe0d781455e97f35934e4a701c1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46251 } } peers { permanent_uuid: "887f286a55fe42c4a545effd3f4316da" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37569 } }
I20260811 08:17:28.748139 15939 leader_election.cc:288] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 369ef2b94ac34df683609026ad7718ab (127.20.158.129:41117), 887f286a55fe42c4a545effd3f4316da (127.20.158.130:37569)
I20260811 08:17:28.751370 15921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:28.748635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:44393 (local address 127.20.158.130:37569)
0811 08:17:28.748683 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:28.748685 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:28.748800 (+ 115us) server_negotiation.cc:407] Connection header received
0811 08:17:28.748832 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:28.748844 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:28.748855 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:28.748918 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:28.749112 (+ 194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.749689 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.750628 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.750989 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.751047 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:28.751078 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:28.751246 (+ 168us) server_negotiation.cc:299] Negotiation successful
0811 08:17:28.751287 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260811 08:17:28.751375 15900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:28.748361 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:41117 (local address 127.20.158.131:40121)
0811 08:17:28.748428 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:28.748441 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:28.748489 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:28.748734 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:28.748736 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:28.748738 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:28.748887 (+ 149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:28.748890 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.749685 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.749686 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:28.750486 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:28.750488 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.751111 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.751112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:28.751182 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:28.751185 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:17:28.751265 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 08:17:28.751303 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260811 08:17:28.751379 15942 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:28.748494 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:37569 (local address 127.20.158.131:44393)
0811 08:17:28.748712 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:28.748729 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:28.748779 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:28.748952 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:28.748953 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:28.748955 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:28.749032 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:28.749034 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.749769 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.749770 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:28.750507 (+ 737us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:28.750508 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.751079 (+ 571us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.751080 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:28.751165 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:28.751169 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:17:28.751214 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 08:17:28.751274 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":201,"mutex_wait_us":1,"thread_start_us":174,"threads_started":1}
I20260811 08:17:28.751420 15915 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:28.748498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:40121 (local address 127.20.158.129:41117)
0811 08:17:28.748555 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:28.748558 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:28.748568 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:17:28.748602 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:28.748603 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:28.748613 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:28.748689 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:28.748983 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.749536 (+ 553us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.750586 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.750997 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.751089 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:28.751098 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:28.751297 (+ 199us) server_negotiation.cc:299] Negotiation successful
0811 08:17:28.751344 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 08:17:28.751824 15628 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ada9920e4c14c5caf66cba11934e4cc" candidate_uuid: "90a77fe0d781455e97f35934e4a701c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "887f286a55fe42c4a545effd3f4316da" is_pre_election: true
I20260811 08:17:28.751814 15445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ada9920e4c14c5caf66cba11934e4cc" candidate_uuid: "90a77fe0d781455e97f35934e4a701c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369ef2b94ac34df683609026ad7718ab" is_pre_election: true
I20260811 08:17:28.751986 15628 raft_consensus.cc:2454] T 8ada9920e4c14c5caf66cba11934e4cc P 887f286a55fe42c4a545effd3f4316da [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90a77fe0d781455e97f35934e4a701c1 in term 0.
I20260811 08:17:28.752000 15445 raft_consensus.cc:2454] T 8ada9920e4c14c5caf66cba11934e4cc P 369ef2b94ac34df683609026ad7718ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90a77fe0d781455e97f35934e4a701c1 in term 0.
I20260811 08:17:28.752272 15730 leader_election.cc:302] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369ef2b94ac34df683609026ad7718ab, 90a77fe0d781455e97f35934e4a701c1; no voters:
I20260811 08:17:28.752435 15939 raft_consensus.cc:2781] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:17:28.752504 15939 raft_consensus.cc:482] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:17:28.752522 15939 raft_consensus.cc:3037] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:28.753274 15939 raft_consensus.cc:504] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369ef2b94ac34df683609026ad7718ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41117 } } peers { permanent_uuid: "90a77fe0d781455e97f35934e4a701c1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46251 } } peers { permanent_uuid: "887f286a55fe42c4a545effd3f4316da" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37569 } }
I20260811 08:17:28.753379 15939 leader_election.cc:288] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1 [CANDIDATE]: Term 1 election: Requested vote from peers 369ef2b94ac34df683609026ad7718ab (127.20.158.129:41117), 887f286a55fe42c4a545effd3f4316da (127.20.158.130:37569)
I20260811 08:17:28.753650 15628 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ada9920e4c14c5caf66cba11934e4cc" candidate_uuid: "90a77fe0d781455e97f35934e4a701c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "887f286a55fe42c4a545effd3f4316da"
I20260811 08:17:28.753629 15445 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ada9920e4c14c5caf66cba11934e4cc" candidate_uuid: "90a77fe0d781455e97f35934e4a701c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369ef2b94ac34df683609026ad7718ab"
I20260811 08:17:28.753719 15628 raft_consensus.cc:3037] T 8ada9920e4c14c5caf66cba11934e4cc P 887f286a55fe42c4a545effd3f4316da [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:28.753748 15445 raft_consensus.cc:3037] T 8ada9920e4c14c5caf66cba11934e4cc P 369ef2b94ac34df683609026ad7718ab [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:28.754438 15628 raft_consensus.cc:2454] T 8ada9920e4c14c5caf66cba11934e4cc P 887f286a55fe42c4a545effd3f4316da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90a77fe0d781455e97f35934e4a701c1 in term 1.
I20260811 08:17:28.754601 15730 leader_election.cc:302] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 887f286a55fe42c4a545effd3f4316da, 90a77fe0d781455e97f35934e4a701c1; no voters:
I20260811 08:17:28.754603 15445 raft_consensus.cc:2454] T 8ada9920e4c14c5caf66cba11934e4cc P 369ef2b94ac34df683609026ad7718ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90a77fe0d781455e97f35934e4a701c1 in term 1.
I20260811 08:17:28.754703 15939 raft_consensus.cc:2781] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:17:28.754871 15939 raft_consensus.cc:686] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1 [term 1 LEADER]: Becoming Leader. State: Replica: 90a77fe0d781455e97f35934e4a701c1, State: Running, Role: LEADER
I20260811 08:17:28.754969 15939 consensus_queue.cc:237] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369ef2b94ac34df683609026ad7718ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41117 } } peers { permanent_uuid: "90a77fe0d781455e97f35934e4a701c1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46251 } } peers { permanent_uuid: "887f286a55fe42c4a545effd3f4316da" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37569 } }
I20260811 08:17:28.755883 15224 catalog_manager.cc:5495] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 90a77fe0d781455e97f35934e4a701c1 (127.20.158.131). New cstate: current_term: 1 leader_uuid: "90a77fe0d781455e97f35934e4a701c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "369ef2b94ac34df683609026ad7718ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41117 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90a77fe0d781455e97f35934e4a701c1" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 46251 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "887f286a55fe42c4a545effd3f4316da" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37569 } health_report { overall_health: UNKNOWN } } }
I20260811 08:17:28.774204 15918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:28.771699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40634 (local address 127.20.158.131:46251)
0811 08:17:28.771759 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:28.771762 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:28.771774 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:17:28.771832 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:28.771833 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:28.771850 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:28.771927 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:17:28.772067 (+ 140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.772536 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.773307 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:28.773502 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:28.773647 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:28.773825 (+ 178us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:17:28.773935 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:17:28.774026 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:28.774065 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 08:17:28.774085 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
W20260811 08:17:28.774751 15516 tablet.cc:2369] T 8ada9920e4c14c5caf66cba11934e4cc P 369ef2b94ac34df683609026ad7718ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:17:28.776072 15628 raft_consensus.cc:1261] T 8ada9920e4c14c5caf66cba11934e4cc P 887f286a55fe42c4a545effd3f4316da [term 1 FOLLOWER]: Refusing update from remote peer 90a77fe0d781455e97f35934e4a701c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:17:28.776072 15445 raft_consensus.cc:1261] T 8ada9920e4c14c5caf66cba11934e4cc P 369ef2b94ac34df683609026ad7718ab [term 1 FOLLOWER]: Refusing update from remote peer 90a77fe0d781455e97f35934e4a701c1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:17:28.776500 15939 consensus_queue.cc:1035] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "369ef2b94ac34df683609026ad7718ab" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 41117 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:17:28.776696 15943 consensus_queue.cc:1035] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "887f286a55fe42c4a545effd3f4316da" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37569 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:17:28.778997 15948 mvcc.cc:205] Tried to move back new op lower bound from 7317242874984087552 to 7317242874901188608. Current Snapshot: MvccSnapshot[applied={T|T < 7317242874984087552}]
I20260811 08:17:28.779353 15949 mvcc.cc:205] Tried to move back new op lower bound from 7317242874984087552 to 7317242874901188608. Current Snapshot: MvccSnapshot[applied={T|T < 7317242874984087552}]
I20260811 08:17:28.779929 15950 mvcc.cc:205] Tried to move back new op lower bound from 7317242874984087552 to 7317242874901188608. Current Snapshot: MvccSnapshot[applied={T|T < 7317242874984087552}]
I20260811 08:17:28.781493 15224 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59248:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:17:28.781662 15224 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59248:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:17:28.782438 15224 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 6fc7f44d069346c8ab2df678c7e56bff: Sending DeleteTablet for 3 replicas of tablet 8ada9920e4c14c5caf66cba11934e4cc
I20260811 08:17:28.782794 15415 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ada9920e4c14c5caf66cba11934e4cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:17:28 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:54706
I20260811 08:17:28.782848 15798 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ada9920e4c14c5caf66cba11934e4cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:17:28 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:40624
I20260811 08:17:28.782930 15603 tablet_service.cc:1514] Processing DeleteTablet for tablet 8ada9920e4c14c5caf66cba11934e4cc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:17:28 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:33698
I20260811 08:17:28.783133 15968 tablet_replica.cc:330] T 8ada9920e4c14c5caf66cba11934e4cc P 887f286a55fe42c4a545effd3f4316da: stopping tablet replica
I20260811 08:17:28.783291 15968 raft_consensus.cc:2229] T 8ada9920e4c14c5caf66cba11934e4cc P 887f286a55fe42c4a545effd3f4316da [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:17:28.783325 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 15311
I20260811 08:17:28.785917 15968 raft_consensus.cc:2258] T 8ada9920e4c14c5caf66cba11934e4cc P 887f286a55fe42c4a545effd3f4316da [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:17:28.787817 15968 ts_tablet_manager.cc:1905] T 8ada9920e4c14c5caf66cba11934e4cc P 887f286a55fe42c4a545effd3f4316da: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:17:28.789356 15968 ts_tablet_manager.cc:1918] T 8ada9920e4c14c5caf66cba11934e4cc P 887f286a55fe42c4a545effd3f4316da: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:17:28.789448 15968 log.cc:1196] T 8ada9920e4c14c5caf66cba11934e4cc P 887f286a55fe42c4a545effd3f4316da: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-1/wal/wals/8ada9920e4c14c5caf66cba11934e4cc
I20260811 08:17:28.789804 15968 ts_tablet_manager.cc:1939] T 8ada9920e4c14c5caf66cba11934e4cc P 887f286a55fe42c4a545effd3f4316da: Deleting consensus metadata
I20260811 08:17:28.790256 15200 catalog_manager.cc:4841] TS 887f286a55fe42c4a545effd3f4316da (127.20.158.130:37569): tablet 8ada9920e4c14c5caf66cba11934e4cc (table test-table [id=39497d0b442241648b3362ee4c6d7ff7]) successfully deleted
I20260811 08:17:28.811101 15966 tablet_replica.cc:330] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1: stopping tablet replica
I20260811 08:17:28.811309 15966 raft_consensus.cc:2229] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:17:28.811441 15966 raft_consensus.cc:2258] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:17:28.813851 15966 ts_tablet_manager.cc:1905] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:17:28.816043 15966 ts_tablet_manager.cc:1918] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:17:28.816133 15966 log.cc:1196] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786436003833085-21114-0/minicluster-data/ts-2/wal/wals/8ada9920e4c14c5caf66cba11934e4cc
I20260811 08:17:28.816457 15966 ts_tablet_manager.cc:1939] T 8ada9920e4c14c5caf66cba11934e4cc P 90a77fe0d781455e97f35934e4a701c1: Deleting consensus metadata
I20260811 08:17:28.816962 15200 catalog_manager.cc:4841] TS 90a77fe0d781455e97f35934e4a701c1 (127.20.158.131:46251): tablet 8ada9920e4c14c5caf66cba11934e4cc (table test-table [id=39497d0b442241648b3362ee4c6d7ff7]) successfully deleted
W20260811 08:17:28.818248 15200 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.158.129:41117 (error 108)
I20260811 08:17:28.818482 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 15522
I20260811 08:17:28.820576 15919 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:28.820426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:41117 (local address 127.0.0.1:54716)
0811 08:17:28.820494 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:28.820539 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.129:41117: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 08:17:28.820739 15200 catalog_manager.cc:4584] TS 369ef2b94ac34df683609026ad7718ab (127.20.158.129:41117): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8ada9920e4c14c5caf66cba11934e4cc: Network error: Client connection negotiation failed: client connection to 127.20.158.129:41117: connect: Connection refused (error 111)
I20260811 08:17:28.830083 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 15702
I20260811 08:17:28.839672 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 15178
2026-08-11T08:17:28Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2320 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-11T08:17:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:17:28Z Disabled control of system clock
I20260811 08:17:28.873196 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:37963
--webserver_interface=127.20.158.190
--webserver_port=0
--builtin_ntp_servers=127.20.158.148:34695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:37963
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 08:17:28.957008 15975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:28.957258 15975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:28.957281 15975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:28.958570 15975 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:17:28.958619 15975 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:28.958632 15975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:28.958645 15975 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:17:28.958658 15975 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:17:28.959937 15975 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:34695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:37963
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:37963
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15975
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:28.960139 15975 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:28.960425 15975 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:28.965436 15986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:28.965574 15975 server_base.cc:1034] running on GCE node
W20260811 08:17:28.965418 15985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:28.965394 15988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:28.965951 15975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:28.966212 15975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:28.967375 15975 hybrid_clock.cc:648] HybridClock initialized: now 1786436248967348 us; error 56 us; skew 500 ppm
I20260811 08:17:28.968713 15975 webserver.cc:460] Webserver started at http://127.20.158.190:34037/ using document root <none> and password file <none>
I20260811 08:17:28.968967 15975 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:28.969017 15975 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:28.969166 15975 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:28.970364 15975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "cc671b066ce645f08660e3acbba62f97"
format_stamp: "Formatted at 2026-08-11 08:17:28 on dist-test-slave-gkw7"
server_key: "4588ae6a72be7182fba0c7868b5dd913"
server_key_iv: "d2fa41890f1ec343113290b882c70267"
server_key_version: "encryptionkey@0"
I20260811 08:17:28.970734 15975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "cc671b066ce645f08660e3acbba62f97"
format_stamp: "Formatted at 2026-08-11 08:17:28 on dist-test-slave-gkw7"
server_key: "4588ae6a72be7182fba0c7868b5dd913"
server_key_iv: "d2fa41890f1ec343113290b882c70267"
server_key_version: "encryptionkey@0"
I20260811 08:17:28.972065 15975 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 08:17:28.972867 15997 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:28.973042 15975 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:17:28.973152 15975 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "cc671b066ce645f08660e3acbba62f97"
format_stamp: "Formatted at 2026-08-11 08:17:28 on dist-test-slave-gkw7"
server_key: "4588ae6a72be7182fba0c7868b5dd913"
server_key_iv: "d2fa41890f1ec343113290b882c70267"
server_key_version: "encryptionkey@0"
I20260811 08:17:28.973248 15975 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:28.991297 15975 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:28.991649 15975 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:28.991819 15975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:28.996317 15975 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:37963
I20260811 08:17:28.996381 16070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:37963 every 8 connection(s)
I20260811 08:17:28.996753 15975 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:17:28.997819 16071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:28.998245 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 15975
I20260811 08:17:28.998375 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:17:28.998579 21114 external_mini_cluster.cc:1428] Setting key 6fa2844058945ba8d18aedaca177f339
I20260811 08:17:29.000820 16071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc671b066ce645f08660e3acbba62f97: Bootstrap starting.
I20260811 08:17:29.001520 16071 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cc671b066ce645f08660e3acbba62f97: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:29.001909 16071 log.cc:824] T 00000000000000000000000000000000 P cc671b066ce645f08660e3acbba62f97: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:29.002673 16071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cc671b066ce645f08660e3acbba62f97: No bootstrap required, opened a new log
I20260811 08:17:29.004492 16071 raft_consensus.cc:348] T 00000000000000000000000000000000 P cc671b066ce645f08660e3acbba62f97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc671b066ce645f08660e3acbba62f97" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37963 } }
I20260811 08:17:29.004606 16075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:28.999171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43408 (local address 127.20.158.190:37963)
0811 08:17:28.999399 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:28.999406 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:28.999434 (+ 28us) server_negotiation.cc:407] Connection header received
0811 08:17:28.999849 (+ 415us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:28.999856 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:28.999914 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:29.000028 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:29.000307 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.001237 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.002370 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.002816 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.002922 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:29.003657 (+ 735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:29.003661 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:29.003661 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:29.003837 (+ 176us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:29.003870 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:29.003882 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:29.003933 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:29.004082 (+ 149us) server_negotiation.cc:299] Negotiation successful
0811 08:17:29.004204 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157,"thread_start_us":105,"threads_started":1}
I20260811 08:17:29.004673 16071 raft_consensus.cc:374] T 00000000000000000000000000000000 P cc671b066ce645f08660e3acbba62f97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:29.004787 16071 raft_consensus.cc:729] T 00000000000000000000000000000000 P cc671b066ce645f08660e3acbba62f97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc671b066ce645f08660e3acbba62f97, State: Initialized, Role: FOLLOWER
I20260811 08:17:29.004921 16071 consensus_queue.cc:260] T 00000000000000000000000000000000 P cc671b066ce645f08660e3acbba62f97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc671b066ce645f08660e3acbba62f97" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37963 } }
I20260811 08:17:29.005018 16071 raft_consensus.cc:388] T 00000000000000000000000000000000 P cc671b066ce645f08660e3acbba62f97 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:17:29.005064 16071 raft_consensus.cc:482] T 00000000000000000000000000000000 P cc671b066ce645f08660e3acbba62f97 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:17:29.005115 16071 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cc671b066ce645f08660e3acbba62f97 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:29.005714 16071 raft_consensus.cc:504] T 00000000000000000000000000000000 P cc671b066ce645f08660e3acbba62f97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc671b066ce645f08660e3acbba62f97" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37963 } }
I20260811 08:17:29.005829 16071 leader_election.cc:302] T 00000000000000000000000000000000 P cc671b066ce645f08660e3acbba62f97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cc671b066ce645f08660e3acbba62f97; no voters:
I20260811 08:17:29.006021 16071 leader_election.cc:288] T 00000000000000000000000000000000 P cc671b066ce645f08660e3acbba62f97 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:17:29.006098 16078 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cc671b066ce645f08660e3acbba62f97 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:17:29.006278 16078 raft_consensus.cc:686] T 00000000000000000000000000000000 P cc671b066ce645f08660e3acbba62f97 [term 1 LEADER]: Becoming Leader. State: Replica: cc671b066ce645f08660e3acbba62f97, State: Running, Role: LEADER
I20260811 08:17:29.006304 16071 sys_catalog.cc:564] T 00000000000000000000000000000000 P cc671b066ce645f08660e3acbba62f97 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:17:29.006373 16078 consensus_queue.cc:237] T 00000000000000000000000000000000 P cc671b066ce645f08660e3acbba62f97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc671b066ce645f08660e3acbba62f97" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37963 } }
I20260811 08:17:29.006762 16079 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc671b066ce645f08660e3acbba62f97 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cc671b066ce645f08660e3acbba62f97" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc671b066ce645f08660e3acbba62f97" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37963 } } }
I20260811 08:17:29.006768 16080 sys_catalog.cc:455] T 00000000000000000000000000000000 P cc671b066ce645f08660e3acbba62f97 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc671b066ce645f08660e3acbba62f97. Latest consensus state: current_term: 1 leader_uuid: "cc671b066ce645f08660e3acbba62f97" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cc671b066ce645f08660e3acbba62f97" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37963 } } }
I20260811 08:17:29.006871 16079 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc671b066ce645f08660e3acbba62f97 [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:29.006875 16080 sys_catalog.cc:458] T 00000000000000000000000000000000 P cc671b066ce645f08660e3acbba62f97 [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:29.007094 16090 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:17:29.007699 16090 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:17:29.009235 16090 catalog_manager.cc:1347] Generated new cluster ID: 43347f0b99584e73811f722e62fe5409
I20260811 08:17:29.009287 16090 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:17:29.020802 16090 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:17:29.021320 16090 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:17:29.030767 16090 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cc671b066ce645f08660e3acbba62f97: Generated new TSK 0
I20260811 08:17:29.030987 16090 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:17:29.032105 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:0
--local_ip_for_outbound_sockets=127.20.158.129
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:37963
--builtin_ntp_servers=127.20.158.148:34695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 08:17:29.119807 16105 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:29.120066 16105 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:29.120105 16105 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:29.121343 16105 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:29.121415 16105 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:29.121454 16105 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:17:29.122875 16105 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:34695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:37963
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16105
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:29.123167 16105 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:29.123490 16105 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:29.129855 16119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:29.129850 16111 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:29.129855 16117 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:29.130172 16105 server_base.cc:1034] running on GCE node
I20260811 08:17:29.130407 16105 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:29.130676 16105 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:29.131834 16105 hybrid_clock.cc:648] HybridClock initialized: now 1786436249131834 us; error 47 us; skew 500 ppm
I20260811 08:17:29.133219 16105 webserver.cc:460] Webserver started at http://127.20.158.129:34113/ using document root <none> and password file <none>
I20260811 08:17:29.133492 16105 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:29.133569 16105 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:29.133703 16105 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:29.135179 16105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-0/data/instance:
uuid: "90a8d74bfe0745f9a632a11720eb2232"
format_stamp: "Formatted at 2026-08-11 08:17:29 on dist-test-slave-gkw7"
server_key: "8a0857e1f79f5407c2e5250d15afc9d4"
server_key_iv: "9303ff683372b6ef1517a5bd3497e71f"
server_key_version: "encryptionkey@0"
I20260811 08:17:29.135614 16105 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance:
uuid: "90a8d74bfe0745f9a632a11720eb2232"
format_stamp: "Formatted at 2026-08-11 08:17:29 on dist-test-slave-gkw7"
server_key: "8a0857e1f79f5407c2e5250d15afc9d4"
server_key_iv: "9303ff683372b6ef1517a5bd3497e71f"
server_key_version: "encryptionkey@0"
I20260811 08:17:29.137226 16105 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:17:29.138123 16136 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:29.138329 16105 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:17:29.138425 16105 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "90a8d74bfe0745f9a632a11720eb2232"
format_stamp: "Formatted at 2026-08-11 08:17:29 on dist-test-slave-gkw7"
server_key: "8a0857e1f79f5407c2e5250d15afc9d4"
server_key_iv: "9303ff683372b6ef1517a5bd3497e71f"
server_key_version: "encryptionkey@0"
I20260811 08:17:29.138499 16105 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:29.150868 16105 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:29.151386 16105 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:29.151592 16105 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:29.151878 16105 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:17:29.152292 16105 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:17:29.152354 16105 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:29.152402 16105 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:17:29.152433 16105 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:29.159104 16105 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:35205
I20260811 08:17:29.159190 16325 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:35205 every 8 connection(s)
I20260811 08:17:29.159582 16105 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:17:29.160880 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 16105
I20260811 08:17:29.160969 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance
I20260811 08:17:29.161146 21114 external_mini_cluster.cc:1428] Setting key a0227dcbddb57e2de8cf0f273f85e3fe
I20260811 08:17:29.162196 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:0
--local_ip_for_outbound_sockets=127.20.158.130
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:37963
--builtin_ntp_servers=127.20.158.148:34695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 08:17:29.166117 16075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:29.160582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:48601 (local address 127.20.158.190:37963)
0811 08:17:29.160653 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:29.160656 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:29.160940 (+ 284us) server_negotiation.cc:407] Connection header received
0811 08:17:29.161888 (+ 948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:29.161889 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:29.161906 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:29.161969 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:29.162851 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.163424 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.164565 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.164787 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.164872 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:29.165780 (+ 908us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:29.165781 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:29.165782 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:29.165788 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:29.165813 (+ 25us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:29.165818 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:29.165891 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:29.165943 (+ 52us) server_negotiation.cc:299] Negotiation successful
0811 08:17:29.165980 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 08:17:29.166218 16331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:29.160554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:37963 (local address 127.20.158.129:48601)
0811 08:17:29.160791 (+ 237us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:29.160830 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:29.161752 (+ 922us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:29.162047 (+ 295us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:29.162051 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:29.162062 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:17:29.162737 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:29.162743 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.163533 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.163534 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:29.164445 (+ 911us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:29.164447 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.164897 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.164899 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:29.165043 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:29.165634 (+ 591us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:17:29.165635 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:17:29.165663 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:17:29.165687 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:17:29.165890 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:17:29.165892 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:17:29.165895 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:17:29.165941 (+ 46us) client_negotiation.cc:240] Negotiation successful
0811 08:17:29.166025 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":121,"threads_started":1}
I20260811 08:17:29.166801 16326 heartbeater.cc:347] Connected to a master server at 127.20.158.190:37963
I20260811 08:17:29.166920 16326 heartbeater.cc:464] Registering TS with master...
I20260811 08:17:29.167104 16326 heartbeater.cc:511] Master 127.20.158.190:37963 requested a full tablet report, sending...
I20260811 08:17:29.167662 16025 ts_manager.cc:194] Registered new tserver with Master: 90a8d74bfe0745f9a632a11720eb2232 (127.20.158.129:35205)
I20260811 08:17:29.168287 16025 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.158.129:48601
W20260811 08:17:29.250342 16334 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:29.250553 16334 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:29.250584 16334 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:29.251762 16334 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:29.251807 16334 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:29.251833 16334 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:17:29.253207 16334 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:34695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:37963
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16334
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:29.253464 16334 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:29.253813 16334 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:17:29.259184 16334 server_base.cc:1034] running on GCE node
W20260811 08:17:29.259151 16345 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:29.259192 16342 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:29.259136 16343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:29.259619 16334 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:29.259873 16334 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:29.261051 16334 hybrid_clock.cc:648] HybridClock initialized: now 1786436249261033 us; error 32 us; skew 500 ppm
I20260811 08:17:29.262445 16334 webserver.cc:460] Webserver started at http://127.20.158.130:36879/ using document root <none> and password file <none>
I20260811 08:17:29.262729 16334 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:29.262806 16334 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:29.262962 16334 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:29.264061 16334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-1/data/instance:
uuid: "ba4fa0bb78f9479fa75bdad575a5da26"
format_stamp: "Formatted at 2026-08-11 08:17:29 on dist-test-slave-gkw7"
server_key: "a13710ad359ed954939ab16de803f128"
server_key_iv: "13078bb945e84315c92463b6e29af3a8"
server_key_version: "encryptionkey@0"
I20260811 08:17:29.264454 16334 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance:
uuid: "ba4fa0bb78f9479fa75bdad575a5da26"
format_stamp: "Formatted at 2026-08-11 08:17:29 on dist-test-slave-gkw7"
server_key: "a13710ad359ed954939ab16de803f128"
server_key_iv: "13078bb945e84315c92463b6e29af3a8"
server_key_version: "encryptionkey@0"
I20260811 08:17:29.265892 16334 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:17:29.266675 16355 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:29.266851 16334 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:29.266956 16334 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "ba4fa0bb78f9479fa75bdad575a5da26"
format_stamp: "Formatted at 2026-08-11 08:17:29 on dist-test-slave-gkw7"
server_key: "a13710ad359ed954939ab16de803f128"
server_key_iv: "13078bb945e84315c92463b6e29af3a8"
server_key_version: "encryptionkey@0"
I20260811 08:17:29.267048 16334 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:29.287359 16334 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:29.287719 16334 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:29.287894 16334 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:29.288147 16334 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:17:29.288509 16334 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:17:29.288566 16334 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:29.288616 16334 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:17:29.288645 16334 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:29.294960 16334 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:37673
I20260811 08:17:29.295012 16528 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:37673 every 8 connection(s)
I20260811 08:17:29.295359 16334 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
I20260811 08:17:29.299414 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 16334
I20260811 08:17:29.299532 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance
I20260811 08:17:29.299734 21114 external_mini_cluster.cc:1428] Setting key 8b1d3a871fb4f37eb9b09b47c229db02
I20260811 08:17:29.300881 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:0
--local_ip_for_outbound_sockets=127.20.158.131
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:37963
--builtin_ntp_servers=127.20.158.148:34695
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 08:17:29.301354 16075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:29.296238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:37931 (local address 127.20.158.190:37963)
0811 08:17:29.296309 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:29.296311 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:29.296491 (+ 180us) server_negotiation.cc:407] Connection header received
0811 08:17:29.296975 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:29.296976 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:29.296987 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:29.297054 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:29.297878 (+ 824us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.298413 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.299607 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.299898 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.300004 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:29.301029 (+ 1025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:29.301031 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:29.301031 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:29.301038 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:29.301058 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:29.301063 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:29.301139 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:29.301250 (+ 111us) server_negotiation.cc:299] Negotiation successful
0811 08:17:29.301291 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 08:17:29.301666 16531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:29.296072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:37963 (local address 127.20.158.130:37931)
0811 08:17:29.296315 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:29.296358 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:29.296857 (+ 499us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:29.297140 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:29.297144 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:29.297155 (+ 11us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:17:29.297778 (+ 623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:29.297783 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.298512 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.298512 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:29.299484 (+ 972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:29.299487 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.300017 (+ 530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.300018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:29.300199 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:29.300845 (+ 646us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:17:29.300846 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:17:29.300886 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:17:29.300919 (+ 33us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:17:29.301147 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:17:29.301154 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:17:29.301157 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:17:29.301232 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 08:17:29.301352 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":134,"threads_started":1}
I20260811 08:17:29.302157 16529 heartbeater.cc:347] Connected to a master server at 127.20.158.190:37963
I20260811 08:17:29.302281 16529 heartbeater.cc:464] Registering TS with master...
I20260811 08:17:29.302479 16529 heartbeater.cc:511] Master 127.20.158.190:37963 requested a full tablet report, sending...
I20260811 08:17:29.302956 16025 ts_manager.cc:194] Registered new tserver with Master: ba4fa0bb78f9479fa75bdad575a5da26 (127.20.158.130:37673)
I20260811 08:17:29.303511 16025 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.158.130:37931
W20260811 08:17:29.388217 16534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:29.388433 16534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:29.388456 16534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:29.389506 16534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:29.389611 16534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:29.389655 16534 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:17:29.391084 16534 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:34695
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:37963
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16534
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:29.391280 16534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:29.391539 16534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:29.396919 16542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:29.396929 16540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:29.396924 16539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:29.397004 16534 server_base.cc:1034] running on GCE node
I20260811 08:17:29.397399 16534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:29.397747 16534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:29.398913 16534 hybrid_clock.cc:648] HybridClock initialized: now 1786436249398898 us; error 32 us; skew 500 ppm
I20260811 08:17:29.400324 16534 webserver.cc:460] Webserver started at http://127.20.158.131:36581/ using document root <none> and password file <none>
I20260811 08:17:29.400530 16534 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:29.400585 16534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:29.400686 16534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:29.401839 16534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-2/data/instance:
uuid: "af8326a4ca784563abb34c1308587e46"
format_stamp: "Formatted at 2026-08-11 08:17:29 on dist-test-slave-gkw7"
server_key: "f21dbda783c73c6cd39d680fa007b8af"
server_key_iv: "c76ae86794fcfe16a43b35c07f0fc9b9"
server_key_version: "encryptionkey@0"
I20260811 08:17:29.402268 16534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance:
uuid: "af8326a4ca784563abb34c1308587e46"
format_stamp: "Formatted at 2026-08-11 08:17:29 on dist-test-slave-gkw7"
server_key: "f21dbda783c73c6cd39d680fa007b8af"
server_key_iv: "c76ae86794fcfe16a43b35c07f0fc9b9"
server_key_version: "encryptionkey@0"
I20260811 08:17:29.403616 16534 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:17:29.404381 16549 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:29.404572 16534 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:17:29.404695 16534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "af8326a4ca784563abb34c1308587e46"
format_stamp: "Formatted at 2026-08-11 08:17:29 on dist-test-slave-gkw7"
server_key: "f21dbda783c73c6cd39d680fa007b8af"
server_key_iv: "c76ae86794fcfe16a43b35c07f0fc9b9"
server_key_version: "encryptionkey@0"
I20260811 08:17:29.404780 16534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:29.420316 16534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:29.420665 16534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:29.420842 16534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:29.421103 16534 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:17:29.421476 16534 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:17:29.421538 16534 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:29.421670 16534 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:17:29.421700 16534 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:29.428383 16534 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:44165
I20260811 08:17:29.428428 16709 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:44165 every 8 connection(s)
I20260811 08:17:29.428805 16534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
I20260811 08:17:29.434360 16075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:29.429695 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:40937 (local address 127.20.158.190:37963)
0811 08:17:29.429767 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:29.429769 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:29.429991 (+ 222us) server_negotiation.cc:407] Connection header received
0811 08:17:29.430522 (+ 531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:29.430524 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:29.430535 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:29.430615 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:29.431346 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.431851 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.432855 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.433067 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.433140 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:29.434076 (+ 936us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:29.434077 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:29.434078 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:29.434084 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:29.434103 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:29.434109 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:29.434161 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:29.434267 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 08:17:29.434292 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 08:17:29.434530 16714 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:29.429613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:37963 (local address 127.20.158.131:40937)
0811 08:17:29.429831 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:29.429875 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:29.430403 (+ 528us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:29.430684 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:29.430688 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:29.430696 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:17:29.431250 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:29.431254 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.431931 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.431931 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:29.432750 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:29.432753 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.433175 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.433176 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:29.433289 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:29.433933 (+ 644us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:17:29.433933 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:17:29.433962 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:17:29.433985 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:17:29.434188 (+ 203us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:17:29.434193 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:17:29.434195 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:17:29.434248 (+ 53us) client_negotiation.cc:240] Negotiation successful
0811 08:17:29.434333 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":110,"threads_started":1}
I20260811 08:17:29.435099 16710 heartbeater.cc:347] Connected to a master server at 127.20.158.190:37963
I20260811 08:17:29.435215 16710 heartbeater.cc:464] Registering TS with master...
I20260811 08:17:29.435400 16710 heartbeater.cc:511] Master 127.20.158.190:37963 requested a full tablet report, sending...
I20260811 08:17:29.435837 16025 ts_manager.cc:194] Registered new tserver with Master: af8326a4ca784563abb34c1308587e46 (127.20.158.131:44165)
I20260811 08:17:29.436277 16025 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.158.131:40937
I20260811 08:17:29.437300 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 16534
I20260811 08:17:29.437394 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance
I20260811 08:17:29.437719 21114 external_mini_cluster.cc:1428] Setting key d837978da9ed1646f9b742258a2d9285
I20260811 08:17:29.438840 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:17:29.443774 16075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:29.440399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43424 (local address 127.20.158.190:37963)
0811 08:17:29.440483 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:29.440486 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:29.440605 (+ 119us) server_negotiation.cc:407] Connection header received
0811 08:17:29.440695 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:29.440696 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:29.440707 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:29.440772 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:29.440963 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.441499 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.442411 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.442642 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.442728 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:29.443471 (+ 743us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:29.443472 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:29.443476 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:29.443481 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:29.443494 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:29.443498 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:29.443562 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:29.443645 (+ 83us) server_negotiation.cc:299] Negotiation successful
0811 08:17:29.443680 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 08:17:29.445632 16025 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43424:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:17:29.447250 16025 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:17:29.454892 16725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:29.449578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:35205 (local address 127.0.0.1:55144)
0811 08:17:29.450013 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:29.450021 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:29.450058 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:29.450332 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:29.450336 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:29.450368 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:29.450467 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:29.450469 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.452094 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.452095 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:29.453410 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:29.453413 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.454519 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.454521 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:29.454635 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:29.454674 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 08:17:29.454754 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 08:17:29.454814 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":118,"threads_started":1}
I20260811 08:17:29.454993 16728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:29.449692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55144 (local address 127.20.158.129:35205)
0811 08:17:29.450099 (+ 407us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:29.450105 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:29.450117 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:17:29.450161 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:29.450163 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:29.450180 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:29.450291 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:29.450571 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.451970 (+ 1399us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.453511 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.454417 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.454503 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:29.454606 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:29.454786 (+ 180us) server_negotiation.cc:299] Negotiation successful
0811 08:17:29.454864 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":344,"thread_start_us":106,"threads_started":1}
I20260811 08:17:29.455729 16723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:29.449563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:37673 (local address 127.0.0.1:56326)
0811 08:17:29.449774 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:29.449823 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:29.449892 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:29.450669 (+ 777us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:29.450671 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:29.450674 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:29.450723 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:29.450725 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.452071 (+ 1346us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.452073 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:29.453916 (+ 1843us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:29.453919 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.455463 (+ 1544us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.455464 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:29.455522 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:29.455525 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:17:29.455605 (+ 80us) client_negotiation.cc:240] Negotiation successful
0811 08:17:29.455657 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":89,"threads_started":1}
I20260811 08:17:29.455785 16730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:29.449854 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56326 (local address 127.20.158.130:37673)
0811 08:17:29.450430 (+ 576us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:29.450435 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:29.450446 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:17:29.450488 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:29.450490 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:29.450506 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:29.450584 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:29.450807 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.451979 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.454032 (+ 2053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.455273 (+ 1241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.455347 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:29.455429 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:29.455624 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 08:17:29.455664 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":533,"thread_start_us":96,"threads_started":1}
I20260811 08:17:29.455734 16220 tablet_service.cc:1467] Processing CreateTablet for tablet 64cf1df28cb54fa78859dc914376dea1 (DEFAULT_TABLE table=test-table [id=36eff968f6ab49b88b9deef9722a41da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:17:29.456140 16220 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64cf1df28cb54fa78859dc914376dea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:29.460214 16731 tablet_bootstrap.cc:492] T 64cf1df28cb54fa78859dc914376dea1 P 90a8d74bfe0745f9a632a11720eb2232: Bootstrap starting.
I20260811 08:17:29.460884 16731 tablet_bootstrap.cc:654] T 64cf1df28cb54fa78859dc914376dea1 P 90a8d74bfe0745f9a632a11720eb2232: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:29.460901 16421 tablet_service.cc:1467] Processing CreateTablet for tablet 64cf1df28cb54fa78859dc914376dea1 (DEFAULT_TABLE table=test-table [id=36eff968f6ab49b88b9deef9722a41da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:17:29.461263 16731 log.cc:824] T 64cf1df28cb54fa78859dc914376dea1 P 90a8d74bfe0745f9a632a11720eb2232: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:29.461342 16421 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64cf1df28cb54fa78859dc914376dea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:29.462183 16731 tablet_bootstrap.cc:492] T 64cf1df28cb54fa78859dc914376dea1 P 90a8d74bfe0745f9a632a11720eb2232: No bootstrap required, opened a new log
I20260811 08:17:29.462277 16731 ts_tablet_manager.cc:1397] T 64cf1df28cb54fa78859dc914376dea1 P 90a8d74bfe0745f9a632a11720eb2232: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:17:29.464445 16731 raft_consensus.cc:348] T 64cf1df28cb54fa78859dc914376dea1 P 90a8d74bfe0745f9a632a11720eb2232 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8326a4ca784563abb34c1308587e46" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44165 } } peers { permanent_uuid: "ba4fa0bb78f9479fa75bdad575a5da26" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37673 } } peers { permanent_uuid: "90a8d74bfe0745f9a632a11720eb2232" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 35205 } }
I20260811 08:17:29.464599 16731 raft_consensus.cc:374] T 64cf1df28cb54fa78859dc914376dea1 P 90a8d74bfe0745f9a632a11720eb2232 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:29.464646 16731 raft_consensus.cc:729] T 64cf1df28cb54fa78859dc914376dea1 P 90a8d74bfe0745f9a632a11720eb2232 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90a8d74bfe0745f9a632a11720eb2232, State: Initialized, Role: FOLLOWER
I20260811 08:17:29.464758 16731 consensus_queue.cc:260] T 64cf1df28cb54fa78859dc914376dea1 P 90a8d74bfe0745f9a632a11720eb2232 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8326a4ca784563abb34c1308587e46" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44165 } } peers { permanent_uuid: "ba4fa0bb78f9479fa75bdad575a5da26" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37673 } } peers { permanent_uuid: "90a8d74bfe0745f9a632a11720eb2232" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 35205 } }
I20260811 08:17:29.465076 16731 ts_tablet_manager.cc:1428] T 64cf1df28cb54fa78859dc914376dea1 P 90a8d74bfe0745f9a632a11720eb2232: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:17:29.465097 16326 heartbeater.cc:503] Master 127.20.158.190:37963 was elected leader, sending a full tablet report...
I20260811 08:17:29.465163 16735 tablet_bootstrap.cc:492] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26: Bootstrap starting.
I20260811 08:17:29.465839 16735 tablet_bootstrap.cc:654] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:29.465915 16724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:29.449575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:44165 (local address 127.0.0.1:40516)
0811 08:17:29.449890 (+ 315us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:29.449900 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:29.449941 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:29.461990 (+ 12049us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:29.461991 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:29.461994 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:29.462042 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:29.462045 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.463528 (+ 1483us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.463529 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:29.464658 (+ 1129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:29.464661 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.465668 (+ 1007us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.465669 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:29.465744 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:29.465750 (+ 6us) client_negotiation.cc:769] Sending connection context
0811 08:17:29.465785 (+ 35us) client_negotiation.cc:240] Negotiation successful
0811 08:17:29.465834 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":299,"thread_start_us":88,"threads_started":1}
I20260811 08:17:29.466176 16735 log.cc:824] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:29.466391 16734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:29.461571 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40516 (local address 127.20.158.131:44165)
0811 08:17:29.461783 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:29.461788 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:29.461812 (+ 24us) server_negotiation.cc:407] Connection header received
0811 08:17:29.461854 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:29.461857 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:29.461873 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:29.462119 (+ 246us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:29.462176 (+ 57us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.463426 (+ 1250us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.464773 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.465561 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.466108 (+ 547us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:29.466221 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:29.466248 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 08:17:29.466286 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":106,"threads_started":1}
I20260811 08:17:29.467104 16735 tablet_bootstrap.cc:492] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26: No bootstrap required, opened a new log
I20260811 08:17:29.467176 16735 ts_tablet_manager.cc:1397] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:17:29.467049 16624 tablet_service.cc:1467] Processing CreateTablet for tablet 64cf1df28cb54fa78859dc914376dea1 (DEFAULT_TABLE table=test-table [id=36eff968f6ab49b88b9deef9722a41da]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:17:29.467423 16624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 64cf1df28cb54fa78859dc914376dea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:29.469779 16735 raft_consensus.cc:348] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8326a4ca784563abb34c1308587e46" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44165 } } peers { permanent_uuid: "ba4fa0bb78f9479fa75bdad575a5da26" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37673 } } peers { permanent_uuid: "90a8d74bfe0745f9a632a11720eb2232" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 35205 } }
I20260811 08:17:29.469949 16735 raft_consensus.cc:374] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:29.469985 16735 raft_consensus.cc:729] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba4fa0bb78f9479fa75bdad575a5da26, State: Initialized, Role: FOLLOWER
I20260811 08:17:29.470141 16735 consensus_queue.cc:260] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8326a4ca784563abb34c1308587e46" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44165 } } peers { permanent_uuid: "ba4fa0bb78f9479fa75bdad575a5da26" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37673 } } peers { permanent_uuid: "90a8d74bfe0745f9a632a11720eb2232" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 35205 } }
I20260811 08:17:29.470430 16735 ts_tablet_manager.cc:1428] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 08:17:29.470484 16529 heartbeater.cc:503] Master 127.20.158.190:37963 was elected leader, sending a full tablet report...
I20260811 08:17:29.472087 16743 tablet_bootstrap.cc:492] T 64cf1df28cb54fa78859dc914376dea1 P af8326a4ca784563abb34c1308587e46: Bootstrap starting.
I20260811 08:17:29.472617 16743 tablet_bootstrap.cc:654] T 64cf1df28cb54fa78859dc914376dea1 P af8326a4ca784563abb34c1308587e46: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:29.472934 16743 log.cc:824] T 64cf1df28cb54fa78859dc914376dea1 P af8326a4ca784563abb34c1308587e46: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:29.473718 16743 tablet_bootstrap.cc:492] T 64cf1df28cb54fa78859dc914376dea1 P af8326a4ca784563abb34c1308587e46: No bootstrap required, opened a new log
I20260811 08:17:29.473775 16743 ts_tablet_manager.cc:1397] T 64cf1df28cb54fa78859dc914376dea1 P af8326a4ca784563abb34c1308587e46: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:17:29.475522 16743 raft_consensus.cc:348] T 64cf1df28cb54fa78859dc914376dea1 P af8326a4ca784563abb34c1308587e46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8326a4ca784563abb34c1308587e46" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44165 } } peers { permanent_uuid: "ba4fa0bb78f9479fa75bdad575a5da26" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37673 } } peers { permanent_uuid: "90a8d74bfe0745f9a632a11720eb2232" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 35205 } }
I20260811 08:17:29.475687 16743 raft_consensus.cc:374] T 64cf1df28cb54fa78859dc914376dea1 P af8326a4ca784563abb34c1308587e46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:29.475736 16743 raft_consensus.cc:729] T 64cf1df28cb54fa78859dc914376dea1 P af8326a4ca784563abb34c1308587e46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af8326a4ca784563abb34c1308587e46, State: Initialized, Role: FOLLOWER
I20260811 08:17:29.475860 16743 consensus_queue.cc:260] T 64cf1df28cb54fa78859dc914376dea1 P af8326a4ca784563abb34c1308587e46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8326a4ca784563abb34c1308587e46" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44165 } } peers { permanent_uuid: "ba4fa0bb78f9479fa75bdad575a5da26" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37673 } } peers { permanent_uuid: "90a8d74bfe0745f9a632a11720eb2232" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 35205 } }
I20260811 08:17:29.476116 16743 ts_tablet_manager.cc:1428] T 64cf1df28cb54fa78859dc914376dea1 P af8326a4ca784563abb34c1308587e46: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:17:29.476292 16710 heartbeater.cc:503] Master 127.20.158.190:37963 was elected leader, sending a full tablet report...
W20260811 08:17:29.545917 16530 tablet.cc:2369] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:17:29.660471 16330 tablet.cc:2369] T 64cf1df28cb54fa78859dc914376dea1 P 90a8d74bfe0745f9a632a11720eb2232: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:17:29.664820 16742 raft_consensus.cc:482] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:17:29.664947 16742 raft_consensus.cc:504] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8326a4ca784563abb34c1308587e46" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44165 } } peers { permanent_uuid: "ba4fa0bb78f9479fa75bdad575a5da26" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37673 } } peers { permanent_uuid: "90a8d74bfe0745f9a632a11720eb2232" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 35205 } }
I20260811 08:17:29.665359 16742 leader_election.cc:288] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers af8326a4ca784563abb34c1308587e46 (127.20.158.131:44165), 90a8d74bfe0745f9a632a11720eb2232 (127.20.158.129:35205)
I20260811 08:17:29.669601 16728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:29.665717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:44347 (local address 127.20.158.129:35205)
0811 08:17:29.665783 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:29.665786 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:29.665963 (+ 177us) server_negotiation.cc:407] Connection header received
0811 08:17:29.665995 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:29.665996 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:29.666008 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:29.666061 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:29.666262 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.666978 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.668513 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.669109 (+ 596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.669211 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:29.669222 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:29.669436 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 08:17:29.669482 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 08:17:29.669601 16734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:29.665717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:49457 (local address 127.20.158.131:44165)
0811 08:17:29.665783 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:29.665786 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:29.665799 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:17:29.665863 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:29.665864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:29.665873 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:29.665963 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:29.666193 (+ 230us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.666966 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.668513 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.669157 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.669237 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:29.669245 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:29.669436 (+ 191us) server_negotiation.cc:299] Negotiation successful
0811 08:17:29.669482 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 08:17:29.669620 16531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:29.665636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:44165 (local address 127.20.158.130:49457)
0811 08:17:29.665710 (+ 74us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:29.665724 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:29.665785 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:29.665986 (+ 201us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:29.665987 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:29.665989 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:29.666093 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:29.666095 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.667064 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.667064 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:29.668379 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:29.668383 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.669252 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.669253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:29.669340 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:29.669347 (+ 7us) client_negotiation.cc:769] Sending connection context
0811 08:17:29.669414 (+ 67us) client_negotiation.cc:240] Negotiation successful
0811 08:17:29.669466 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53,"mutex_wait_us":13}
I20260811 08:17:29.669633 16748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:29.665643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:35205 (local address 127.20.158.130:44347)
0811 08:17:29.665845 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:29.665854 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:29.665909 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:29.666084 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:29.666084 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:29.666086 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:29.666147 (+ 61us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:29.666184 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.667063 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.667064 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:29.668379 (+ 1315us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:29.668383 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.669265 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.669265 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:29.669340 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:29.669348 (+ 8us) client_negotiation.cc:769] Sending connection context
0811 08:17:29.669414 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 08:17:29.669466 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":186,"mutex_wait_us":68,"thread_start_us":102,"threads_started":1}
I20260811 08:17:29.670091 16648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64cf1df28cb54fa78859dc914376dea1" candidate_uuid: "ba4fa0bb78f9479fa75bdad575a5da26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af8326a4ca784563abb34c1308587e46" is_pre_election: true
I20260811 08:17:29.670285 16648 raft_consensus.cc:2454] T 64cf1df28cb54fa78859dc914376dea1 P af8326a4ca784563abb34c1308587e46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba4fa0bb78f9479fa75bdad575a5da26 in term 0.
I20260811 08:17:29.670276 16246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64cf1df28cb54fa78859dc914376dea1" candidate_uuid: "ba4fa0bb78f9479fa75bdad575a5da26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90a8d74bfe0745f9a632a11720eb2232" is_pre_election: true
I20260811 08:17:29.670478 16246 raft_consensus.cc:2454] T 64cf1df28cb54fa78859dc914376dea1 P 90a8d74bfe0745f9a632a11720eb2232 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ba4fa0bb78f9479fa75bdad575a5da26 in term 0.
I20260811 08:17:29.670698 16358 leader_election.cc:302] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 90a8d74bfe0745f9a632a11720eb2232, ba4fa0bb78f9479fa75bdad575a5da26; no voters:
I20260811 08:17:29.670845 16742 raft_consensus.cc:2781] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:17:29.670958 16742 raft_consensus.cc:482] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:17:29.671001 16742 raft_consensus.cc:3037] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:29.671815 16742 raft_consensus.cc:504] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8326a4ca784563abb34c1308587e46" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44165 } } peers { permanent_uuid: "ba4fa0bb78f9479fa75bdad575a5da26" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37673 } } peers { permanent_uuid: "90a8d74bfe0745f9a632a11720eb2232" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 35205 } }
I20260811 08:17:29.671984 16742 leader_election.cc:288] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26 [CANDIDATE]: Term 1 election: Requested vote from peers af8326a4ca784563abb34c1308587e46 (127.20.158.131:44165), 90a8d74bfe0745f9a632a11720eb2232 (127.20.158.129:35205)
I20260811 08:17:29.672144 16246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64cf1df28cb54fa78859dc914376dea1" candidate_uuid: "ba4fa0bb78f9479fa75bdad575a5da26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90a8d74bfe0745f9a632a11720eb2232"
I20260811 08:17:29.672160 16648 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "64cf1df28cb54fa78859dc914376dea1" candidate_uuid: "ba4fa0bb78f9479fa75bdad575a5da26" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af8326a4ca784563abb34c1308587e46"
I20260811 08:17:29.672235 16648 raft_consensus.cc:3037] T 64cf1df28cb54fa78859dc914376dea1 P af8326a4ca784563abb34c1308587e46 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:29.672235 16246 raft_consensus.cc:3037] T 64cf1df28cb54fa78859dc914376dea1 P 90a8d74bfe0745f9a632a11720eb2232 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:29.673245 16246 raft_consensus.cc:2454] T 64cf1df28cb54fa78859dc914376dea1 P 90a8d74bfe0745f9a632a11720eb2232 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba4fa0bb78f9479fa75bdad575a5da26 in term 1.
I20260811 08:17:29.673245 16648 raft_consensus.cc:2454] T 64cf1df28cb54fa78859dc914376dea1 P af8326a4ca784563abb34c1308587e46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ba4fa0bb78f9479fa75bdad575a5da26 in term 1.
I20260811 08:17:29.673485 16356 leader_election.cc:302] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: af8326a4ca784563abb34c1308587e46, ba4fa0bb78f9479fa75bdad575a5da26; no voters:
I20260811 08:17:29.673646 16742 raft_consensus.cc:2781] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:17:29.673795 16742 raft_consensus.cc:686] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26 [term 1 LEADER]: Becoming Leader. State: Replica: ba4fa0bb78f9479fa75bdad575a5da26, State: Running, Role: LEADER
I20260811 08:17:29.673872 16742 consensus_queue.cc:237] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8326a4ca784563abb34c1308587e46" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44165 } } peers { permanent_uuid: "ba4fa0bb78f9479fa75bdad575a5da26" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37673 } } peers { permanent_uuid: "90a8d74bfe0745f9a632a11720eb2232" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 35205 } }
I20260811 08:17:29.674850 16023 catalog_manager.cc:5495] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26 reported cstate change: term changed from 0 to 1, leader changed from <none> to ba4fa0bb78f9479fa75bdad575a5da26 (127.20.158.130). New cstate: current_term: 1 leader_uuid: "ba4fa0bb78f9479fa75bdad575a5da26" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "af8326a4ca784563abb34c1308587e46" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ba4fa0bb78f9479fa75bdad575a5da26" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 37673 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90a8d74bfe0745f9a632a11720eb2232" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 35205 } health_report { overall_health: UNKNOWN } } }
W20260811 08:17:29.679425 16712 tablet.cc:2369] T 64cf1df28cb54fa78859dc914376dea1 P af8326a4ca784563abb34c1308587e46: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:17:29.680974 16730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:29.678636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56332 (local address 127.20.158.130:37673)
0811 08:17:29.678708 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:29.678710 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:29.678720 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:17:29.678766 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:29.678767 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:29.678791 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:29.678862 (+ 71us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:17:29.679000 (+ 138us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.679498 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.680268 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:29.680479 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:29.680549 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:29.680676 (+ 127us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:17:29.680778 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:17:29.680844 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:29.680877 (+ 33us) server_negotiation.cc:299] Negotiation successful
0811 08:17:29.680897 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 08:17:29.682910 16648 raft_consensus.cc:1261] T 64cf1df28cb54fa78859dc914376dea1 P af8326a4ca784563abb34c1308587e46 [term 1 FOLLOWER]: Refusing update from remote peer ba4fa0bb78f9479fa75bdad575a5da26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:17:29.682911 16246 raft_consensus.cc:1261] T 64cf1df28cb54fa78859dc914376dea1 P 90a8d74bfe0745f9a632a11720eb2232 [term 1 FOLLOWER]: Refusing update from remote peer ba4fa0bb78f9479fa75bdad575a5da26: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:17:29.683269 16742 consensus_queue.cc:1035] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90a8d74bfe0745f9a632a11720eb2232" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 35205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:17:29.683424 16749 consensus_queue.cc:1035] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af8326a4ca784563abb34c1308587e46" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 44165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:17:29.685945 16754 mvcc.cc:205] Tried to move back new op lower bound from 7317242878698434560 to 7317242878664810496. Current Snapshot: MvccSnapshot[applied={T|T < 7317242878698434560}]
I20260811 08:17:29.686796 16757 mvcc.cc:205] Tried to move back new op lower bound from 7317242878698434560 to 7317242878664810496. Current Snapshot: MvccSnapshot[applied={T|T < 7317242878698434560}]
I20260811 08:17:29.688607 16025 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43424:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:17:29.688716 16025 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43424:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:17:29.689497 16025 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cc671b066ce645f08660e3acbba62f97: Sending DeleteTablet for 3 replicas of tablet 64cf1df28cb54fa78859dc914376dea1
I20260811 08:17:29.689848 16624 tablet_service.cc:1514] Processing DeleteTablet for tablet 64cf1df28cb54fa78859dc914376dea1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:17:29 UTC) from {username='slave'} at 127.0.0.1:40516
I20260811 08:17:29.689895 16421 tablet_service.cc:1514] Processing DeleteTablet for tablet 64cf1df28cb54fa78859dc914376dea1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:17:29 UTC) from {username='slave'} at 127.0.0.1:56326
I20260811 08:17:29.689895 16220 tablet_service.cc:1514] Processing DeleteTablet for tablet 64cf1df28cb54fa78859dc914376dea1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:17:29 UTC) from {username='slave'} at 127.0.0.1:55144
I20260811 08:17:29.690229 16769 tablet_replica.cc:330] T 64cf1df28cb54fa78859dc914376dea1 P 90a8d74bfe0745f9a632a11720eb2232: stopping tablet replica
I20260811 08:17:29.690248 16768 tablet_replica.cc:330] T 64cf1df28cb54fa78859dc914376dea1 P af8326a4ca784563abb34c1308587e46: stopping tablet replica
I20260811 08:17:29.690347 16769 raft_consensus.cc:2229] T 64cf1df28cb54fa78859dc914376dea1 P 90a8d74bfe0745f9a632a11720eb2232 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:17:29.690452 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 16105
I20260811 08:17:29.690475 16769 raft_consensus.cc:2258] T 64cf1df28cb54fa78859dc914376dea1 P 90a8d74bfe0745f9a632a11720eb2232 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:17:29.690626 16772 tablet_replica.cc:330] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26: stopping tablet replica
I20260811 08:17:29.690711 16772 raft_consensus.cc:2229] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:17:29.690821 16772 raft_consensus.cc:2258] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:17:29.693632 16772 ts_tablet_manager.cc:1905] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:17:29.690491 16768 raft_consensus.cc:2229] T 64cf1df28cb54fa78859dc914376dea1 P af8326a4ca784563abb34c1308587e46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:17:29.695876 16768 raft_consensus.cc:2258] T 64cf1df28cb54fa78859dc914376dea1 P af8326a4ca784563abb34c1308587e46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:17:29.695959 16772 ts_tablet_manager.cc:1918] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:17:29.696072 16772 log.cc:1196] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-1/wal/wals/64cf1df28cb54fa78859dc914376dea1
I20260811 08:17:29.696416 16772 ts_tablet_manager.cc:1939] T 64cf1df28cb54fa78859dc914376dea1 P ba4fa0bb78f9479fa75bdad575a5da26: Deleting consensus metadata
I20260811 08:17:29.698323 16002 catalog_manager.cc:4841] TS ba4fa0bb78f9479fa75bdad575a5da26 (127.20.158.130:37673): tablet 64cf1df28cb54fa78859dc914376dea1 (table test-table [id=36eff968f6ab49b88b9deef9722a41da]) successfully deleted
I20260811 08:17:29.706522 16768 ts_tablet_manager.cc:1905] T 64cf1df28cb54fa78859dc914376dea1 P af8326a4ca784563abb34c1308587e46: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 08:17:29.707940 16001 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.158.129:35205 (error 108)
I20260811 08:17:29.708153 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 16334
I20260811 08:17:29.714036 16724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:29.713869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:35205 (local address 127.0.0.1:55146)
0811 08:17:29.713931 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:29.713983 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.129:35205: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260811 08:17:29.714180 16001 catalog_manager.cc:4584] TS 90a8d74bfe0745f9a632a11720eb2232 (127.20.158.129:35205): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 64cf1df28cb54fa78859dc914376dea1: Network error: Client connection negotiation failed: client connection to 127.20.158.129:35205: connect: Connection refused (error 111)
I20260811 08:17:29.716956 16768 ts_tablet_manager.cc:1918] T 64cf1df28cb54fa78859dc914376dea1 P af8326a4ca784563abb34c1308587e46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:17:29.717049 16768 log.cc:1196] T 64cf1df28cb54fa78859dc914376dea1 P af8326a4ca784563abb34c1308587e46: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786436003833085-21114-0/minicluster-data/ts-2/wal/wals/64cf1df28cb54fa78859dc914376dea1
I20260811 08:17:29.717299 16768 ts_tablet_manager.cc:1939] T 64cf1df28cb54fa78859dc914376dea1 P af8326a4ca784563abb34c1308587e46: Deleting consensus metadata
I20260811 08:17:29.734833 15998 catalog_manager.cc:4841] TS af8326a4ca784563abb34c1308587e46 (127.20.158.131:44165): tablet 64cf1df28cb54fa78859dc914376dea1 (table test-table [id=36eff968f6ab49b88b9deef9722a41da]) successfully deleted
I20260811 08:17:29.741479 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 16534
I20260811 08:17:29.753791 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 15975
2026-08-11T08:17:29Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (919 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:17:29 dist-test-slave-gkw7 krb5kdc[16777](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:17:29 dist-test-slave-gkw7 krb5kdc[16777](info): set up 2 sockets
Aug 11 08:17:29 dist-test-slave-gkw7 krb5kdc[16777](info): commencing operation
krb5kdc: starting...
W20260811 08:17:31.023844 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.240s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:17:31 dist-test-slave-gkw7 krb5kdc[16777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436251, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:17:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:17:31Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:17:31.165349 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:37393
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:34519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:37393
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:31.250808 16795 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:31.251031 16795 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:31.251055 16795 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:31.252307 16795 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:17:31.252355 16795 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:31.252372 16795 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:31.252384 16795 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:17:31.252396 16795 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:17:31.254022 16795 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:34519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:37393
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:37393
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16795
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:31.254305 16795 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:31.254559 16795 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:31.259842 16801 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:31.259868 16804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:31.259994 16802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:31.260077 16795 server_base.cc:1034] running on GCE node
I20260811 08:17:31.260304 16795 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:31.260663 16795 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:31.261861 16795 hybrid_clock.cc:648] HybridClock initialized: now 1786436251261846 us; error 28 us; skew 500 ppm
Aug 11 08:17:31 dist-test-slave-gkw7 krb5kdc[16777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436251, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:31.264571 16795 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:17:31.265086 16795 webserver.cc:460] Webserver started at http://127.20.158.190:46149/ using document root <none> and password file <none>
I20260811 08:17:31.265352 16795 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:31.265425 16795 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:31.265615 16795 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:31.266742 16795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "16777be0f09145cba5dc0e1b7efdad6a"
format_stamp: "Formatted at 2026-08-11 08:17:31 on dist-test-slave-gkw7"
server_key: "7e272057c9e19c7cd9cf24c649bfa079"
server_key_iv: "7fd8a0e0986ad9526af05e1be4e1e5ff"
server_key_version: "encryptionkey@0"
I20260811 08:17:31.267122 16795 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "16777be0f09145cba5dc0e1b7efdad6a"
format_stamp: "Formatted at 2026-08-11 08:17:31 on dist-test-slave-gkw7"
server_key: "7e272057c9e19c7cd9cf24c649bfa079"
server_key_iv: "7fd8a0e0986ad9526af05e1be4e1e5ff"
server_key_version: "encryptionkey@0"
I20260811 08:17:31.268541 16795 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:17:31.269425 16811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:31.269667 16795 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:17:31.269786 16795 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "16777be0f09145cba5dc0e1b7efdad6a"
format_stamp: "Formatted at 2026-08-11 08:17:31 on dist-test-slave-gkw7"
server_key: "7e272057c9e19c7cd9cf24c649bfa079"
server_key_iv: "7fd8a0e0986ad9526af05e1be4e1e5ff"
server_key_version: "encryptionkey@0"
I20260811 08:17:31.269867 16795 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:31.282505 16795 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:31.284608 16795 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:31.284799 16795 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:31.289295 16795 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:37393
I20260811 08:17:31.289417 16885 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:37393 every 8 connection(s)
I20260811 08:17:31.289783 16795 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:17:31.290686 16886 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:31.291417 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 16795
I20260811 08:17:31.291519 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:17:31.291765 21114 external_mini_cluster.cc:1428] Setting key 540d0a7de3cbb656f3e50eec63958a53
I20260811 08:17:31.293982 16886 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16777be0f09145cba5dc0e1b7efdad6a: Bootstrap starting.
I20260811 08:17:31.294721 16886 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 16777be0f09145cba5dc0e1b7efdad6a: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:31.295048 16886 log.cc:824] T 00000000000000000000000000000000 P 16777be0f09145cba5dc0e1b7efdad6a: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:31.295790 16886 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16777be0f09145cba5dc0e1b7efdad6a: No bootstrap required, opened a new log
I20260811 08:17:31.298250 16886 raft_consensus.cc:348] T 00000000000000000000000000000000 P 16777be0f09145cba5dc0e1b7efdad6a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16777be0f09145cba5dc0e1b7efdad6a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37393 } }
I20260811 08:17:31.298401 16886 raft_consensus.cc:374] T 00000000000000000000000000000000 P 16777be0f09145cba5dc0e1b7efdad6a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:31.298425 16886 raft_consensus.cc:729] T 00000000000000000000000000000000 P 16777be0f09145cba5dc0e1b7efdad6a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16777be0f09145cba5dc0e1b7efdad6a, State: Initialized, Role: FOLLOWER
I20260811 08:17:31.298592 16886 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16777be0f09145cba5dc0e1b7efdad6a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16777be0f09145cba5dc0e1b7efdad6a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37393 } }
I20260811 08:17:31.298695 16886 raft_consensus.cc:388] T 00000000000000000000000000000000 P 16777be0f09145cba5dc0e1b7efdad6a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:17:31.298723 16886 raft_consensus.cc:482] T 00000000000000000000000000000000 P 16777be0f09145cba5dc0e1b7efdad6a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:17:31.298799 16886 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 16777be0f09145cba5dc0e1b7efdad6a [term 0 FOLLOWER]: Advancing to term 1
Aug 11 08:17:31 dist-test-slave-gkw7 krb5kdc[16777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436251, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:17:31.299436 16886 raft_consensus.cc:504] T 00000000000000000000000000000000 P 16777be0f09145cba5dc0e1b7efdad6a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16777be0f09145cba5dc0e1b7efdad6a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37393 } }
I20260811 08:17:31.299567 16886 leader_election.cc:302] T 00000000000000000000000000000000 P 16777be0f09145cba5dc0e1b7efdad6a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 16777be0f09145cba5dc0e1b7efdad6a; no voters:
I20260811 08:17:31.299777 16886 leader_election.cc:288] T 00000000000000000000000000000000 P 16777be0f09145cba5dc0e1b7efdad6a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:17:31.299811 16893 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 16777be0f09145cba5dc0e1b7efdad6a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:17:31.299938 16893 raft_consensus.cc:686] T 00000000000000000000000000000000 P 16777be0f09145cba5dc0e1b7efdad6a [term 1 LEADER]: Becoming Leader. State: Replica: 16777be0f09145cba5dc0e1b7efdad6a, State: Running, Role: LEADER
I20260811 08:17:31.300028 16893 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16777be0f09145cba5dc0e1b7efdad6a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16777be0f09145cba5dc0e1b7efdad6a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37393 } }
I20260811 08:17:31.300120 16886 sys_catalog.cc:564] T 00000000000000000000000000000000 P 16777be0f09145cba5dc0e1b7efdad6a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:17:31.300966 16898 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16777be0f09145cba5dc0e1b7efdad6a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16777be0f09145cba5dc0e1b7efdad6a. Latest consensus state: current_term: 1 leader_uuid: "16777be0f09145cba5dc0e1b7efdad6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16777be0f09145cba5dc0e1b7efdad6a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37393 } } }
I20260811 08:17:31.300958 16896 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16777be0f09145cba5dc0e1b7efdad6a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "16777be0f09145cba5dc0e1b7efdad6a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "16777be0f09145cba5dc0e1b7efdad6a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37393 } } }
I20260811 08:17:31.301072 16896 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16777be0f09145cba5dc0e1b7efdad6a [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:31.301060 16898 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16777be0f09145cba5dc0e1b7efdad6a [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:31.301391 16909 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:17:31.302096 16909 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:17:31.304250 16909 catalog_manager.cc:1347] Generated new cluster ID: 8c905920282c4678a6754831f1132e1c
I20260811 08:17:31.304297 16890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:31.292335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45108 (local address 127.20.158.190:37393)
0811 08:17:31.292534 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:31.292545 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:31.292582 (+ 37us) server_negotiation.cc:407] Connection header received
0811 08:17:31.293165 (+ 583us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:31.293175 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:31.293243 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:31.293399 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:31.294093 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.295511 (+ 1418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.296327 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.296962 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.297087 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:31.299934 (+ 2847us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:31.299939 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:31.299940 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:17:31.299956 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:31.302332 (+ 2376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:31.302781 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:31.302785 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:31.302785 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:31.302897 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:31.303252 (+ 355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:31.303253 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:31.303253 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:31.303576 (+ 323us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:31.303736 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:31.303907 (+ 171us) server_negotiation.cc:299] Negotiation successful
0811 08:17:31.304061 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":84,"threads_started":1}
I20260811 08:17:31.304368 16909 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:17:31.321765 16909 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:17:31.322340 16909 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:17:31.325275 16909 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 16777be0f09145cba5dc0e1b7efdad6a: Generated new TSK 0
I20260811 08:17:31.325474 16909 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.158.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
I20260811 08:17:31.362634 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:0
--local_ip_for_outbound_sockets=127.20.158.129
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:37393
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:34519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:31.462364 16930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:31.462560 16930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:31.462584 16930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:31.463739 16930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:31.463781 16930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:31.463807 16930 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:17:31.465265 16930 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:34519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:37393
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.16930
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:31.465512 16930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:31.465790 16930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:31.470995 16937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:31.471022 16940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:31.471236 16930 server_base.cc:1034] running on GCE node
W20260811 08:17:31.471273 16944 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:31.471530 16930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:31.471812 16930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:31.472965 16930 hybrid_clock.cc:648] HybridClock initialized: now 1786436251472934 us; error 41 us; skew 500 ppm
Aug 11 08:17:31 dist-test-slave-gkw7 krb5kdc[16777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436251, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:31.475934 16930 init.cc:377] Logged in from keytab as kudu/127.20.158.129@KRBTEST.COM (short username kudu)
I20260811 08:17:31.476447 16930 webserver.cc:460] Webserver started at http://127.20.158.129:37095/ using document root <none> and password file <none>
I20260811 08:17:31.476727 16930 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:31.476804 16930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:31.476966 16930 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:31.478189 16930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-0/data/instance:
uuid: "31ce93f37f4d400c8ce14dd2730b145b"
format_stamp: "Formatted at 2026-08-11 08:17:31 on dist-test-slave-gkw7"
server_key: "90a1251f9144e68e36c1e26168ee19c9"
server_key_iv: "3ee16da0cad8b49815ffd8e4b9e4b448"
server_key_version: "encryptionkey@0"
I20260811 08:17:31.478614 16930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance:
uuid: "31ce93f37f4d400c8ce14dd2730b145b"
format_stamp: "Formatted at 2026-08-11 08:17:31 on dist-test-slave-gkw7"
server_key: "90a1251f9144e68e36c1e26168ee19c9"
server_key_iv: "3ee16da0cad8b49815ffd8e4b9e4b448"
server_key_version: "encryptionkey@0"
I20260811 08:17:31.480197 16930 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:17:31.480983 16952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:31.481176 16930 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:17:31.481298 16930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "31ce93f37f4d400c8ce14dd2730b145b"
format_stamp: "Formatted at 2026-08-11 08:17:31 on dist-test-slave-gkw7"
server_key: "90a1251f9144e68e36c1e26168ee19c9"
server_key_iv: "3ee16da0cad8b49815ffd8e4b9e4b448"
server_key_version: "encryptionkey@0"
I20260811 08:17:31.481380 16930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:31.494550 16930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:31.497195 16930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:31.497375 16930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:31.497706 16930 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:17:31.498052 16930 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:17:31.498121 16930 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:31.498164 16930 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:17:31.498195 16930 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:31.505034 16930 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:45181
I20260811 08:17:31.505074 17127 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:45181 every 8 connection(s)
I20260811 08:17:31.505430 16930 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:17:31.509771 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 16930
I20260811 08:17:31.509898 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance
I20260811 08:17:31.510128 21114 external_mini_cluster.cc:1428] Setting key ba8b0f35bb6ecca41cebc84b42c433e3
Aug 11 08:17:31 dist-test-slave-gkw7 krb5kdc[16777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436251, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:17:31.516242 16890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:31.506371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:60415 (local address 127.20.158.190:37393)
0811 08:17:31.506455 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:31.506464 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:31.506677 (+ 213us) server_negotiation.cc:407] Connection header received
0811 08:17:31.507162 (+ 485us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:31.507163 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:31.507176 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:31.507242 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:31.508253 (+ 1011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.508768 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.510037 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.510315 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.510398 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:31.512823 (+ 2425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:31.512824 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:31.512825 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:17:31.512832 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:31.514586 (+ 1754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:31.515146 (+ 560us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:31.515148 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:31.515148 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:31.515229 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:31.515507 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:31.515508 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:31.515509 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:31.515642 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:31.515728 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:31.516031 (+ 303us) server_negotiation.cc:299] Negotiation successful
0811 08:17:31.516150 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260811 08:17:31.516443 17131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:31.506327 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:37393 (local address 127.20.158.129:60415)
0811 08:17:31.506533 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:31.506578 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:31.507068 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:31.507299 (+ 231us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:31.507302 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:31.507907 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:17:31.508138 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:31.508143 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.508860 (+ 717us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.508861 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:31.509942 (+ 1081us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:31.509946 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.510422 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.510423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:31.510592 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:31.511244 (+ 652us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:17:31.511253 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:17:31.512712 (+ 1459us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:17:31.514705 (+ 1993us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:17:31.514714 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:17:31.514717 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:17:31.514982 (+ 265us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:17:31.515294 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:17:31.515295 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:17:31.515296 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:17:31.515418 (+ 122us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:17:31.515719 (+ 301us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:17:31.515727 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:17:31.515877 (+ 150us) client_negotiation.cc:769] Sending connection context
0811 08:17:31.515991 (+ 114us) client_negotiation.cc:240] Negotiation successful
0811 08:17:31.516178 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":131,"threads_started":1}
I20260811 08:17:31.517084 17128 heartbeater.cc:347] Connected to a master server at 127.20.158.190:37393
I20260811 08:17:31.517210 17128 heartbeater.cc:464] Registering TS with master...
I20260811 08:17:31.517419 17128 heartbeater.cc:511] Master 127.20.158.190:37393 requested a full tablet report, sending...
I20260811 08:17:31.518082 16836 ts_manager.cc:194] Registered new tserver with Master: 31ce93f37f4d400c8ce14dd2730b145b (127.20.158.129:45181)
I20260811 08:17:31.519075 16836 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.129@KRBTEST.COM'} at 127.20.158.129:60415
WARNING: no policy specified for kudu/127.20.158.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
I20260811 08:17:31.538532 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:0
--local_ip_for_outbound_sockets=127.20.158.130
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:37393
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:34519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:31.621079 17141 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:31.621281 17141 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:31.621305 17141 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:31.622399 17141 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:31.622437 17141 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:31.622462 17141 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:17:31.623843 17141 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:34519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:37393
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17141
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:31.624024 17141 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:31.624202 17141 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:31.629238 17150 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:31.629231 17146 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:31.629240 17148 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:31.629518 17141 server_base.cc:1034] running on GCE node
I20260811 08:17:31.629774 17141 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:31.630010 17141 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:31.631199 17141 hybrid_clock.cc:648] HybridClock initialized: now 1786436251631189 us; error 27 us; skew 500 ppm
Aug 11 08:17:31 dist-test-slave-gkw7 krb5kdc[16777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436251, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:31.633792 17141 init.cc:377] Logged in from keytab as kudu/127.20.158.130@KRBTEST.COM (short username kudu)
I20260811 08:17:31.634272 17141 webserver.cc:460] Webserver started at http://127.20.158.130:37771/ using document root <none> and password file <none>
I20260811 08:17:31.634507 17141 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:31.634575 17141 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:31.634711 17141 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:31.635763 17141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-1/data/instance:
uuid: "0f9e576423144b66b4aeb21c82f24249"
format_stamp: "Formatted at 2026-08-11 08:17:31 on dist-test-slave-gkw7"
server_key: "ee6111780d35d51c0a79fd6cc1b5b9e4"
server_key_iv: "c561c7b5bdb4153b466f26924788ecb4"
server_key_version: "encryptionkey@0"
I20260811 08:17:31.636121 17141 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance:
uuid: "0f9e576423144b66b4aeb21c82f24249"
format_stamp: "Formatted at 2026-08-11 08:17:31 on dist-test-slave-gkw7"
server_key: "ee6111780d35d51c0a79fd6cc1b5b9e4"
server_key_iv: "c561c7b5bdb4153b466f26924788ecb4"
server_key_version: "encryptionkey@0"
I20260811 08:17:31.637439 17141 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:17:31.638218 17162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:31.638441 17141 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:17:31.638552 17141 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "0f9e576423144b66b4aeb21c82f24249"
format_stamp: "Formatted at 2026-08-11 08:17:31 on dist-test-slave-gkw7"
server_key: "ee6111780d35d51c0a79fd6cc1b5b9e4"
server_key_iv: "c561c7b5bdb4153b466f26924788ecb4"
server_key_version: "encryptionkey@0"
I20260811 08:17:31.638651 17141 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:31.652209 17141 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:31.654186 17141 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:31.654358 17141 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:31.654587 17141 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:17:31.654897 17141 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:17:31.654958 17141 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:31.654999 17141 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:17:31.655027 17141 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:31.661001 17141 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:45691
I20260811 08:17:31.661046 17337 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:45691 every 8 connection(s)
I20260811 08:17:31.661362 17141 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
I20260811 08:17:31.663975 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 17141
I20260811 08:17:31.664140 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance
I20260811 08:17:31.664352 21114 external_mini_cluster.cc:1428] Setting key c44b3b52271fff362053d746eb9f93ce
Aug 11 08:17:31 dist-test-slave-gkw7 krb5kdc[16777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436251, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:17:31.672389 16890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:31.662139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:45905 (local address 127.20.158.190:37393)
0811 08:17:31.662203 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:31.662206 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:31.662449 (+ 243us) server_negotiation.cc:407] Connection header received
0811 08:17:31.662900 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:31.662901 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:31.662913 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:31.662976 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:31.663905 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.664705 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.665931 (+ 1226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.666242 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.666321 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:31.669014 (+ 2693us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:31.669015 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:31.669016 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:17:31.669023 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:31.670676 (+ 1653us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:31.671261 (+ 585us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:31.671262 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:31.671262 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:31.671316 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:31.671653 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:31.671654 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:31.671654 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:31.671757 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:31.671813 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:31.672252 (+ 439us) server_negotiation.cc:299] Negotiation successful
0811 08:17:31.672325 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 08:17:31.672735 17344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:31.662114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:37393 (local address 127.20.158.130:45905)
0811 08:17:31.662294 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:31.662336 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:31.662803 (+ 467us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:31.663026 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:31.663029 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:31.663594 (+ 565us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:17:31.663785 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:31.663791 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.664807 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.664808 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:31.665846 (+ 1038us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:31.665850 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.666331 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.666332 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:31.666451 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:31.667006 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:17:31.667017 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:17:31.668914 (+ 1897us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:17:31.670773 (+ 1859us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:17:31.670780 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:17:31.670782 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:17:31.671173 (+ 391us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:17:31.671391 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:17:31.671392 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:17:31.671392 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:17:31.671572 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:17:31.671831 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:17:31.671838 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:17:31.672038 (+ 200us) client_negotiation.cc:769] Sending connection context
0811 08:17:31.672197 (+ 159us) client_negotiation.cc:240] Negotiation successful
0811 08:17:31.672434 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":102,"threads_started":1}
I20260811 08:17:31.673342 17338 heartbeater.cc:347] Connected to a master server at 127.20.158.190:37393
I20260811 08:17:31.673441 17338 heartbeater.cc:464] Registering TS with master...
I20260811 08:17:31.673674 17338 heartbeater.cc:511] Master 127.20.158.190:37393 requested a full tablet report, sending...
I20260811 08:17:31.674134 16836 ts_manager.cc:194] Registered new tserver with Master: 0f9e576423144b66b4aeb21c82f24249 (127.20.158.130:45691)
I20260811 08:17:31.674546 16836 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.130@KRBTEST.COM'} at 127.20.158.130:45905
WARNING: no policy specified for kudu/127.20.158.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
I20260811 08:17:31.694243 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:0
--local_ip_for_outbound_sockets=127.20.158.131
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:37393
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:34519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:31.778667 17353 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:31.778915 17353 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:31.778956 17353 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:31.780122 17353 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:31.780194 17353 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:31.780246 17353 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:17:31.781826 17353 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:34519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:37393
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17353
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:31.782109 17353 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:31.782356 17353 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:31.787760 17359 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:31.787731 17364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:31.787794 17361 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:31.788049 17353 server_base.cc:1034] running on GCE node
I20260811 08:17:31.788259 17353 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:31.788491 17353 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:31.789621 17353 hybrid_clock.cc:648] HybridClock initialized: now 1786436251789588 us; error 39 us; skew 500 ppm
Aug 11 08:17:31 dist-test-slave-gkw7 krb5kdc[16777](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436251, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:31.792419 17353 init.cc:377] Logged in from keytab as kudu/127.20.158.131@KRBTEST.COM (short username kudu)
I20260811 08:17:31.792913 17353 webserver.cc:460] Webserver started at http://127.20.158.131:41715/ using document root <none> and password file <none>
I20260811 08:17:31.793134 17353 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:31.793181 17353 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:31.793279 17353 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:31.794426 17353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-2/data/instance:
uuid: "7475a224eea040869d6cd27627428175"
format_stamp: "Formatted at 2026-08-11 08:17:31 on dist-test-slave-gkw7"
server_key: "bd3a1c5a2fb9e0a9ac78d0a1f5b0a562"
server_key_iv: "84e11aa1df52d4ffb5bbd0a4fe1329c1"
server_key_version: "encryptionkey@0"
I20260811 08:17:31.794770 17353 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance:
uuid: "7475a224eea040869d6cd27627428175"
format_stamp: "Formatted at 2026-08-11 08:17:31 on dist-test-slave-gkw7"
server_key: "bd3a1c5a2fb9e0a9ac78d0a1f5b0a562"
server_key_iv: "84e11aa1df52d4ffb5bbd0a4fe1329c1"
server_key_version: "encryptionkey@0"
I20260811 08:17:31.796161 17353 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 08:17:31.797008 17377 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:31.797207 17353 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:17:31.797307 17353 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "7475a224eea040869d6cd27627428175"
format_stamp: "Formatted at 2026-08-11 08:17:31 on dist-test-slave-gkw7"
server_key: "bd3a1c5a2fb9e0a9ac78d0a1f5b0a562"
server_key_iv: "84e11aa1df52d4ffb5bbd0a4fe1329c1"
server_key_version: "encryptionkey@0"
I20260811 08:17:31.797386 17353 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:31.817144 17353 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:31.819657 17353 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:31.819837 17353 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:31.820084 17353 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:17:31.820429 17353 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:17:31.820465 17353 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:31.820524 17353 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:17:31.820554 17353 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:31.826947 17353 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:43843
I20260811 08:17:31.827021 17544 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:43843 every 8 connection(s)
I20260811 08:17:31.827340 17353 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
I20260811 08:17:31.829744 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 17353
I20260811 08:17:31.829874 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance
I20260811 08:17:31.830067 21114 external_mini_cluster.cc:1428] Setting key 971036700593ca838652fa8bdf9a8f48
Aug 11 08:17:31 dist-test-slave-gkw7 krb5kdc[16777](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436251, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:17:31.837001 16890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:31.828091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:47703 (local address 127.20.158.190:37393)
0811 08:17:31.828158 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:31.828160 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:31.828391 (+ 231us) server_negotiation.cc:407] Connection header received
0811 08:17:31.828875 (+ 484us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:31.828876 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:31.828885 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:31.828946 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:31.830063 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.830707 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.831772 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.831962 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.832018 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:31.834136 (+ 2118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:31.834138 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:31.834138 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:17:31.834147 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:31.835559 (+ 1412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:31.836001 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:31.836002 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:31.836003 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:31.836067 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:31.836339 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:31.836340 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:31.836340 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:31.836458 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:31.836531 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:31.836826 (+ 295us) server_negotiation.cc:299] Negotiation successful
0811 08:17:31.836907 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260811 08:17:31.837206 17552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:31.828083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:37393 (local address 127.20.158.131:47703)
0811 08:17:31.828261 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:31.828304 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:31.828792 (+ 488us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:31.829002 (+ 210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:31.829006 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:31.829705 (+ 699us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:17:31.829956 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:31.829963 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.830800 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.830801 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:31.831696 (+ 895us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:31.831699 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.832037 (+ 338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.832038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:31.832142 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:31.832602 (+ 460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:17:31.832610 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:17:31.834033 (+ 1423us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:17:31.835676 (+ 1643us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:17:31.835683 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:17:31.835685 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:17:31.835917 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:17:31.836140 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:17:31.836141 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:17:31.836141 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:17:31.836260 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:17:31.836533 (+ 273us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:17:31.836541 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:17:31.836692 (+ 151us) client_negotiation.cc:769] Sending connection context
0811 08:17:31.836802 (+ 110us) client_negotiation.cc:240] Negotiation successful
0811 08:17:31.836964 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":104,"threads_started":1}
I20260811 08:17:31.837795 17546 heartbeater.cc:347] Connected to a master server at 127.20.158.190:37393
I20260811 08:17:31.837884 17546 heartbeater.cc:464] Registering TS with master...
I20260811 08:17:31.838030 17546 heartbeater.cc:511] Master 127.20.158.190:37393 requested a full tablet report, sending...
I20260811 08:17:31.838375 16836 ts_manager.cc:194] Registered new tserver with Master: 7475a224eea040869d6cd27627428175 (127.20.158.131:43843)
I20260811 08:17:31.838807 16836 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.131@KRBTEST.COM'} at 127.20.158.131:47703
I20260811 08:17:31.842036 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:17:31.849764 16890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:31.843486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45110 (local address 127.20.158.190:37393)
0811 08:17:31.843563 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:31.843565 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:31.843574 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:17:31.843645 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:31.843645 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:31.843654 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:31.843707 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:31.844254 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.844729 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.845461 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.845768 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.845847 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:31.847193 (+ 1346us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:31.847194 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:31.847195 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:17:31.847201 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:31.848485 (+ 1284us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:31.848880 (+ 395us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:31.848881 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:31.848881 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:31.848934 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:31.849165 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:31.849166 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:31.849167 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:31.849329 (+ 162us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:31.849431 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:31.849619 (+ 188us) server_negotiation.cc:299] Negotiation successful
0811 08:17:31.849685 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260811 08:17:31.851590 16836 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45110:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:17:31.853333 16836 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:17:31.860368 17565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:31.855938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43242 (local address 127.20.158.129:45181)
0811 08:17:31.856165 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:31.856170 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:31.856179 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:17:31.856216 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:31.856218 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:31.856239 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:31.856345 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:31.856555 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.857846 (+ 1291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.859280 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.859990 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.860053 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:31.860115 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:31.860248 (+ 133us) server_negotiation.cc:299] Negotiation successful
0811 08:17:31.860290 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":195,"thread_start_us":96,"threads_started":1}
I20260811 08:17:31.860368 17564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:31.855811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:45181 (local address 127.0.0.1:43242)
0811 08:17:31.855969 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:31.856015 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:31.856083 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:31.856353 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:31.856357 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:31.856359 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:31.856448 (+ 89us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:31.856450 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.857971 (+ 1521us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.857972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:31.859182 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:31.859185 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.860082 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.860084 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:31.860154 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:31.860159 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:17:31.860221 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 08:17:31.860266 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"mutex_wait_us":24,"thread_start_us":73,"threads_started":1}
I20260811 08:17:31.860452 17566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:31.856021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59858 (local address 127.20.158.131:43843)
0811 08:17:31.856766 (+ 745us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:31.856772 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:31.856781 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:17:31.856820 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:31.856822 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:31.856839 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:31.856921 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:31.857163 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.857959 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.859276 (+ 1317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.859863 (+ 587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.859963 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:31.860024 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:31.860316 (+ 292us) server_negotiation.cc:299] Negotiation successful
0811 08:17:31.860362 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":705,"thread_start_us":95,"threads_started":1}
I20260811 08:17:31.860272 17563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:31.855811 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:43843 (local address 127.0.0.1:59858)
0811 08:17:31.856214 (+ 403us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:31.856228 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:31.856288 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:31.856994 (+ 706us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:31.856995 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:31.856997 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:31.857072 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:31.857073 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.858085 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.858086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:31.859181 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:31.859184 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.859959 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.859959 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:31.860051 (+ 92us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:31.860066 (+ 15us) client_negotiation.cc:769] Sending connection context
0811 08:17:31.860132 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 08:17:31.860186 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":387,"mutex_wait_us":3,"thread_start_us":89,"threads_started":1}
I20260811 08:17:31.861060 17567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:31.856033 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:45691 (local address 127.0.0.1:49062)
0811 08:17:31.856534 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:31.856545 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:31.856646 (+ 101us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:31.857027 (+ 381us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:31.857028 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:31.857030 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:31.857080 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:31.857081 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.858517 (+ 1436us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.858518 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:31.859781 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:31.859784 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.860805 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.860806 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:31.860861 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:31.860865 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:17:31.860943 (+ 78us) client_negotiation.cc:240] Negotiation successful
0811 08:17:31.860991 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":481,"mutex_wait_us":2,"thread_start_us":122,"threads_started":1}
I20260811 08:17:31.861294 17569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:31.856349 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49062 (local address 127.20.158.130:45691)
0811 08:17:31.856513 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:31.856518 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:31.856726 (+ 208us) server_negotiation.cc:407] Connection header received
0811 08:17:31.856836 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:31.856840 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:31.856859 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:31.856938 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:31.857185 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.858405 (+ 1220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.859880 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.860719 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.860800 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:31.860850 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:31.861162 (+ 312us) server_negotiation.cc:299] Negotiation successful
0811 08:17:31.861206 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":98,"threads_started":1}
I20260811 08:17:31.861707 17029 tablet_service.cc:1467] Processing CreateTablet for tablet 65e363b36f0e42009681e88440491c7a (DEFAULT_TABLE table=test-table [id=fd1dfb3602d04d668ac0a4627e49157a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:17:31.861707 17449 tablet_service.cc:1467] Processing CreateTablet for tablet 65e363b36f0e42009681e88440491c7a (DEFAULT_TABLE table=test-table [id=fd1dfb3602d04d668ac0a4627e49157a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:17:31.862149 17449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65e363b36f0e42009681e88440491c7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:31.862149 17029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65e363b36f0e42009681e88440491c7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:31.865944 17572 tablet_bootstrap.cc:492] T 65e363b36f0e42009681e88440491c7a P 31ce93f37f4d400c8ce14dd2730b145b: Bootstrap starting.
I20260811 08:17:31.865975 17575 tablet_bootstrap.cc:492] T 65e363b36f0e42009681e88440491c7a P 7475a224eea040869d6cd27627428175: Bootstrap starting.
I20260811 08:17:31.866405 17246 tablet_service.cc:1467] Processing CreateTablet for tablet 65e363b36f0e42009681e88440491c7a (DEFAULT_TABLE table=test-table [id=fd1dfb3602d04d668ac0a4627e49157a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:17:31.866663 17575 tablet_bootstrap.cc:654] T 65e363b36f0e42009681e88440491c7a P 7475a224eea040869d6cd27627428175: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:31.866742 17572 tablet_bootstrap.cc:654] T 65e363b36f0e42009681e88440491c7a P 31ce93f37f4d400c8ce14dd2730b145b: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:31.866765 17246 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 65e363b36f0e42009681e88440491c7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:31.867213 17575 log.cc:824] T 65e363b36f0e42009681e88440491c7a P 7475a224eea040869d6cd27627428175: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:31.867353 17572 log.cc:824] T 65e363b36f0e42009681e88440491c7a P 31ce93f37f4d400c8ce14dd2730b145b: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:31.868148 17572 tablet_bootstrap.cc:492] T 65e363b36f0e42009681e88440491c7a P 31ce93f37f4d400c8ce14dd2730b145b: No bootstrap required, opened a new log
I20260811 08:17:31.868141 17575 tablet_bootstrap.cc:492] T 65e363b36f0e42009681e88440491c7a P 7475a224eea040869d6cd27627428175: No bootstrap required, opened a new log
I20260811 08:17:31.868227 17572 ts_tablet_manager.cc:1397] T 65e363b36f0e42009681e88440491c7a P 31ce93f37f4d400c8ce14dd2730b145b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:17:31.868227 17575 ts_tablet_manager.cc:1397] T 65e363b36f0e42009681e88440491c7a P 7475a224eea040869d6cd27627428175: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:17:31.869897 17578 tablet_bootstrap.cc:492] T 65e363b36f0e42009681e88440491c7a P 0f9e576423144b66b4aeb21c82f24249: Bootstrap starting.
I20260811 08:17:31.870496 17578 tablet_bootstrap.cc:654] T 65e363b36f0e42009681e88440491c7a P 0f9e576423144b66b4aeb21c82f24249: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:31.870390 17575 raft_consensus.cc:348] T 65e363b36f0e42009681e88440491c7a P 7475a224eea040869d6cd27627428175 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ce93f37f4d400c8ce14dd2730b145b" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45181 } } peers { permanent_uuid: "0f9e576423144b66b4aeb21c82f24249" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 45691 } } peers { permanent_uuid: "7475a224eea040869d6cd27627428175" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 43843 } }
I20260811 08:17:31.870390 17572 raft_consensus.cc:348] T 65e363b36f0e42009681e88440491c7a P 31ce93f37f4d400c8ce14dd2730b145b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ce93f37f4d400c8ce14dd2730b145b" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45181 } } peers { permanent_uuid: "0f9e576423144b66b4aeb21c82f24249" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 45691 } } peers { permanent_uuid: "7475a224eea040869d6cd27627428175" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 43843 } }
I20260811 08:17:31.870582 17575 raft_consensus.cc:374] T 65e363b36f0e42009681e88440491c7a P 7475a224eea040869d6cd27627428175 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:31.870617 17572 raft_consensus.cc:374] T 65e363b36f0e42009681e88440491c7a P 31ce93f37f4d400c8ce14dd2730b145b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:31.870631 17575 raft_consensus.cc:729] T 65e363b36f0e42009681e88440491c7a P 7475a224eea040869d6cd27627428175 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7475a224eea040869d6cd27627428175, State: Initialized, Role: FOLLOWER
I20260811 08:17:31.870661 17572 raft_consensus.cc:729] T 65e363b36f0e42009681e88440491c7a P 31ce93f37f4d400c8ce14dd2730b145b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31ce93f37f4d400c8ce14dd2730b145b, State: Initialized, Role: FOLLOWER
I20260811 08:17:31.870775 17575 consensus_queue.cc:260] T 65e363b36f0e42009681e88440491c7a P 7475a224eea040869d6cd27627428175 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ce93f37f4d400c8ce14dd2730b145b" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45181 } } peers { permanent_uuid: "0f9e576423144b66b4aeb21c82f24249" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 45691 } } peers { permanent_uuid: "7475a224eea040869d6cd27627428175" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 43843 } }
I20260811 08:17:31.870775 17572 consensus_queue.cc:260] T 65e363b36f0e42009681e88440491c7a P 31ce93f37f4d400c8ce14dd2730b145b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ce93f37f4d400c8ce14dd2730b145b" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45181 } } peers { permanent_uuid: "0f9e576423144b66b4aeb21c82f24249" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 45691 } } peers { permanent_uuid: "7475a224eea040869d6cd27627428175" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 43843 } }
I20260811 08:17:31.871093 17575 ts_tablet_manager.cc:1428] T 65e363b36f0e42009681e88440491c7a P 7475a224eea040869d6cd27627428175: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:17:31.871088 17572 ts_tablet_manager.cc:1428] T 65e363b36f0e42009681e88440491c7a P 31ce93f37f4d400c8ce14dd2730b145b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:17:31.871114 17578 log.cc:824] T 65e363b36f0e42009681e88440491c7a P 0f9e576423144b66b4aeb21c82f24249: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:31.871232 17128 heartbeater.cc:503] Master 127.20.158.190:37393 was elected leader, sending a full tablet report...
I20260811 08:17:31.871544 17546 heartbeater.cc:503] Master 127.20.158.190:37393 was elected leader, sending a full tablet report...
I20260811 08:17:31.872231 17578 tablet_bootstrap.cc:492] T 65e363b36f0e42009681e88440491c7a P 0f9e576423144b66b4aeb21c82f24249: No bootstrap required, opened a new log
I20260811 08:17:31.872316 17578 ts_tablet_manager.cc:1397] T 65e363b36f0e42009681e88440491c7a P 0f9e576423144b66b4aeb21c82f24249: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:17:31.874001 17578 raft_consensus.cc:348] T 65e363b36f0e42009681e88440491c7a P 0f9e576423144b66b4aeb21c82f24249 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ce93f37f4d400c8ce14dd2730b145b" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45181 } } peers { permanent_uuid: "0f9e576423144b66b4aeb21c82f24249" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 45691 } } peers { permanent_uuid: "7475a224eea040869d6cd27627428175" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 43843 } }
I20260811 08:17:31.874136 17578 raft_consensus.cc:374] T 65e363b36f0e42009681e88440491c7a P 0f9e576423144b66b4aeb21c82f24249 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:31.874186 17578 raft_consensus.cc:729] T 65e363b36f0e42009681e88440491c7a P 0f9e576423144b66b4aeb21c82f24249 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f9e576423144b66b4aeb21c82f24249, State: Initialized, Role: FOLLOWER
I20260811 08:17:31.874320 17578 consensus_queue.cc:260] T 65e363b36f0e42009681e88440491c7a P 0f9e576423144b66b4aeb21c82f24249 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ce93f37f4d400c8ce14dd2730b145b" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45181 } } peers { permanent_uuid: "0f9e576423144b66b4aeb21c82f24249" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 45691 } } peers { permanent_uuid: "7475a224eea040869d6cd27627428175" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 43843 } }
I20260811 08:17:31.874599 17578 ts_tablet_manager.cc:1428] T 65e363b36f0e42009681e88440491c7a P 0f9e576423144b66b4aeb21c82f24249: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:17:31.874631 17338 heartbeater.cc:503] Master 127.20.158.190:37393 was elected leader, sending a full tablet report...
W20260811 08:17:31.911972 17339 tablet.cc:2369] T 65e363b36f0e42009681e88440491c7a P 0f9e576423144b66b4aeb21c82f24249: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:17:31.915297 17581 raft_consensus.cc:482] T 65e363b36f0e42009681e88440491c7a P 31ce93f37f4d400c8ce14dd2730b145b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:17:31.915405 17581 raft_consensus.cc:504] T 65e363b36f0e42009681e88440491c7a P 31ce93f37f4d400c8ce14dd2730b145b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ce93f37f4d400c8ce14dd2730b145b" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45181 } } peers { permanent_uuid: "0f9e576423144b66b4aeb21c82f24249" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 45691 } } peers { permanent_uuid: "7475a224eea040869d6cd27627428175" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 43843 } }
I20260811 08:17:31.915855 17581 leader_election.cc:288] T 65e363b36f0e42009681e88440491c7a P 31ce93f37f4d400c8ce14dd2730b145b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0f9e576423144b66b4aeb21c82f24249 (127.20.158.130:45691), 7475a224eea040869d6cd27627428175 (127.20.158.131:43843)
I20260811 08:17:31.919785 17569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:31.916150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:58069 (local address 127.20.158.130:45691)
0811 08:17:31.916208 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:31.916210 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:31.916222 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:17:31.916321 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:31.916322 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:31.916333 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:31.916392 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:31.916577 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.917372 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.918785 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.919392 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.919476 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:31.919487 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:31.919682 (+ 195us) server_negotiation.cc:299] Negotiation successful
0811 08:17:31.919721 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 08:17:31.919785 17566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:31.916224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:33201 (local address 127.20.158.131:43843)
0811 08:17:31.916276 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:31.916278 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:31.916506 (+ 228us) server_negotiation.cc:407] Connection header received
0811 08:17:31.916548 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:31.916549 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:31.916560 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:31.916613 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:31.916765 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.917469 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.918851 (+ 1382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.919439 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.919505 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:31.919514 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:31.919672 (+ 158us) server_negotiation.cc:299] Negotiation successful
0811 08:17:31.919716 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:17:31.919787 17131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:31.916067 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:45691 (local address 127.20.158.129:58069)
0811 08:17:31.916162 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:31.916174 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:31.916225 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:31.916414 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:31.916416 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:31.916418 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:31.916495 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:31.916497 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.917450 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.917451 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:31.918696 (+ 1245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:31.918700 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.919497 (+ 797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.919498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:31.919578 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:31.919580 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:17:31.919642 (+ 62us) client_negotiation.cc:240] Negotiation successful
0811 08:17:31.919695 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":72,"mutex_wait_us":30}
I20260811 08:17:31.919795 17591 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:31.916070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:43843 (local address 127.20.158.129:33201)
0811 08:17:31.916406 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:31.916416 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:31.916476 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:31.916641 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:31.916642 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:31.916643 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:31.916695 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:31.916696 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.917550 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.917550 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:31.918770 (+ 1220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:31.918772 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.919513 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.919513 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:31.919576 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:31.919580 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:17:31.919654 (+ 74us) client_negotiation.cc:240] Negotiation successful
0811 08:17:31.919695 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":314,"mutex_wait_us":97,"thread_start_us":150,"threads_started":1}
I20260811 08:17:31.920249 17277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65e363b36f0e42009681e88440491c7a" candidate_uuid: "31ce93f37f4d400c8ce14dd2730b145b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f9e576423144b66b4aeb21c82f24249" is_pre_election: true
I20260811 08:17:31.920455 17277 raft_consensus.cc:2454] T 65e363b36f0e42009681e88440491c7a P 0f9e576423144b66b4aeb21c82f24249 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ce93f37f4d400c8ce14dd2730b145b in term 0.
I20260811 08:17:31.920421 17477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65e363b36f0e42009681e88440491c7a" candidate_uuid: "31ce93f37f4d400c8ce14dd2730b145b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7475a224eea040869d6cd27627428175" is_pre_election: true
I20260811 08:17:31.920550 17477 raft_consensus.cc:2454] T 65e363b36f0e42009681e88440491c7a P 7475a224eea040869d6cd27627428175 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31ce93f37f4d400c8ce14dd2730b145b in term 0.
I20260811 08:17:31.920720 16954 leader_election.cc:302] T 65e363b36f0e42009681e88440491c7a P 31ce93f37f4d400c8ce14dd2730b145b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f9e576423144b66b4aeb21c82f24249, 31ce93f37f4d400c8ce14dd2730b145b; no voters:
I20260811 08:17:31.920902 17581 raft_consensus.cc:2781] T 65e363b36f0e42009681e88440491c7a P 31ce93f37f4d400c8ce14dd2730b145b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:17:31.920965 17581 raft_consensus.cc:482] T 65e363b36f0e42009681e88440491c7a P 31ce93f37f4d400c8ce14dd2730b145b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:17:31.920989 17581 raft_consensus.cc:3037] T 65e363b36f0e42009681e88440491c7a P 31ce93f37f4d400c8ce14dd2730b145b [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:31.921784 17581 raft_consensus.cc:504] T 65e363b36f0e42009681e88440491c7a P 31ce93f37f4d400c8ce14dd2730b145b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ce93f37f4d400c8ce14dd2730b145b" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45181 } } peers { permanent_uuid: "0f9e576423144b66b4aeb21c82f24249" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 45691 } } peers { permanent_uuid: "7475a224eea040869d6cd27627428175" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 43843 } }
I20260811 08:17:31.921948 17581 leader_election.cc:288] T 65e363b36f0e42009681e88440491c7a P 31ce93f37f4d400c8ce14dd2730b145b [CANDIDATE]: Term 1 election: Requested vote from peers 0f9e576423144b66b4aeb21c82f24249 (127.20.158.130:45691), 7475a224eea040869d6cd27627428175 (127.20.158.131:43843)
I20260811 08:17:31.922099 17277 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65e363b36f0e42009681e88440491c7a" candidate_uuid: "31ce93f37f4d400c8ce14dd2730b145b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0f9e576423144b66b4aeb21c82f24249"
I20260811 08:17:31.922163 17477 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65e363b36f0e42009681e88440491c7a" candidate_uuid: "31ce93f37f4d400c8ce14dd2730b145b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7475a224eea040869d6cd27627428175"
I20260811 08:17:31.922228 17477 raft_consensus.cc:3037] T 65e363b36f0e42009681e88440491c7a P 7475a224eea040869d6cd27627428175 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:31.922230 17277 raft_consensus.cc:3037] T 65e363b36f0e42009681e88440491c7a P 0f9e576423144b66b4aeb21c82f24249 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:31.923151 17477 raft_consensus.cc:2454] T 65e363b36f0e42009681e88440491c7a P 7475a224eea040869d6cd27627428175 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ce93f37f4d400c8ce14dd2730b145b in term 1.
I20260811 08:17:31.923161 17277 raft_consensus.cc:2454] T 65e363b36f0e42009681e88440491c7a P 0f9e576423144b66b4aeb21c82f24249 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31ce93f37f4d400c8ce14dd2730b145b in term 1.
I20260811 08:17:31.923326 16954 leader_election.cc:302] T 65e363b36f0e42009681e88440491c7a P 31ce93f37f4d400c8ce14dd2730b145b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0f9e576423144b66b4aeb21c82f24249, 31ce93f37f4d400c8ce14dd2730b145b; no voters:
I20260811 08:17:31.923424 17581 raft_consensus.cc:2781] T 65e363b36f0e42009681e88440491c7a P 31ce93f37f4d400c8ce14dd2730b145b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:17:31.923590 17581 raft_consensus.cc:686] T 65e363b36f0e42009681e88440491c7a P 31ce93f37f4d400c8ce14dd2730b145b [term 1 LEADER]: Becoming Leader. State: Replica: 31ce93f37f4d400c8ce14dd2730b145b, State: Running, Role: LEADER
I20260811 08:17:31.923703 17581 consensus_queue.cc:237] T 65e363b36f0e42009681e88440491c7a P 31ce93f37f4d400c8ce14dd2730b145b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ce93f37f4d400c8ce14dd2730b145b" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45181 } } peers { permanent_uuid: "0f9e576423144b66b4aeb21c82f24249" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 45691 } } peers { permanent_uuid: "7475a224eea040869d6cd27627428175" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 43843 } }
I20260811 08:17:31.924650 16835 catalog_manager.cc:5495] T 65e363b36f0e42009681e88440491c7a P 31ce93f37f4d400c8ce14dd2730b145b reported cstate change: term changed from 0 to 1, leader changed from <none> to 31ce93f37f4d400c8ce14dd2730b145b (127.20.158.129). New cstate: current_term: 1 leader_uuid: "31ce93f37f4d400c8ce14dd2730b145b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31ce93f37f4d400c8ce14dd2730b145b" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 45181 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0f9e576423144b66b4aeb21c82f24249" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 45691 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7475a224eea040869d6cd27627428175" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 43843 } health_report { overall_health: UNKNOWN } } }
I20260811 08:17:31.938068 17565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:31.935614 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43252 (local address 127.20.158.129:45181)
0811 08:17:31.935679 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:31.935681 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:31.935689 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:17:31.935730 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:31.935731 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:31.935747 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:31.935823 (+ 76us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:17:31.935989 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.936464 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.937247 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:31.937443 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:31.937555 (+ 112us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:31.937702 (+ 147us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:17:31.937803 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:17:31.937919 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:31.937958 (+ 39us) server_negotiation.cc:299] Negotiation successful
0811 08:17:31.937970 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260811 08:17:31.940121 17477 raft_consensus.cc:1261] T 65e363b36f0e42009681e88440491c7a P 7475a224eea040869d6cd27627428175 [term 1 FOLLOWER]: Refusing update from remote peer 31ce93f37f4d400c8ce14dd2730b145b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:17:31.940132 17277 raft_consensus.cc:1261] T 65e363b36f0e42009681e88440491c7a P 0f9e576423144b66b4aeb21c82f24249 [term 1 FOLLOWER]: Refusing update from remote peer 31ce93f37f4d400c8ce14dd2730b145b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:17:31.940539 17592 consensus_queue.cc:1035] T 65e363b36f0e42009681e88440491c7a P 31ce93f37f4d400c8ce14dd2730b145b [LEADER]: Connected to new peer: Peer: permanent_uuid: "0f9e576423144b66b4aeb21c82f24249" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 45691 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:17:31.940747 17581 consensus_queue.cc:1035] T 65e363b36f0e42009681e88440491c7a P 31ce93f37f4d400c8ce14dd2730b145b [LEADER]: Connected to new peer: Peer: permanent_uuid: "7475a224eea040869d6cd27627428175" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 43843 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:17:31.943970 17597 mvcc.cc:205] Tried to move back new op lower bound from 7317242887943225344 to 7317242887880118272. Current Snapshot: MvccSnapshot[applied={T|T < 7317242887943225344}]
I20260811 08:17:31.944675 17595 mvcc.cc:205] Tried to move back new op lower bound from 7317242887943225344 to 7317242887880118272. Current Snapshot: MvccSnapshot[applied={T|T < 7317242887943225344 or (T in {7317242887943225344})}]
I20260811 08:17:31.945923 16835 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45110:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:17:31.946022 16835 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:45110:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:17:31.946854 16835 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 16777be0f09145cba5dc0e1b7efdad6a: Sending DeleteTablet for 3 replicas of tablet 65e363b36f0e42009681e88440491c7a
I20260811 08:17:31.947258 17246 tablet_service.cc:1514] Processing DeleteTablet for tablet 65e363b36f0e42009681e88440491c7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:17:31 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:49062
I20260811 08:17:31.947257 17449 tablet_service.cc:1514] Processing DeleteTablet for tablet 65e363b36f0e42009681e88440491c7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:17:31 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:59858
I20260811 08:17:31.947516 17612 tablet_replica.cc:330] T 65e363b36f0e42009681e88440491c7a P 0f9e576423144b66b4aeb21c82f24249: stopping tablet replica
I20260811 08:17:31.947647 17029 tablet_service.cc:1514] Processing DeleteTablet for tablet 65e363b36f0e42009681e88440491c7a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:17:31 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:43242
I20260811 08:17:31.947685 17612 raft_consensus.cc:2229] T 65e363b36f0e42009681e88440491c7a P 0f9e576423144b66b4aeb21c82f24249 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:17:31.947816 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 16930
I20260811 08:17:31.947896 17612 raft_consensus.cc:2258] T 65e363b36f0e42009681e88440491c7a P 0f9e576423144b66b4aeb21c82f24249 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:17:31.950686 17611 tablet_replica.cc:330] T 65e363b36f0e42009681e88440491c7a P 7475a224eea040869d6cd27627428175: stopping tablet replica
I20260811 08:17:31.950793 17611 raft_consensus.cc:2229] T 65e363b36f0e42009681e88440491c7a P 7475a224eea040869d6cd27627428175 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:17:31.950897 17611 raft_consensus.cc:2258] T 65e363b36f0e42009681e88440491c7a P 7475a224eea040869d6cd27627428175 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:17:31.950968 17612 ts_tablet_manager.cc:1905] T 65e363b36f0e42009681e88440491c7a P 0f9e576423144b66b4aeb21c82f24249: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:17:31.951572 17611 ts_tablet_manager.cc:1905] T 65e363b36f0e42009681e88440491c7a P 7475a224eea040869d6cd27627428175: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:17:31.952876 17612 ts_tablet_manager.cc:1918] T 65e363b36f0e42009681e88440491c7a P 0f9e576423144b66b4aeb21c82f24249: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:17:31.952962 17612 log.cc:1196] T 65e363b36f0e42009681e88440491c7a P 0f9e576423144b66b4aeb21c82f24249: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-1/wal/wals/65e363b36f0e42009681e88440491c7a
I20260811 08:17:31.953246 17612 ts_tablet_manager.cc:1939] T 65e363b36f0e42009681e88440491c7a P 0f9e576423144b66b4aeb21c82f24249: Deleting consensus metadata
I20260811 08:17:31.953735 17611 ts_tablet_manager.cc:1918] T 65e363b36f0e42009681e88440491c7a P 7475a224eea040869d6cd27627428175: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:17:31.953830 17611 log.cc:1196] T 65e363b36f0e42009681e88440491c7a P 7475a224eea040869d6cd27627428175: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786436003833085-21114-0/minicluster-data/ts-2/wal/wals/65e363b36f0e42009681e88440491c7a
I20260811 08:17:31.953826 16812 catalog_manager.cc:4841] TS 0f9e576423144b66b4aeb21c82f24249 (127.20.158.130:45691): tablet 65e363b36f0e42009681e88440491c7a (table test-table [id=fd1dfb3602d04d668ac0a4627e49157a]) successfully deleted
I20260811 08:17:31.954123 17611 ts_tablet_manager.cc:1939] T 65e363b36f0e42009681e88440491c7a P 7475a224eea040869d6cd27627428175: Deleting consensus metadata
I20260811 08:17:31.954532 16819 catalog_manager.cc:4841] TS 7475a224eea040869d6cd27627428175 (127.20.158.131:43843): tablet 65e363b36f0e42009681e88440491c7a (table test-table [id=fd1dfb3602d04d668ac0a4627e49157a]) successfully deleted
W20260811 08:17:31.957585 16812 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.158.129:45181 (error 108)
I20260811 08:17:31.958146 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 17141
I20260811 08:17:31.958194 17563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:31.958038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:45181 (local address 127.0.0.1:43260)
0811 08:17:31.958123 (+ 85us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:31.958162 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.129:45181: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260811 08:17:31.965463 16812 catalog_manager.cc:4584] TS 31ce93f37f4d400c8ce14dd2730b145b (127.20.158.129:45181): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 65e363b36f0e42009681e88440491c7a: Network error: Client connection negotiation failed: client connection to 127.20.158.129:45181: connect: Connection refused (error 111)
I20260811 08:17:31.976436 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 17353
I20260811 08:17:31.994482 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 16795
2026-08-11T08:17:32Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2238 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-11T08:17:32Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:17:32Z Disabled control of system clock
I20260811 08:17:32.031339 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:37749
--webserver_interface=127.20.158.190
--webserver_port=0
--builtin_ntp_servers=127.20.158.148:44547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:37749
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 08:17:32.120689 17622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:32.120929 17622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:32.120952 17622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:32.122280 17622 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:17:32.122335 17622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:32.122349 17622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:32.122361 17622 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:17:32.122373 17622 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:17:32.123796 17622 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:44547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:37749
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:37749
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17622
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:32.124084 17622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:32.124423 17622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:32.129487 17628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:32.129494 17630 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:32.129664 17622 server_base.cc:1034] running on GCE node
W20260811 08:17:32.129683 17627 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:32.130169 17622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:32.130486 17622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:32.131680 17622 hybrid_clock.cc:648] HybridClock initialized: now 1786436252131663 us; error 33 us; skew 500 ppm
I20260811 08:17:32.133095 17622 webserver.cc:460] Webserver started at http://127.20.158.190:44941/ using document root <none> and password file <none>
I20260811 08:17:32.133392 17622 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:32.133468 17622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:32.133669 17622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:32.134806 17622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "c853b5c0bee64d01adc6f663daf222be"
format_stamp: "Formatted at 2026-08-11 08:17:32 on dist-test-slave-gkw7"
server_key: "c49ee449ea3eab1fc12560fb5dce2dee"
server_key_iv: "fd6971265ac2a73e911ac564a8bf22f1"
server_key_version: "encryptionkey@0"
I20260811 08:17:32.135202 17622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "c853b5c0bee64d01adc6f663daf222be"
format_stamp: "Formatted at 2026-08-11 08:17:32 on dist-test-slave-gkw7"
server_key: "c49ee449ea3eab1fc12560fb5dce2dee"
server_key_iv: "fd6971265ac2a73e911ac564a8bf22f1"
server_key_version: "encryptionkey@0"
I20260811 08:17:32.136655 17622 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:17:32.137868 17638 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:32.138085 17622 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:17:32.138244 17622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "c853b5c0bee64d01adc6f663daf222be"
format_stamp: "Formatted at 2026-08-11 08:17:32 on dist-test-slave-gkw7"
server_key: "c49ee449ea3eab1fc12560fb5dce2dee"
server_key_iv: "fd6971265ac2a73e911ac564a8bf22f1"
server_key_version: "encryptionkey@0"
I20260811 08:17:32.138331 17622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:32.154335 17622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:32.154703 17622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:32.154870 17622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:32.159207 17622 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:37749
I20260811 08:17:32.159250 17716 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:37749 every 8 connection(s)
I20260811 08:17:32.159642 17622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:17:32.160732 17718 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:32.164307 17718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c853b5c0bee64d01adc6f663daf222be: Bootstrap starting.
I20260811 08:17:32.164947 17718 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c853b5c0bee64d01adc6f663daf222be: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:32.165261 17718 log.cc:824] T 00000000000000000000000000000000 P c853b5c0bee64d01adc6f663daf222be: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:32.166043 17718 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c853b5c0bee64d01adc6f663daf222be: No bootstrap required, opened a new log
I20260811 08:17:32.166790 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 17622
I20260811 08:17:32.166882 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:17:32.167104 21114 external_mini_cluster.cc:1428] Setting key eeb4ce63c0148135eb0f4ad177e407c4
I20260811 08:17:32.168329 17718 raft_consensus.cc:348] T 00000000000000000000000000000000 P c853b5c0bee64d01adc6f663daf222be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c853b5c0bee64d01adc6f663daf222be" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37749 } }
I20260811 08:17:32.168503 17718 raft_consensus.cc:374] T 00000000000000000000000000000000 P c853b5c0bee64d01adc6f663daf222be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:32.168542 17718 raft_consensus.cc:729] T 00000000000000000000000000000000 P c853b5c0bee64d01adc6f663daf222be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c853b5c0bee64d01adc6f663daf222be, State: Initialized, Role: FOLLOWER
I20260811 08:17:32.168716 17718 consensus_queue.cc:260] T 00000000000000000000000000000000 P c853b5c0bee64d01adc6f663daf222be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c853b5c0bee64d01adc6f663daf222be" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37749 } }
I20260811 08:17:32.168807 17718 raft_consensus.cc:388] T 00000000000000000000000000000000 P c853b5c0bee64d01adc6f663daf222be [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:17:32.168843 17718 raft_consensus.cc:482] T 00000000000000000000000000000000 P c853b5c0bee64d01adc6f663daf222be [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:17:32.168895 17718 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c853b5c0bee64d01adc6f663daf222be [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:32.169657 17718 raft_consensus.cc:504] T 00000000000000000000000000000000 P c853b5c0bee64d01adc6f663daf222be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c853b5c0bee64d01adc6f663daf222be" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37749 } }
I20260811 08:17:32.169778 17718 leader_election.cc:302] T 00000000000000000000000000000000 P c853b5c0bee64d01adc6f663daf222be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c853b5c0bee64d01adc6f663daf222be; no voters:
I20260811 08:17:32.169945 17718 leader_election.cc:288] T 00000000000000000000000000000000 P c853b5c0bee64d01adc6f663daf222be [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:17:32.170007 17723 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c853b5c0bee64d01adc6f663daf222be [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:17:32.170192 17723 raft_consensus.cc:686] T 00000000000000000000000000000000 P c853b5c0bee64d01adc6f663daf222be [term 1 LEADER]: Becoming Leader. State: Replica: c853b5c0bee64d01adc6f663daf222be, State: Running, Role: LEADER
I20260811 08:17:32.170194 17718 sys_catalog.cc:564] T 00000000000000000000000000000000 P c853b5c0bee64d01adc6f663daf222be [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:17:32.170326 17723 consensus_queue.cc:237] T 00000000000000000000000000000000 P c853b5c0bee64d01adc6f663daf222be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c853b5c0bee64d01adc6f663daf222be" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37749 } }
I20260811 08:17:32.170866 17723 sys_catalog.cc:455] T 00000000000000000000000000000000 P c853b5c0bee64d01adc6f663daf222be [sys.catalog]: SysCatalogTable state changed. Reason: New leader c853b5c0bee64d01adc6f663daf222be. Latest consensus state: current_term: 1 leader_uuid: "c853b5c0bee64d01adc6f663daf222be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c853b5c0bee64d01adc6f663daf222be" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37749 } } }
I20260811 08:17:32.170945 17723 sys_catalog.cc:458] T 00000000000000000000000000000000 P c853b5c0bee64d01adc6f663daf222be [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:32.171290 17724 sys_catalog.cc:455] T 00000000000000000000000000000000 P c853b5c0bee64d01adc6f663daf222be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c853b5c0bee64d01adc6f663daf222be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c853b5c0bee64d01adc6f663daf222be" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37749 } } }
I20260811 08:17:32.171370 17724 sys_catalog.cc:458] T 00000000000000000000000000000000 P c853b5c0bee64d01adc6f663daf222be [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:32.171495 17735 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:17:32.172399 17735 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:17:32.174043 17735 catalog_manager.cc:1347] Generated new cluster ID: f9792de396db467987536890830bc4e8
I20260811 08:17:32.174115 17735 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:17:32.174252 17722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:32.167691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42690 (local address 127.20.158.190:37749)
0811 08:17:32.167976 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:32.167987 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:32.168026 (+ 39us) server_negotiation.cc:407] Connection header received
0811 08:17:32.168279 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:32.168288 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:32.168372 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:32.168528 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:32.168752 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.170606 (+ 1854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.171855 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.172405 (+ 550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.172550 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:32.173313 (+ 763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:32.173317 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:32.173318 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:32.173581 (+ 263us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:32.173628 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:32.173644 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:32.173714 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:32.173814 (+ 100us) server_negotiation.cc:299] Negotiation successful
0811 08:17:32.173998 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":112,"threads_started":1}
I20260811 08:17:32.180009 17735 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:17:32.180717 17735 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:17:32.201916 17735 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c853b5c0bee64d01adc6f663daf222be: Generated new TSK 0
I20260811 08:17:32.202165 17735 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:17:32.207718 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:0
--local_ip_for_outbound_sockets=127.20.158.129
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:37749
--builtin_ntp_servers=127.20.158.148:44547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 08:17:32.292426 17751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:32.292640 17751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:32.292665 17751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:32.293879 17751 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:32.293917 17751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:32.293942 17751 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:17:32.295320 17751 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:44547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:37749
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17751
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:32.295574 17751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:32.295910 17751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:32.302349 17760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:32.302373 17759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:32.302660 17762 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:32.302672 17751 server_base.cc:1034] running on GCE node
I20260811 08:17:32.302932 17751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:32.303213 17751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:32.304391 17751 hybrid_clock.cc:648] HybridClock initialized: now 1786436252304368 us; error 37 us; skew 500 ppm
I20260811 08:17:32.305835 17751 webserver.cc:460] Webserver started at http://127.20.158.129:38963/ using document root <none> and password file <none>
I20260811 08:17:32.306124 17751 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:32.306203 17751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:32.306380 17751 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:32.307485 17751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-0/data/instance:
uuid: "b5ea9b7fccc7475ab0e5ae81970bb0a9"
format_stamp: "Formatted at 2026-08-11 08:17:32 on dist-test-slave-gkw7"
server_key: "a2dcbc1fc72cc15e000bb5e161397c59"
server_key_iv: "c34885914d656923aef7bec1c146c76d"
server_key_version: "encryptionkey@0"
I20260811 08:17:32.307889 17751 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance:
uuid: "b5ea9b7fccc7475ab0e5ae81970bb0a9"
format_stamp: "Formatted at 2026-08-11 08:17:32 on dist-test-slave-gkw7"
server_key: "a2dcbc1fc72cc15e000bb5e161397c59"
server_key_iv: "c34885914d656923aef7bec1c146c76d"
server_key_version: "encryptionkey@0"
I20260811 08:17:32.309324 17751 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:17:32.310200 17771 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:32.310374 17751 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:17:32.310480 17751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "b5ea9b7fccc7475ab0e5ae81970bb0a9"
format_stamp: "Formatted at 2026-08-11 08:17:32 on dist-test-slave-gkw7"
server_key: "a2dcbc1fc72cc15e000bb5e161397c59"
server_key_iv: "c34885914d656923aef7bec1c146c76d"
server_key_version: "encryptionkey@0"
I20260811 08:17:32.310570 17751 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:32.324118 17751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:32.324448 17751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:32.324616 17751 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:32.324854 17751 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:17:32.325191 17751 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:17:32.325248 17751 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:32.325294 17751 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:17:32.325322 17751 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:32.331492 17751 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:38473
I20260811 08:17:32.331544 17943 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:38473 every 8 connection(s)
I20260811 08:17:32.331887 17751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:17:32.334187 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 17751
I20260811 08:17:32.334306 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance
I20260811 08:17:32.334494 21114 external_mini_cluster.cc:1428] Setting key 88f69635ed06eb742a219fcb4b135673
I20260811 08:17:32.335570 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:0
--local_ip_for_outbound_sockets=127.20.158.130
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:37749
--builtin_ntp_servers=127.20.158.148:44547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 08:17:32.338443 17722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:32.332690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:48569 (local address 127.20.158.190:37749)
0811 08:17:32.332761 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:32.332763 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:32.332998 (+ 235us) server_negotiation.cc:407] Connection header received
0811 08:17:32.333624 (+ 626us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:32.333625 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:32.333639 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:32.333704 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:32.334435 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.335075 (+ 640us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.336671 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.336864 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.336925 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:32.338055 (+ 1130us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:32.338057 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:32.338057 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:32.338064 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:32.338084 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:32.338090 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:32.338171 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:32.338279 (+ 108us) server_negotiation.cc:299] Negotiation successful
0811 08:17:32.338317 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 08:17:32.338500 17947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:32.332693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:37749 (local address 127.20.158.129:48569)
0811 08:17:32.332873 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:32.332911 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:32.333477 (+ 566us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:32.333782 (+ 305us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:32.333786 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:32.333794 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:17:32.334345 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:32.334353 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.335271 (+ 918us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.335273 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:32.336560 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:32.336564 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.336958 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.336959 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:32.337131 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:32.337897 (+ 766us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:17:32.337898 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:17:32.337927 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:17:32.337951 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:17:32.338189 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:17:32.338194 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:17:32.338197 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:17:32.338252 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 08:17:32.338338 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":72,"threads_started":1}
I20260811 08:17:32.339114 17945 heartbeater.cc:347] Connected to a master server at 127.20.158.190:37749
I20260811 08:17:32.339221 17945 heartbeater.cc:464] Registering TS with master...
I20260811 08:17:32.339432 17945 heartbeater.cc:511] Master 127.20.158.190:37749 requested a full tablet report, sending...
I20260811 08:17:32.340003 17666 ts_manager.cc:194] Registered new tserver with Master: b5ea9b7fccc7475ab0e5ae81970bb0a9 (127.20.158.129:38473)
I20260811 08:17:32.340709 17666 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.158.129:48569
W20260811 08:17:32.421058 17948 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:32.421279 17948 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:32.421301 17948 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:32.422592 17948 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:32.422636 17948 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:32.422664 17948 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:17:32.424039 17948 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:44547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:37749
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.17948
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:32.424320 17948 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:32.424630 17948 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:32.429792 17956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:32.429791 17959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:32.429802 17955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:32.430266 17948 server_base.cc:1034] running on GCE node
I20260811 08:17:32.430486 17948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:32.430730 17948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:32.431887 17948 hybrid_clock.cc:648] HybridClock initialized: now 1786436252431855 us; error 54 us; skew 500 ppm
I20260811 08:17:32.433234 17948 webserver.cc:460] Webserver started at http://127.20.158.130:39165/ using document root <none> and password file <none>
I20260811 08:17:32.433488 17948 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:32.433598 17948 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:32.433748 17948 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:32.434849 17948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-1/data/instance:
uuid: "8e6f2cb292d34bada3c2e6a6f99b903f"
format_stamp: "Formatted at 2026-08-11 08:17:32 on dist-test-slave-gkw7"
server_key: "c172a48e846ae68cfef12c97493d7a44"
server_key_iv: "c92f28a4eedd3d91247fad8ea23a74df"
server_key_version: "encryptionkey@0"
I20260811 08:17:32.435231 17948 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance:
uuid: "8e6f2cb292d34bada3c2e6a6f99b903f"
format_stamp: "Formatted at 2026-08-11 08:17:32 on dist-test-slave-gkw7"
server_key: "c172a48e846ae68cfef12c97493d7a44"
server_key_iv: "c92f28a4eedd3d91247fad8ea23a74df"
server_key_version: "encryptionkey@0"
I20260811 08:17:32.436657 17948 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:17:32.437517 17967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:32.437803 17948 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:17:32.437908 17948 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "8e6f2cb292d34bada3c2e6a6f99b903f"
format_stamp: "Formatted at 2026-08-11 08:17:32 on dist-test-slave-gkw7"
server_key: "c172a48e846ae68cfef12c97493d7a44"
server_key_iv: "c92f28a4eedd3d91247fad8ea23a74df"
server_key_version: "encryptionkey@0"
I20260811 08:17:32.437999 17948 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:32.448654 17948 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:32.448949 17948 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:32.449101 17948 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:32.449333 17948 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:17:32.449733 17948 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:17:32.449790 17948 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:32.449828 17948 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:17:32.449855 17948 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:32.455956 17948 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:38439
I20260811 08:17:32.456008 18143 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:38439 every 8 connection(s)
I20260811 08:17:32.456373 17948 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
I20260811 08:17:32.461786 17722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:32.457200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:46729 (local address 127.20.158.190:37749)
0811 08:17:32.457273 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:32.457276 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:32.457590 (+ 314us) server_negotiation.cc:407] Connection header received
0811 08:17:32.458059 (+ 469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:32.458061 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:32.458072 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:32.458154 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:32.458838 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.459417 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.460362 (+ 945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.460572 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.460634 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:32.461428 (+ 794us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:32.461430 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:32.461430 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:32.461435 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:32.461450 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:32.461455 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:32.461506 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:32.461689 (+ 183us) server_negotiation.cc:299] Negotiation successful
0811 08:17:32.461722 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 08:17:32.461952 18149 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:32.457188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:37749 (local address 127.20.158.130:46729)
0811 08:17:32.457387 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:32.457428 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:32.457952 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:32.458214 (+ 262us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:32.458218 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:32.458226 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:17:32.458725 (+ 499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:32.458729 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.459504 (+ 775us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.459505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:32.460285 (+ 780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:32.460286 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.460662 (+ 376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.460663 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:32.460778 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:32.461278 (+ 500us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:17:32.461279 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:17:32.461307 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:17:32.461330 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:17:32.461516 (+ 186us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:17:32.461521 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:17:32.461523 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:17:32.461636 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 08:17:32.461730 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":94,"threads_started":1}
I20260811 08:17:32.462484 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 17948
I20260811 08:17:32.462515 18145 heartbeater.cc:347] Connected to a master server at 127.20.158.190:37749
I20260811 08:17:32.462623 18145 heartbeater.cc:464] Registering TS with master...
I20260811 08:17:32.462632 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance
I20260811 08:17:32.462858 18145 heartbeater.cc:511] Master 127.20.158.190:37749 requested a full tablet report, sending...
I20260811 08:17:32.462885 21114 external_mini_cluster.cc:1428] Setting key eb588ea4ae40cca6d4db06bd6317506e
I20260811 08:17:32.463339 17666 ts_manager.cc:194] Registered new tserver with Master: 8e6f2cb292d34bada3c2e6a6f99b903f (127.20.158.130:38439)
I20260811 08:17:32.463809 17666 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.158.130:46729
I20260811 08:17:32.464159 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:0
--local_ip_for_outbound_sockets=127.20.158.131
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:37749
--builtin_ntp_servers=127.20.158.148:44547
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 08:17:32.565217 18150 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:32.565423 18150 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:32.565445 18150 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:32.566605 18150 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:32.566650 18150 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:32.566675 18150 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:17:32.568050 18150 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:44547
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:37749
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18150
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:32.568264 18150 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:32.568522 18150 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:32.574049 18157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:32.574087 18162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:32.574302 18150 server_base.cc:1034] running on GCE node
W20260811 08:17:32.574420 18158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:32.574666 18150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:32.574889 18150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:32.576082 18150 hybrid_clock.cc:648] HybridClock initialized: now 1786436252576074 us; error 38 us; skew 500 ppm
I20260811 08:17:32.577502 18150 webserver.cc:460] Webserver started at http://127.20.158.131:39635/ using document root <none> and password file <none>
I20260811 08:17:32.577804 18150 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:32.577878 18150 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:32.578033 18150 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:32.579185 18150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-2/data/instance:
uuid: "90088b688b464070984debf195b9b73a"
format_stamp: "Formatted at 2026-08-11 08:17:32 on dist-test-slave-gkw7"
server_key: "59bdfab4d51c211a27ccfce7d92c3f38"
server_key_iv: "44b4167e56d429b124104a4c473a926b"
server_key_version: "encryptionkey@0"
I20260811 08:17:32.579564 18150 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance:
uuid: "90088b688b464070984debf195b9b73a"
format_stamp: "Formatted at 2026-08-11 08:17:32 on dist-test-slave-gkw7"
server_key: "59bdfab4d51c211a27ccfce7d92c3f38"
server_key_iv: "44b4167e56d429b124104a4c473a926b"
server_key_version: "encryptionkey@0"
I20260811 08:17:32.580940 18150 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:17:32.581749 18174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:32.581939 18150 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:17:32.582051 18150 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "90088b688b464070984debf195b9b73a"
format_stamp: "Formatted at 2026-08-11 08:17:32 on dist-test-slave-gkw7"
server_key: "59bdfab4d51c211a27ccfce7d92c3f38"
server_key_iv: "44b4167e56d429b124104a4c473a926b"
server_key_version: "encryptionkey@0"
I20260811 08:17:32.582129 18150 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:32.591316 18150 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:32.591635 18150 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:32.591809 18150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:32.592042 18150 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:17:32.592396 18150 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:17:32.592453 18150 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:32.592495 18150 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:17:32.592523 18150 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:32.598603 18150 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:38085
I20260811 08:17:32.598654 18362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:38085 every 8 connection(s)
I20260811 08:17:32.599007 18150 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
I20260811 08:17:32.601624 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 18150
I20260811 08:17:32.601734 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance
I20260811 08:17:32.601984 21114 external_mini_cluster.cc:1428] Setting key 7397d09eff360b300de6d6cdf3061512
I20260811 08:17:32.604688 17722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:32.599819 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:40205 (local address 127.20.158.190:37749)
0811 08:17:32.599872 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:32.599874 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:32.600118 (+ 244us) server_negotiation.cc:407] Connection header received
0811 08:17:32.600582 (+ 464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:32.600583 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:32.600594 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:32.600646 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:32.601437 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.602264 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.603469 (+ 1205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.603659 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.603716 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:32.604478 (+ 762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:32.604479 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:32.604479 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:32.604484 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:32.604498 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:32.604502 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:32.604550 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:32.604601 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 08:17:32.604628 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:17:32.604938 18367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:32.599821 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:37749 (local address 127.20.158.131:40205)
0811 08:17:32.599987 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:32.600022 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:32.600497 (+ 475us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:32.600700 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:32.600703 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:32.600712 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:17:32.601328 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:32.601334 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.602414 (+ 1080us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.602415 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:32.603394 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:32.603396 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.603738 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.603739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:32.603851 (+ 112us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:32.604346 (+ 495us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:17:32.604346 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:17:32.604376 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:17:32.604398 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:17:32.604552 (+ 154us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:17:32.604554 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:17:32.604557 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:17:32.604602 (+ 45us) client_negotiation.cc:240] Negotiation successful
0811 08:17:32.604681 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":68,"threads_started":1}
I20260811 08:17:32.605453 18365 heartbeater.cc:347] Connected to a master server at 127.20.158.190:37749
I20260811 08:17:32.605584 18365 heartbeater.cc:464] Registering TS with master...
I20260811 08:17:32.605769 18365 heartbeater.cc:511] Master 127.20.158.190:37749 requested a full tablet report, sending...
I20260811 08:17:32.606137 17666 ts_manager.cc:194] Registered new tserver with Master: 90088b688b464070984debf195b9b73a (127.20.158.131:38085)
I20260811 08:17:32.606521 17666 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.158.131:40205
I20260811 08:17:32.613997 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:17:32.618764 17722 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:32.615448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42692 (local address 127.20.158.190:37749)
0811 08:17:32.615491 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:32.615494 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:32.615622 (+ 128us) server_negotiation.cc:407] Connection header received
0811 08:17:32.615696 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:32.615697 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:32.615711 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:32.615762 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:32.615952 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.616460 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.617275 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.617486 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.617615 (+ 129us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:32.618430 (+ 815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:32.618431 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:32.618432 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:32.618444 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:32.618464 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:32.618468 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:32.618566 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:32.618662 (+ 96us) server_negotiation.cc:299] Negotiation successful
0811 08:17:32.618672 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:17:32.620469 17666 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:42692:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:17:32.622100 17666 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:17:32.628866 18381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:32.624621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49856 (local address 127.20.158.131:38085)
0811 08:17:32.625271 (+ 650us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:32.625276 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:32.625286 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:17:32.625326 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:32.625328 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:32.625344 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:32.625421 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:32.625667 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.626366 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.627782 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.628458 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.628550 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:32.628660 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:32.628734 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 08:17:32.628774 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":597,"thread_start_us":128,"threads_started":1}
I20260811 08:17:32.628854 18379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:32.624532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:38085 (local address 127.0.0.1:49856)
0811 08:17:32.624748 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:32.624790 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:32.624856 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:32.625493 (+ 637us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:32.625494 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:32.625497 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:32.625569 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:32.625572 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.626465 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.626467 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:32.627694 (+ 1227us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:32.627696 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.628550 (+ 854us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.628551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:32.628628 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:32.628641 (+ 13us) client_negotiation.cc:769] Sending connection context
0811 08:17:32.628720 (+ 79us) client_negotiation.cc:240] Negotiation successful
0811 08:17:32.628774 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":93,"threads_started":1}
I20260811 08:17:32.629240 18380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:32.624533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:38439 (local address 127.0.0.1:54658)
0811 08:17:32.625069 (+ 536us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:32.625080 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:32.625133 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:32.625431 (+ 298us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:32.625434 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:32.625440 (+ 6us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:32.625551 (+ 111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:32.625553 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.626857 (+ 1304us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.626858 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:32.627872 (+ 1014us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:32.627874 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.628827 (+ 953us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.628829 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:32.628889 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:32.628893 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:17:32.629092 (+ 199us) client_negotiation.cc:240] Negotiation successful
0811 08:17:32.629147 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":522,"mutex_wait_us":310,"thread_start_us":82,"threads_started":1}
I20260811 08:17:32.629439 18384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:32.624533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:38473 (local address 127.0.0.1:53942)
0811 08:17:32.625006 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:32.625017 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:32.625086 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:32.625432 (+ 346us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:32.625434 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:32.625436 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:32.625548 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:32.625551 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.627030 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.627032 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:32.628105 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:32.628108 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.629233 (+ 1125us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.629234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:32.629293 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:32.629298 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:17:32.629341 (+ 43us) client_negotiation.cc:240] Negotiation successful
0811 08:17:32.629378 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":453,"mutex_wait_us":11,"thread_start_us":98,"threads_started":1}
I20260811 08:17:32.629495 18383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:32.624818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53942 (local address 127.20.158.129:38473)
0811 08:17:32.625027 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:32.625031 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:32.625070 (+ 39us) server_negotiation.cc:407] Connection header received
0811 08:17:32.625174 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:32.625177 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:32.625265 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:32.625342 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:32.625639 (+ 297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.626948 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.628205 (+ 1257us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.628930 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.629230 (+ 300us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:32.629333 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:32.629376 (+ 43us) server_negotiation.cc:299] Negotiation successful
0811 08:17:32.629414 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":97,"threads_started":1}
I20260811 08:17:32.629674 18251 tablet_service.cc:1467] Processing CreateTablet for tablet c53851bf037844d6a61d07d157bfe024 (DEFAULT_TABLE table=test-table [id=9d057c6c2ce84668a00993ee1ae7ae47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:17:32.629997 18382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:32.624691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54658 (local address 127.20.158.130:38439)
0811 08:17:32.625019 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:32.625024 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:32.625182 (+ 158us) server_negotiation.cc:407] Connection header received
0811 08:17:32.625230 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:32.625232 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:32.625248 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:32.625338 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:32.625640 (+ 302us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.626759 (+ 1119us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.627958 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.628630 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.628704 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:32.628788 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:32.629802 (+ 1014us) server_negotiation.cc:299] Negotiation successful
0811 08:17:32.629876 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":290,"thread_start_us":99,"threads_started":1}
I20260811 08:17:32.630158 18251 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c53851bf037844d6a61d07d157bfe024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:32.630491 17845 tablet_service.cc:1467] Processing CreateTablet for tablet c53851bf037844d6a61d07d157bfe024 (DEFAULT_TABLE table=test-table [id=9d057c6c2ce84668a00993ee1ae7ae47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:17:32.630702 18042 tablet_service.cc:1467] Processing CreateTablet for tablet c53851bf037844d6a61d07d157bfe024 (DEFAULT_TABLE table=test-table [id=9d057c6c2ce84668a00993ee1ae7ae47]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:17:32.630852 17845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c53851bf037844d6a61d07d157bfe024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:32.631057 18042 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c53851bf037844d6a61d07d157bfe024. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:32.633657 18386 tablet_bootstrap.cc:492] T c53851bf037844d6a61d07d157bfe024 P b5ea9b7fccc7475ab0e5ae81970bb0a9: Bootstrap starting.
I20260811 08:17:32.633991 18387 tablet_bootstrap.cc:492] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a: Bootstrap starting.
I20260811 08:17:32.634443 18386 tablet_bootstrap.cc:654] T c53851bf037844d6a61d07d157bfe024 P b5ea9b7fccc7475ab0e5ae81970bb0a9: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:32.634542 18389 tablet_bootstrap.cc:492] T c53851bf037844d6a61d07d157bfe024 P 8e6f2cb292d34bada3c2e6a6f99b903f: Bootstrap starting.
I20260811 08:17:32.634804 18387 tablet_bootstrap.cc:654] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:32.635138 18389 tablet_bootstrap.cc:654] T c53851bf037844d6a61d07d157bfe024 P 8e6f2cb292d34bada3c2e6a6f99b903f: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:32.635214 18387 log.cc:824] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:32.635214 18386 log.cc:824] T c53851bf037844d6a61d07d157bfe024 P b5ea9b7fccc7475ab0e5ae81970bb0a9: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:32.635471 18389 log.cc:824] T c53851bf037844d6a61d07d157bfe024 P 8e6f2cb292d34bada3c2e6a6f99b903f: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:32.636078 18387 tablet_bootstrap.cc:492] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a: No bootstrap required, opened a new log
I20260811 08:17:32.636196 18387 ts_tablet_manager.cc:1397] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:17:32.636412 18389 tablet_bootstrap.cc:492] T c53851bf037844d6a61d07d157bfe024 P 8e6f2cb292d34bada3c2e6a6f99b903f: No bootstrap required, opened a new log
I20260811 08:17:32.636480 18389 ts_tablet_manager.cc:1397] T c53851bf037844d6a61d07d157bfe024 P 8e6f2cb292d34bada3c2e6a6f99b903f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:17:32.636673 18386 tablet_bootstrap.cc:492] T c53851bf037844d6a61d07d157bfe024 P b5ea9b7fccc7475ab0e5ae81970bb0a9: No bootstrap required, opened a new log
I20260811 08:17:32.636775 18386 ts_tablet_manager.cc:1397] T c53851bf037844d6a61d07d157bfe024 P b5ea9b7fccc7475ab0e5ae81970bb0a9: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 08:17:32.639005 18389 raft_consensus.cc:348] T c53851bf037844d6a61d07d157bfe024 P 8e6f2cb292d34bada3c2e6a6f99b903f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e6f2cb292d34bada3c2e6a6f99b903f" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 38439 } } peers { permanent_uuid: "90088b688b464070984debf195b9b73a" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 38085 } } peers { permanent_uuid: "b5ea9b7fccc7475ab0e5ae81970bb0a9" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 38473 } }
I20260811 08:17:32.638980 18387 raft_consensus.cc:348] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e6f2cb292d34bada3c2e6a6f99b903f" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 38439 } } peers { permanent_uuid: "90088b688b464070984debf195b9b73a" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 38085 } } peers { permanent_uuid: "b5ea9b7fccc7475ab0e5ae81970bb0a9" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 38473 } }
I20260811 08:17:32.639026 18386 raft_consensus.cc:348] T c53851bf037844d6a61d07d157bfe024 P b5ea9b7fccc7475ab0e5ae81970bb0a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e6f2cb292d34bada3c2e6a6f99b903f" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 38439 } } peers { permanent_uuid: "90088b688b464070984debf195b9b73a" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 38085 } } peers { permanent_uuid: "b5ea9b7fccc7475ab0e5ae81970bb0a9" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 38473 } }
I20260811 08:17:32.639173 18387 raft_consensus.cc:374] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:32.639173 18389 raft_consensus.cc:374] T c53851bf037844d6a61d07d157bfe024 P 8e6f2cb292d34bada3c2e6a6f99b903f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:32.639200 18386 raft_consensus.cc:374] T c53851bf037844d6a61d07d157bfe024 P b5ea9b7fccc7475ab0e5ae81970bb0a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:32.639214 18387 raft_consensus.cc:729] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90088b688b464070984debf195b9b73a, State: Initialized, Role: FOLLOWER
I20260811 08:17:32.639214 18389 raft_consensus.cc:729] T c53851bf037844d6a61d07d157bfe024 P 8e6f2cb292d34bada3c2e6a6f99b903f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e6f2cb292d34bada3c2e6a6f99b903f, State: Initialized, Role: FOLLOWER
I20260811 08:17:32.639250 18386 raft_consensus.cc:729] T c53851bf037844d6a61d07d157bfe024 P b5ea9b7fccc7475ab0e5ae81970bb0a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5ea9b7fccc7475ab0e5ae81970bb0a9, State: Initialized, Role: FOLLOWER
I20260811 08:17:32.639364 18389 consensus_queue.cc:260] T c53851bf037844d6a61d07d157bfe024 P 8e6f2cb292d34bada3c2e6a6f99b903f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e6f2cb292d34bada3c2e6a6f99b903f" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 38439 } } peers { permanent_uuid: "90088b688b464070984debf195b9b73a" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 38085 } } peers { permanent_uuid: "b5ea9b7fccc7475ab0e5ae81970bb0a9" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 38473 } }
I20260811 08:17:32.639364 18387 consensus_queue.cc:260] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e6f2cb292d34bada3c2e6a6f99b903f" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 38439 } } peers { permanent_uuid: "90088b688b464070984debf195b9b73a" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 38085 } } peers { permanent_uuid: "b5ea9b7fccc7475ab0e5ae81970bb0a9" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 38473 } }
I20260811 08:17:32.639415 18386 consensus_queue.cc:260] T c53851bf037844d6a61d07d157bfe024 P b5ea9b7fccc7475ab0e5ae81970bb0a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e6f2cb292d34bada3c2e6a6f99b903f" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 38439 } } peers { permanent_uuid: "90088b688b464070984debf195b9b73a" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 38085 } } peers { permanent_uuid: "b5ea9b7fccc7475ab0e5ae81970bb0a9" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 38473 } }
I20260811 08:17:32.639653 18387 ts_tablet_manager.cc:1428] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 08:17:32.639662 18389 ts_tablet_manager.cc:1428] T c53851bf037844d6a61d07d157bfe024 P 8e6f2cb292d34bada3c2e6a6f99b903f: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 08:17:32.639740 18386 ts_tablet_manager.cc:1428] T c53851bf037844d6a61d07d157bfe024 P b5ea9b7fccc7475ab0e5ae81970bb0a9: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260811 08:17:32.639787 18145 heartbeater.cc:503] Master 127.20.158.190:37749 was elected leader, sending a full tablet report...
I20260811 08:17:32.639845 17945 heartbeater.cc:503] Master 127.20.158.190:37749 was elected leader, sending a full tablet report...
I20260811 08:17:32.640084 18365 heartbeater.cc:503] Master 127.20.158.190:37749 was elected leader, sending a full tablet report...
W20260811 08:17:32.706980 18147 tablet.cc:2369] T c53851bf037844d6a61d07d157bfe024 P 8e6f2cb292d34bada3c2e6a6f99b903f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:17:32.710096 18396 raft_consensus.cc:482] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:17:32.710294 18396 raft_consensus.cc:504] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e6f2cb292d34bada3c2e6a6f99b903f" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 38439 } } peers { permanent_uuid: "90088b688b464070984debf195b9b73a" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 38085 } } peers { permanent_uuid: "b5ea9b7fccc7475ab0e5ae81970bb0a9" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 38473 } }
I20260811 08:17:32.710697 18396 leader_election.cc:288] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e6f2cb292d34bada3c2e6a6f99b903f (127.20.158.130:38439), b5ea9b7fccc7475ab0e5ae81970bb0a9 (127.20.158.129:38473)
I20260811 08:17:32.713938 18382 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:32.710969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:57303 (local address 127.20.158.130:38439)
0811 08:17:32.711020 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:32.711022 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:32.711303 (+ 281us) server_negotiation.cc:407] Connection header received
0811 08:17:32.711367 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:32.711369 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:32.711381 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:32.711455 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:32.711635 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.712094 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.713054 (+ 960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.713492 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.713639 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:32.713649 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:32.713827 (+ 178us) server_negotiation.cc:299] Negotiation successful
0811 08:17:32.713867 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260811 08:17:32.713958 18398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:32.710902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:38439 (local address 127.20.158.131:57303)
0811 08:17:32.711234 (+ 332us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:32.711242 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:32.711311 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:32.711459 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:32.711460 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:32.711462 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:32.711541 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:32.711544 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.712185 (+ 641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.712186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:32.712927 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:32.712929 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.713642 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.713643 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:32.713724 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:32.713728 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:17:32.713821 (+ 93us) client_negotiation.cc:240] Negotiation successful
0811 08:17:32.713865 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":301,"mutex_wait_us":132,"thread_start_us":117,"threads_started":1}
I20260811 08:17:32.714159 18383 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:32.710963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:54367 (local address 127.20.158.129:38473)
0811 08:17:32.711038 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:32.711040 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:32.711050 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:17:32.711146 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:32.711147 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:32.711157 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:32.711237 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:32.711404 (+ 167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.711905 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.712864 (+ 959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.713580 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.713681 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:32.713692 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:32.714012 (+ 320us) server_negotiation.cc:299] Negotiation successful
0811 08:17:32.714064 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 08:17:32.714326 18367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:32.710897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:38473 (local address 127.20.158.131:54367)
0811 08:17:32.710973 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:32.710986 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:32.711042 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:32.711244 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:32.711245 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:32.711247 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:32.711327 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:32.711329 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.712008 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.712009 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:32.712764 (+ 755us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:32.712767 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.713681 (+ 914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.713683 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:32.713776 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:32.713779 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:17:32.713877 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 08:17:32.713932 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 08:17:32.714404 18069 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c53851bf037844d6a61d07d157bfe024" candidate_uuid: "90088b688b464070984debf195b9b73a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e6f2cb292d34bada3c2e6a6f99b903f" is_pre_election: true
I20260811 08:17:32.714563 18069 raft_consensus.cc:2454] T c53851bf037844d6a61d07d157bfe024 P 8e6f2cb292d34bada3c2e6a6f99b903f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90088b688b464070984debf195b9b73a in term 0.
I20260811 08:17:32.714793 17876 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c53851bf037844d6a61d07d157bfe024" candidate_uuid: "90088b688b464070984debf195b9b73a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5ea9b7fccc7475ab0e5ae81970bb0a9" is_pre_election: true
I20260811 08:17:32.714941 17876 raft_consensus.cc:2454] T c53851bf037844d6a61d07d157bfe024 P b5ea9b7fccc7475ab0e5ae81970bb0a9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90088b688b464070984debf195b9b73a in term 0.
I20260811 08:17:32.714867 18175 leader_election.cc:302] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e6f2cb292d34bada3c2e6a6f99b903f, 90088b688b464070984debf195b9b73a; no voters:
I20260811 08:17:32.715138 18396 raft_consensus.cc:2781] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:17:32.715230 18396 raft_consensus.cc:482] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:17:32.715270 18396 raft_consensus.cc:3037] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:32.716022 18396 raft_consensus.cc:504] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e6f2cb292d34bada3c2e6a6f99b903f" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 38439 } } peers { permanent_uuid: "90088b688b464070984debf195b9b73a" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 38085 } } peers { permanent_uuid: "b5ea9b7fccc7475ab0e5ae81970bb0a9" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 38473 } }
I20260811 08:17:32.716179 18396 leader_election.cc:288] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a [CANDIDATE]: Term 1 election: Requested vote from peers 8e6f2cb292d34bada3c2e6a6f99b903f (127.20.158.130:38439), b5ea9b7fccc7475ab0e5ae81970bb0a9 (127.20.158.129:38473)
I20260811 08:17:32.716333 18069 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c53851bf037844d6a61d07d157bfe024" candidate_uuid: "90088b688b464070984debf195b9b73a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e6f2cb292d34bada3c2e6a6f99b903f"
I20260811 08:17:32.716336 17876 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c53851bf037844d6a61d07d157bfe024" candidate_uuid: "90088b688b464070984debf195b9b73a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b5ea9b7fccc7475ab0e5ae81970bb0a9"
I20260811 08:17:32.716434 18069 raft_consensus.cc:3037] T c53851bf037844d6a61d07d157bfe024 P 8e6f2cb292d34bada3c2e6a6f99b903f [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:32.716429 17876 raft_consensus.cc:3037] T c53851bf037844d6a61d07d157bfe024 P b5ea9b7fccc7475ab0e5ae81970bb0a9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:32.717151 18069 raft_consensus.cc:2454] T c53851bf037844d6a61d07d157bfe024 P 8e6f2cb292d34bada3c2e6a6f99b903f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90088b688b464070984debf195b9b73a in term 1.
I20260811 08:17:32.717386 18175 leader_election.cc:302] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e6f2cb292d34bada3c2e6a6f99b903f, 90088b688b464070984debf195b9b73a; no voters:
I20260811 08:17:32.717388 17876 raft_consensus.cc:2454] T c53851bf037844d6a61d07d157bfe024 P b5ea9b7fccc7475ab0e5ae81970bb0a9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90088b688b464070984debf195b9b73a in term 1.
I20260811 08:17:32.717587 18396 raft_consensus.cc:2781] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:17:32.717810 18396 raft_consensus.cc:686] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a [term 1 LEADER]: Becoming Leader. State: Replica: 90088b688b464070984debf195b9b73a, State: Running, Role: LEADER
I20260811 08:17:32.717905 18396 consensus_queue.cc:237] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e6f2cb292d34bada3c2e6a6f99b903f" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 38439 } } peers { permanent_uuid: "90088b688b464070984debf195b9b73a" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 38085 } } peers { permanent_uuid: "b5ea9b7fccc7475ab0e5ae81970bb0a9" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 38473 } }
I20260811 08:17:32.718997 17663 catalog_manager.cc:5495] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a reported cstate change: term changed from 0 to 1, leader changed from <none> to 90088b688b464070984debf195b9b73a (127.20.158.131). New cstate: current_term: 1 leader_uuid: "90088b688b464070984debf195b9b73a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e6f2cb292d34bada3c2e6a6f99b903f" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 38439 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90088b688b464070984debf195b9b73a" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 38085 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b5ea9b7fccc7475ab0e5ae81970bb0a9" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 38473 } health_report { overall_health: UNKNOWN } } }
I20260811 08:17:32.746250 18381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:32.743448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49858 (local address 127.20.158.131:38085)
0811 08:17:32.743516 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:32.743519 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:32.743530 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:17:32.743580 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:32.743582 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:32.743606 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:32.743716 (+ 110us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:17:32.743875 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.744424 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.745283 (+ 859us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:32.745518 (+ 235us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:32.745644 (+ 126us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:32.745804 (+ 160us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:17:32.745922 (+ 118us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:17:32.746041 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:32.746123 (+ 82us) server_negotiation.cc:299] Negotiation successful
0811 08:17:32.746132 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 08:17:32.748454 18069 raft_consensus.cc:1261] T c53851bf037844d6a61d07d157bfe024 P 8e6f2cb292d34bada3c2e6a6f99b903f [term 1 FOLLOWER]: Refusing update from remote peer 90088b688b464070984debf195b9b73a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:17:32.748456 17876 raft_consensus.cc:1261] T c53851bf037844d6a61d07d157bfe024 P b5ea9b7fccc7475ab0e5ae81970bb0a9 [term 1 FOLLOWER]: Refusing update from remote peer 90088b688b464070984debf195b9b73a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:17:32.748929 18396 consensus_queue.cc:1035] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e6f2cb292d34bada3c2e6a6f99b903f" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 38439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:17:32.749075 18399 consensus_queue.cc:1035] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5ea9b7fccc7475ab0e5ae81970bb0a9" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 38473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:17:32.752959 18407 mvcc.cc:205] Tried to move back new op lower bound from 7317242891254210560 to 7317242891133755392. Current Snapshot: MvccSnapshot[applied={T|T < 7317242891254210560}]
I20260811 08:17:32.754896 17666 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:42692:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:17:32.755007 17666 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:42692:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:17:32.755826 17666 catalog_manager.cc:5782] T 00000000000000000000000000000000 P c853b5c0bee64d01adc6f663daf222be: Sending DeleteTablet for 3 replicas of tablet c53851bf037844d6a61d07d157bfe024
I20260811 08:17:32.756187 18042 tablet_service.cc:1514] Processing DeleteTablet for tablet c53851bf037844d6a61d07d157bfe024 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:17:32 UTC) from {username='slave'} at 127.0.0.1:54658
I20260811 08:17:32.756186 18251 tablet_service.cc:1514] Processing DeleteTablet for tablet c53851bf037844d6a61d07d157bfe024 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:17:32 UTC) from {username='slave'} at 127.0.0.1:49856
I20260811 08:17:32.756217 17845 tablet_service.cc:1514] Processing DeleteTablet for tablet c53851bf037844d6a61d07d157bfe024 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:17:32 UTC) from {username='slave'} at 127.0.0.1:53942
I20260811 08:17:32.756474 18424 tablet_replica.cc:330] T c53851bf037844d6a61d07d157bfe024 P b5ea9b7fccc7475ab0e5ae81970bb0a9: stopping tablet replica
I20260811 08:17:32.756583 18423 tablet_replica.cc:330] T c53851bf037844d6a61d07d157bfe024 P 8e6f2cb292d34bada3c2e6a6f99b903f: stopping tablet replica
I20260811 08:17:32.756600 18424 raft_consensus.cc:2229] T c53851bf037844d6a61d07d157bfe024 P b5ea9b7fccc7475ab0e5ae81970bb0a9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:17:32.756692 18423 raft_consensus.cc:2229] T c53851bf037844d6a61d07d157bfe024 P 8e6f2cb292d34bada3c2e6a6f99b903f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:17:32.756714 18424 raft_consensus.cc:2258] T c53851bf037844d6a61d07d157bfe024 P b5ea9b7fccc7475ab0e5ae81970bb0a9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:17:32.756793 18423 raft_consensus.cc:2258] T c53851bf037844d6a61d07d157bfe024 P 8e6f2cb292d34bada3c2e6a6f99b903f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:17:32.756887 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 17751
I20260811 08:17:32.757150 18424 ts_tablet_manager.cc:1905] T c53851bf037844d6a61d07d157bfe024 P b5ea9b7fccc7475ab0e5ae81970bb0a9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:17:32.762964 18423 ts_tablet_manager.cc:1905] T c53851bf037844d6a61d07d157bfe024 P 8e6f2cb292d34bada3c2e6a6f99b903f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:17:32.764791 18423 ts_tablet_manager.cc:1918] T c53851bf037844d6a61d07d157bfe024 P 8e6f2cb292d34bada3c2e6a6f99b903f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:17:32.764866 18423 log.cc:1196] T c53851bf037844d6a61d07d157bfe024 P 8e6f2cb292d34bada3c2e6a6f99b903f: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-1/wal/wals/c53851bf037844d6a61d07d157bfe024
I20260811 08:17:32.765084 18423 ts_tablet_manager.cc:1939] T c53851bf037844d6a61d07d157bfe024 P 8e6f2cb292d34bada3c2e6a6f99b903f: Deleting consensus metadata
I20260811 08:17:32.765280 18422 tablet_replica.cc:330] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a: stopping tablet replica
I20260811 08:17:32.765395 18422 raft_consensus.cc:2229] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:17:32.765558 18422 raft_consensus.cc:2258] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:17:32.766016 17639 catalog_manager.cc:4841] TS 8e6f2cb292d34bada3c2e6a6f99b903f (127.20.158.130:38439): tablet c53851bf037844d6a61d07d157bfe024 (table test-table [id=9d057c6c2ce84668a00993ee1ae7ae47]) successfully deleted
I20260811 08:17:32.766448 18422 ts_tablet_manager.cc:1905] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:17:32.768253 18422 ts_tablet_manager.cc:1918] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:17:32.768342 18422 log.cc:1196] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786436003833085-21114-0/minicluster-data/ts-2/wal/wals/c53851bf037844d6a61d07d157bfe024
I20260811 08:17:32.768653 18422 ts_tablet_manager.cc:1939] T c53851bf037844d6a61d07d157bfe024 P 90088b688b464070984debf195b9b73a: Deleting consensus metadata
I20260811 08:17:32.769179 17644 catalog_manager.cc:4841] TS 90088b688b464070984debf195b9b73a (127.20.158.131:38085): tablet c53851bf037844d6a61d07d157bfe024 (table test-table [id=9d057c6c2ce84668a00993ee1ae7ae47]) successfully deleted
W20260811 08:17:32.771374 17640 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.158.129:38473 (error 108)
I20260811 08:17:32.771970 18384 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:32.771814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:38473 (local address 127.0.0.1:53956)
0811 08:17:32.771882 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:32.771930 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.129:38473: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 08:17:32.772096 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 17948
W20260811 08:17:32.772105 17640 catalog_manager.cc:4584] TS b5ea9b7fccc7475ab0e5ae81970bb0a9 (127.20.158.129:38473): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c53851bf037844d6a61d07d157bfe024: Network error: Client connection negotiation failed: client connection to 127.20.158.129:38473: connect: Connection refused (error 111)
I20260811 08:17:32.802429 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 18150
I20260811 08:17:32.814538 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 17622
2026-08-11T08:17:32Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (818 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:17:32 dist-test-slave-gkw7 krb5kdc[18431](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:17:32 dist-test-slave-gkw7 krb5kdc[18431](info): set up 2 sockets
Aug 11 08:17:32 dist-test-slave-gkw7 krb5kdc[18431](info): commencing operation
krb5kdc: starting...
W20260811 08:17:34.097033 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.257s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:17:34 dist-test-slave-gkw7 krb5kdc[18431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436254, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:17:34Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:17:34Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:17:34.230674 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:34501
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:43423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:34501
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:34.314756 18449 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:34.314968 18449 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:34.314992 18449 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:34.316082 18449 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:17:34.316119 18449 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:34.316133 18449 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:34.316146 18449 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:17:34.316157 18449 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:17:34.317657 18449 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:43423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:34501
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:34501
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18449
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:34.317963 18449 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:34.318207 18449 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:34.323738 18461 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:34.323792 18462 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:34.323889 18449 server_base.cc:1034] running on GCE node
W20260811 08:17:34.323738 18464 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:34.324249 18449 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:34.324601 18449 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:34.325765 18449 hybrid_clock.cc:648] HybridClock initialized: now 1786436254325751 us; error 31 us; skew 500 ppm
Aug 11 08:17:34 dist-test-slave-gkw7 krb5kdc[18431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436254, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:34.333199 18449 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:17:34.333825 18449 webserver.cc:460] Webserver started at http://127.20.158.190:43803/ using document root <none> and password file <none>
I20260811 08:17:34.334116 18449 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:34.334195 18449 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:34.334362 18449 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:34.335557 18449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "5cc335fc143a411f847fa8175fafb5c3"
format_stamp: "Formatted at 2026-08-11 08:17:34 on dist-test-slave-gkw7"
server_key: "56a50bd9e4059e2d81e35d56ec6137b7"
server_key_iv: "07774ce0310c30ebe5766391821621a4"
server_key_version: "encryptionkey@0"
I20260811 08:17:34.335963 18449 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "5cc335fc143a411f847fa8175fafb5c3"
format_stamp: "Formatted at 2026-08-11 08:17:34 on dist-test-slave-gkw7"
server_key: "56a50bd9e4059e2d81e35d56ec6137b7"
server_key_iv: "07774ce0310c30ebe5766391821621a4"
server_key_version: "encryptionkey@0"
I20260811 08:17:34.337466 18449 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:17:34.338320 18477 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:34.338517 18449 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:17:34.338652 18449 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "5cc335fc143a411f847fa8175fafb5c3"
format_stamp: "Formatted at 2026-08-11 08:17:34 on dist-test-slave-gkw7"
server_key: "56a50bd9e4059e2d81e35d56ec6137b7"
server_key_iv: "07774ce0310c30ebe5766391821621a4"
server_key_version: "encryptionkey@0"
I20260811 08:17:34.338734 18449 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:34.359084 18449 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:34.361155 18449 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:34.361336 18449 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:34.366214 18449 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:34501
I20260811 08:17:34.366251 18559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:34501 every 8 connection(s)
I20260811 08:17:34.366652 18449 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:17:34.367672 18561 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:34.370401 18561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5cc335fc143a411f847fa8175fafb5c3: Bootstrap starting.
I20260811 08:17:34.371141 18561 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5cc335fc143a411f847fa8175fafb5c3: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:34.371503 18561 log.cc:824] T 00000000000000000000000000000000 P 5cc335fc143a411f847fa8175fafb5c3: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:34.372359 18561 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5cc335fc143a411f847fa8175fafb5c3: No bootstrap required, opened a new log
I20260811 08:17:34.374248 18561 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5cc335fc143a411f847fa8175fafb5c3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cc335fc143a411f847fa8175fafb5c3" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34501 } }
I20260811 08:17:34.374406 18561 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5cc335fc143a411f847fa8175fafb5c3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:34.374435 18561 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5cc335fc143a411f847fa8175fafb5c3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5cc335fc143a411f847fa8175fafb5c3, State: Initialized, Role: FOLLOWER
I20260811 08:17:34.374629 18561 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5cc335fc143a411f847fa8175fafb5c3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cc335fc143a411f847fa8175fafb5c3" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34501 } }
I20260811 08:17:34.374711 18561 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5cc335fc143a411f847fa8175fafb5c3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:17:34.374739 18561 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5cc335fc143a411f847fa8175fafb5c3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:17:34.374815 18561 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5cc335fc143a411f847fa8175fafb5c3 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:34.375459 18561 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5cc335fc143a411f847fa8175fafb5c3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cc335fc143a411f847fa8175fafb5c3" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34501 } }
I20260811 08:17:34.375571 18561 leader_election.cc:302] T 00000000000000000000000000000000 P 5cc335fc143a411f847fa8175fafb5c3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5cc335fc143a411f847fa8175fafb5c3; no voters:
I20260811 08:17:34.375841 18561 leader_election.cc:288] T 00000000000000000000000000000000 P 5cc335fc143a411f847fa8175fafb5c3 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:17:34.375877 18565 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5cc335fc143a411f847fa8175fafb5c3 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:17:34.376076 18565 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5cc335fc143a411f847fa8175fafb5c3 [term 1 LEADER]: Becoming Leader. State: Replica: 5cc335fc143a411f847fa8175fafb5c3, State: Running, Role: LEADER
I20260811 08:17:34.376170 18561 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5cc335fc143a411f847fa8175fafb5c3 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:17:34.376211 18565 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5cc335fc143a411f847fa8175fafb5c3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cc335fc143a411f847fa8175fafb5c3" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34501 } }
I20260811 08:17:34.376762 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 18449
I20260811 08:17:34.376901 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:17:34.377141 21114 external_mini_cluster.cc:1428] Setting key 7c8f21f3ce2fb407abc9777cc64b1d9d
I20260811 08:17:34.377899 18569 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5cc335fc143a411f847fa8175fafb5c3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5cc335fc143a411f847fa8175fafb5c3. Latest consensus state: current_term: 1 leader_uuid: "5cc335fc143a411f847fa8175fafb5c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cc335fc143a411f847fa8175fafb5c3" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34501 } } }
I20260811 08:17:34.378060 18569 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5cc335fc143a411f847fa8175fafb5c3 [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:34.378310 18597 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:17:34.378302 18568 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5cc335fc143a411f847fa8175fafb5c3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5cc335fc143a411f847fa8175fafb5c3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5cc335fc143a411f847fa8175fafb5c3" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 34501 } } }
I20260811 08:17:34.378611 18568 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5cc335fc143a411f847fa8175fafb5c3 [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:34.379078 18597 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:17:34.380825 18597 catalog_manager.cc:1347] Generated new cluster ID: 9103c51513a74c1fa305c86d8fbcabdd
I20260811 08:17:34.380877 18597 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:17:34 dist-test-slave-gkw7 krb5kdc[18431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436254, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:17:34.389902 18589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:34.377680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38078 (local address 127.20.158.190:34501)
0811 08:17:34.377885 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:34.377897 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:34.377934 (+ 37us) server_negotiation.cc:407] Connection header received
0811 08:17:34.378067 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:34.378075 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:34.378149 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:34.379174 (+ 1025us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:34.379288 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.380577 (+ 1289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.381823 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.382459 (+ 636us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.382561 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:34.385950 (+ 3389us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:34.385954 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:34.385954 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:17:34.385968 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:34.388054 (+ 2086us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:34.388530 (+ 476us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:34.388533 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:34.388533 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:34.388653 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:34.388910 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:34.388911 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:34.388911 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:34.389215 (+ 304us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:34.389361 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:34.389524 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 08:17:34.389688 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":110,"threads_started":1}
I20260811 08:17:34.395669 18597 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:17:34.396469 18597 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:17:34.408267 18597 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5cc335fc143a411f847fa8175fafb5c3: Generated new TSK 0
I20260811 08:17:34.408495 18597 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.20.158.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
Entry for principal kudu/127.20.158.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab.
I20260811 08:17:34.444272 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:0
--local_ip_for_outbound_sockets=127.20.158.129
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:34501
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:43423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:34.529768 18605 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:34.529973 18605 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:34.529997 18605 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:34.531162 18605 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:34.531205 18605 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:34.531239 18605 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:17:34.532752 18605 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:43423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.129.keytab
--principal=kudu/127.20.158.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:34501
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18605
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:34.533021 18605 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:34.533277 18605 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:34.538757 18617 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:34.538741 18616 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:34.538745 18620 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:34.539033 18605 server_base.cc:1034] running on GCE node
I20260811 08:17:34.539353 18605 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:34.539615 18605 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:34.540795 18605 hybrid_clock.cc:648] HybridClock initialized: now 1786436254540774 us; error 39 us; skew 500 ppm
Aug 11 08:17:34 dist-test-slave-gkw7 krb5kdc[18431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436254, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:34.543548 18605 init.cc:377] Logged in from keytab as kudu/127.20.158.129@KRBTEST.COM (short username kudu)
I20260811 08:17:34.543947 18605 webserver.cc:460] Webserver started at http://127.20.158.129:39599/ using document root <none> and password file <none>
I20260811 08:17:34.544166 18605 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:34.544209 18605 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:34.544304 18605 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:34.545312 18605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-0/data/instance:
uuid: "e597377f1bf7492e967dac84450d2530"
format_stamp: "Formatted at 2026-08-11 08:17:34 on dist-test-slave-gkw7"
server_key: "6a32364a408df57129c821adf15e1844"
server_key_iv: "1788c46b468ae1b6fee9f9a542cc74f2"
server_key_version: "encryptionkey@0"
I20260811 08:17:34.545704 18605 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance:
uuid: "e597377f1bf7492e967dac84450d2530"
format_stamp: "Formatted at 2026-08-11 08:17:34 on dist-test-slave-gkw7"
server_key: "6a32364a408df57129c821adf15e1844"
server_key_iv: "1788c46b468ae1b6fee9f9a542cc74f2"
server_key_version: "encryptionkey@0"
I20260811 08:17:34.547066 18605 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:17:34.548098 18631 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:34.548336 18605 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:17:34.548444 18605 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "e597377f1bf7492e967dac84450d2530"
format_stamp: "Formatted at 2026-08-11 08:17:34 on dist-test-slave-gkw7"
server_key: "6a32364a408df57129c821adf15e1844"
server_key_iv: "1788c46b468ae1b6fee9f9a542cc74f2"
server_key_version: "encryptionkey@0"
I20260811 08:17:34.548513 18605 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:34.561203 18605 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:34.563259 18605 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:34.563380 18605 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:34.563580 18605 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:17:34.563925 18605 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:17:34.563959 18605 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:34.564005 18605 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:17:34.564031 18605 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:34.570185 18605 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:36403
I20260811 08:17:34.570286 18802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:36403 every 8 connection(s)
I20260811 08:17:34.570621 18605 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
Aug 11 08:17:34 dist-test-slave-gkw7 krb5kdc[18431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436254, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.129@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:17:34.580379 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 18605
I20260811 08:17:34.580521 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance
I20260811 08:17:34.580591 18589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:34.571452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:58127 (local address 127.20.158.190:34501)
0811 08:17:34.571506 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:34.571512 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:34.571664 (+ 152us) server_negotiation.cc:407] Connection header received
0811 08:17:34.572143 (+ 479us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:34.572144 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:34.572154 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:34.572221 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:34.573205 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.573759 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.574774 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.574978 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.575047 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:34.577618 (+ 2571us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:34.577619 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:34.577620 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:17:34.577627 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:34.579092 (+ 1465us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:34.579505 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:34.579506 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:34.579506 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:34.579564 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:34.579787 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:34.579788 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:34.579788 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:34.579893 (+ 105us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:34.579946 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:34.580350 (+ 404us) server_negotiation.cc:299] Negotiation successful
0811 08:17:34.580472 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:17:34.580713 18808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:34.571350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:34501 (local address 127.20.158.129:58127)
0811 08:17:34.571523 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:34.571566 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:34.572057 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:34.572276 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:34.572279 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:34.572893 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:17:34.573089 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:34.573094 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.573850 (+ 756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.573851 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:34.574678 (+ 827us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:34.574680 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.575062 (+ 382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.575063 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:34.575166 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:34.575700 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:17:34.575710 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:17:34.577484 (+ 1774us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:17:34.579187 (+ 1703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:17:34.579194 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:17:34.579196 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:17:34.579434 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:17:34.579624 (+ 190us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:17:34.579624 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:17:34.579625 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:17:34.579731 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:17:34.579950 (+ 219us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:17:34.579955 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:17:34.580075 (+ 120us) client_negotiation.cc:769] Sending connection context
0811 08:17:34.580231 (+ 156us) client_negotiation.cc:240] Negotiation successful
0811 08:17:34.580423 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":100,"threads_started":1}
I20260811 08:17:34.580788 21114 external_mini_cluster.cc:1428] Setting key 40181c606aa7df5b03e20b87db74326e
I20260811 08:17:34.581351 18803 heartbeater.cc:347] Connected to a master server at 127.20.158.190:34501
I20260811 08:17:34.581458 18803 heartbeater.cc:464] Registering TS with master...
I20260811 08:17:34.581730 18803 heartbeater.cc:511] Master 127.20.158.190:34501 requested a full tablet report, sending...
I20260811 08:17:34.582381 18507 ts_manager.cc:194] Registered new tserver with Master: e597377f1bf7492e967dac84450d2530 (127.20.158.129:36403)
I20260811 08:17:34.583017 18507 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.129@KRBTEST.COM'} at 127.20.158.129:58127
WARNING: no policy specified for kudu/127.20.158.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
Entry for principal kudu/127.20.158.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab.
I20260811 08:17:34.609567 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:0
--local_ip_for_outbound_sockets=127.20.158.130
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:34501
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:43423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:34.694849 18815 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:34.695060 18815 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:34.695083 18815 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:34.696174 18815 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:34.696208 18815 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:34.696234 18815 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:17:34.697655 18815 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:43423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.130.keytab
--principal=kudu/127.20.158.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:34501
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.18815
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:34.697847 18815 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:34.698021 18815 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:34.703079 18825 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:34.703073 18822 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:34.703074 18823 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:34.703351 18815 server_base.cc:1034] running on GCE node
I20260811 08:17:34.703562 18815 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:34.703761 18815 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:34.704905 18815 hybrid_clock.cc:648] HybridClock initialized: now 1786436254704890 us; error 32 us; skew 500 ppm
Aug 11 08:17:34 dist-test-slave-gkw7 krb5kdc[18431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436254, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:34.707604 18815 init.cc:377] Logged in from keytab as kudu/127.20.158.130@KRBTEST.COM (short username kudu)
I20260811 08:17:34.708102 18815 webserver.cc:460] Webserver started at http://127.20.158.130:40243/ using document root <none> and password file <none>
I20260811 08:17:34.708350 18815 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:34.708420 18815 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:34.708575 18815 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:34.709738 18815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-1/data/instance:
uuid: "b11a65e87f4442258644c7e13c7edb79"
format_stamp: "Formatted at 2026-08-11 08:17:34 on dist-test-slave-gkw7"
server_key: "9b1ea16d1150815e7ef41c40a19487f3"
server_key_iv: "f9d91bc4af78b35af88b7b2945aa202e"
server_key_version: "encryptionkey@0"
I20260811 08:17:34.710109 18815 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance:
uuid: "b11a65e87f4442258644c7e13c7edb79"
format_stamp: "Formatted at 2026-08-11 08:17:34 on dist-test-slave-gkw7"
server_key: "9b1ea16d1150815e7ef41c40a19487f3"
server_key_iv: "f9d91bc4af78b35af88b7b2945aa202e"
server_key_version: "encryptionkey@0"
I20260811 08:17:34.711500 18815 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:17:34.712316 18837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:34.712513 18815 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:17:34.712623 18815 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "b11a65e87f4442258644c7e13c7edb79"
format_stamp: "Formatted at 2026-08-11 08:17:34 on dist-test-slave-gkw7"
server_key: "9b1ea16d1150815e7ef41c40a19487f3"
server_key_iv: "f9d91bc4af78b35af88b7b2945aa202e"
server_key_version: "encryptionkey@0"
I20260811 08:17:34.712702 18815 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:34.730568 18815 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:34.732685 18815 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:34.732858 18815 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:34.733108 18815 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:17:34.733450 18815 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:17:34.733506 18815 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:34.733573 18815 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:17:34.733623 18815 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:34.739847 18815 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:36501
I20260811 08:17:34.739923 19029 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:36501 every 8 connection(s)
I20260811 08:17:34.740302 18815 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
I20260811 08:17:34.745579 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 18815
I20260811 08:17:34.745725 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance
I20260811 08:17:34.745955 21114 external_mini_cluster.cc:1428] Setting key b1348b473b7aab7454de366a8bbeadd9
Aug 11 08:17:34 dist-test-slave-gkw7 krb5kdc[18431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436254, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.130@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:17:34.750433 18589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:34.741185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:48837 (local address 127.20.158.190:34501)
0811 08:17:34.741256 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:34.741258 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:34.741428 (+ 170us) server_negotiation.cc:407] Connection header received
0811 08:17:34.742001 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:34.742002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:34.742013 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:34.742074 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:34.743042 (+ 968us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.743544 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.744528 (+ 984us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.744730 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.744789 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:34.747204 (+ 2415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:34.747205 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:34.747206 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:17:34.747212 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:34.748940 (+ 1728us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:34.749339 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:34.749341 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:34.749341 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:34.749413 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:34.749720 (+ 307us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:34.749721 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:34.749721 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:34.749887 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:34.749945 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:34.750243 (+ 298us) server_negotiation.cc:299] Negotiation successful
0811 08:17:34.750342 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 08:17:34.750608 19039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:34.741133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:34501 (local address 127.20.158.130:48837)
0811 08:17:34.741297 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:34.741339 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:34.741909 (+ 570us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:34.742128 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:34.742131 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:34.742743 (+ 612us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:17:34.742947 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:34.742953 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.743641 (+ 688us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.743642 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:34.744446 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:34.744448 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.744811 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.744812 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:34.744917 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:34.745393 (+ 476us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:17:34.745401 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:17:34.747110 (+ 1709us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:17:34.749026 (+ 1916us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:17:34.749032 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:17:34.749034 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:17:34.749261 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:17:34.749483 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:17:34.749483 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:17:34.749483 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:17:34.749640 (+ 157us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:17:34.749954 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:17:34.749960 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:17:34.750080 (+ 120us) client_negotiation.cc:769] Sending connection context
0811 08:17:34.750192 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 08:17:34.750359 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":88,"threads_started":1}
I20260811 08:17:34.751147 19035 heartbeater.cc:347] Connected to a master server at 127.20.158.190:34501
I20260811 08:17:34.751250 19035 heartbeater.cc:464] Registering TS with master...
I20260811 08:17:34.751461 19035 heartbeater.cc:511] Master 127.20.158.190:34501 requested a full tablet report, sending...
I20260811 08:17:34.751921 18507 ts_manager.cc:194] Registered new tserver with Master: b11a65e87f4442258644c7e13c7edb79 (127.20.158.130:36501)
I20260811 08:17:34.752512 18507 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.130@KRBTEST.COM'} at 127.20.158.130:48837
WARNING: no policy specified for kudu/127.20.158.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
Entry for principal kudu/127.20.158.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab.
I20260811 08:17:34.776876 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:0
--local_ip_for_outbound_sockets=127.20.158.131
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:34501
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:43423
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:34.862608 19043 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:34.862830 19043 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:34.862856 19043 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:34.864027 19043 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:34.864075 19043 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:34.864102 19043 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:17:34.865592 19043 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:43423
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.131.keytab
--principal=kudu/127.20.158.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:34501
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19043
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:34.865830 19043 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:34.866092 19043 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:34.871320 19055 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:34.871367 19043 server_base.cc:1034] running on GCE node
W20260811 08:17:34.871372 19053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:34.871320 19058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:34.871716 19043 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:34.871932 19043 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:34.873116 19043 hybrid_clock.cc:648] HybridClock initialized: now 1786436254873071 us; error 32 us; skew 500 ppm
Aug 11 08:17:34 dist-test-slave-gkw7 krb5kdc[18431](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436254, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:34.875785 19043 init.cc:377] Logged in from keytab as kudu/127.20.158.131@KRBTEST.COM (short username kudu)
I20260811 08:17:34.876348 19043 webserver.cc:460] Webserver started at http://127.20.158.131:37953/ using document root <none> and password file <none>
I20260811 08:17:34.876534 19043 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:34.876573 19043 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:34.876720 19043 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:34.878016 19043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-2/data/instance:
uuid: "c5714d0990f243aaab55ef22a7368595"
format_stamp: "Formatted at 2026-08-11 08:17:34 on dist-test-slave-gkw7"
server_key: "13938194c21b87367f402bea89bf33d3"
server_key_iv: "28b8383fe46eedee20e253c60fd099c4"
server_key_version: "encryptionkey@0"
I20260811 08:17:34.878386 19043 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance:
uuid: "c5714d0990f243aaab55ef22a7368595"
format_stamp: "Formatted at 2026-08-11 08:17:34 on dist-test-slave-gkw7"
server_key: "13938194c21b87367f402bea89bf33d3"
server_key_iv: "28b8383fe46eedee20e253c60fd099c4"
server_key_version: "encryptionkey@0"
I20260811 08:17:34.879703 19043 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:17:34.880479 19065 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:34.880664 19043 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:17:34.880750 19043 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "c5714d0990f243aaab55ef22a7368595"
format_stamp: "Formatted at 2026-08-11 08:17:34 on dist-test-slave-gkw7"
server_key: "13938194c21b87367f402bea89bf33d3"
server_key_iv: "28b8383fe46eedee20e253c60fd099c4"
server_key_version: "encryptionkey@0"
I20260811 08:17:34.880805 19043 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:34.895396 19043 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:34.897887 19043 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:34.898010 19043 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:34.898216 19043 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:17:34.898490 19043 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:17:34.898525 19043 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:34.898548 19043 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:17:34.898561 19043 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:34.904510 19043 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:40643
I20260811 08:17:34.904589 19240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:40643 every 8 connection(s)
I20260811 08:17:34.904917 19043 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
Aug 11 08:17:34 dist-test-slave-gkw7 krb5kdc[18431](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436254, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.131@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:17:34.913466 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 19043
I20260811 08:17:34.913635 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance
I20260811 08:17:34.913870 21114 external_mini_cluster.cc:1428] Setting key 39b9abbee831ad1c556a01c0a39519f9
I20260811 08:17:34.914709 18589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:34.905756 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:57763 (local address 127.20.158.190:34501)
0811 08:17:34.905827 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:34.905830 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:34.906051 (+ 221us) server_negotiation.cc:407] Connection header received
0811 08:17:34.906542 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:34.906543 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:34.906554 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:34.906607 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:34.907639 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.908142 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.909363 (+ 1221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.909614 (+ 251us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.909687 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:34.911748 (+ 2061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:34.911750 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:34.911750 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:17:34.911758 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:34.913165 (+ 1407us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:34.913667 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:34.913668 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:34.913669 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:34.913740 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:34.914018 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:34.914020 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:34.914020 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:34.914147 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:34.914226 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:34.914526 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 08:17:34.914610 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260811 08:17:34.914904 19245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:34.905732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:34501 (local address 127.20.158.131:57763)
0811 08:17:34.905920 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:34.905959 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:34.906449 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:34.906670 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:34.906673 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:34.907346 (+ 673us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:17:34.907547 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:34.907552 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.908249 (+ 697us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.908250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:34.909277 (+ 1027us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:34.909280 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.909697 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.909698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:34.909806 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:34.910254 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:17:34.910261 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:17:34.911643 (+ 1382us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:17:34.913268 (+ 1625us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:17:34.913276 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:17:34.913278 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:17:34.913511 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:17:34.913823 (+ 312us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:17:34.913824 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:17:34.913824 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:17:34.913957 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:17:34.914229 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:17:34.914236 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:17:34.914381 (+ 145us) client_negotiation.cc:769] Sending connection context
0811 08:17:34.914488 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 08:17:34.914650 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":92,"threads_started":1}
I20260811 08:17:34.915381 19243 heartbeater.cc:347] Connected to a master server at 127.20.158.190:34501
I20260811 08:17:34.915491 19243 heartbeater.cc:464] Registering TS with master...
I20260811 08:17:34.915693 19243 heartbeater.cc:511] Master 127.20.158.190:34501 requested a full tablet report, sending...
I20260811 08:17:34.916066 18507 ts_manager.cc:194] Registered new tserver with Master: c5714d0990f243aaab55ef22a7368595 (127.20.158.131:40643)
I20260811 08:17:34.916414 18507 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.20.158.131@KRBTEST.COM'} at 127.20.158.131:57763
I20260811 08:17:34.925731 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:17:34.933079 18589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:34.927073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38088 (local address 127.20.158.190:34501)
0811 08:17:34.927182 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:34.927184 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:34.927271 (+ 87us) server_negotiation.cc:407] Connection header received
0811 08:17:34.927345 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:34.927346 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:34.927356 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:34.927412 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:34.927989 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.928479 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.929247 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.929445 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.929524 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:34.930697 (+ 1173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:34.930698 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:34.930698 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:17:34.930706 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:34.931851 (+ 1145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:34.932214 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:34.932216 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:34.932216 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:34.932279 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:34.932481 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:34.932482 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:34.932482 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:34.932639 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:34.932746 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:34.932881 (+ 135us) server_negotiation.cc:299] Negotiation successful
0811 08:17:34.932973 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260811 08:17:34.934938 18507 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38088:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:17:34.936878 18507 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:17:34.944336 19261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:34.940091 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35920 (local address 127.20.158.129:36403)
0811 08:17:34.940503 (+ 412us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:34.940508 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:34.940518 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:17:34.940555 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:34.940557 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:34.940572 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:34.940648 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:34.940793 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.942040 (+ 1247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.943219 (+ 1179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.943895 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.943984 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:34.944044 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:34.944210 (+ 166us) server_negotiation.cc:299] Negotiation successful
0811 08:17:34.944250 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":367,"thread_start_us":95,"threads_started":1}
I20260811 08:17:34.944331 19260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:34.939955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:36403 (local address 127.0.0.1:35920)
0811 08:17:34.940278 (+ 323us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:34.940289 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:34.940342 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:34.940662 (+ 320us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:34.940663 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:34.940664 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:34.940713 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:34.940714 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.942168 (+ 1454us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.942169 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:34.943129 (+ 960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:34.943132 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.943980 (+ 848us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.943981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:34.944063 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:34.944077 (+ 14us) client_negotiation.cc:769] Sending connection context
0811 08:17:34.944190 (+ 113us) client_negotiation.cc:240] Negotiation successful
0811 08:17:34.944246 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":302,"thread_start_us":76,"threads_started":1}
I20260811 08:17:34.944496 19258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:34.939843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44852 (local address 127.20.158.130:36501)
0811 08:17:34.940129 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:34.940134 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:34.940146 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:17:34.940187 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:34.940190 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:34.940206 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:34.940290 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:34.940605 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.941702 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.943288 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.943999 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.944049 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:34.944113 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:34.944361 (+ 248us) server_negotiation.cc:299] Negotiation successful
0811 08:17:34.944409 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":252,"thread_start_us":98,"threads_started":1}
I20260811 08:17:34.944644 19263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:34.940141 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:40643 (local address 127.0.0.1:41358)
0811 08:17:34.940404 (+ 263us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:34.940415 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:34.940464 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:34.940993 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:34.940994 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:34.940996 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:34.941047 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:34.941048 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.942393 (+ 1345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.942394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:34.943442 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:34.943444 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.944406 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.944407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:34.944462 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:34.944465 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:17:34.944516 (+ 51us) client_negotiation.cc:240] Negotiation successful
0811 08:17:34.944557 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":74,"threads_started":1}
I20260811 08:17:34.944715 19257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:34.939686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:36501 (local address 127.0.0.1:44852)
0811 08:17:34.939867 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:34.939911 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:34.939998 (+ 87us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:34.940457 (+ 459us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:34.940460 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:34.940463 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:34.940538 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:34.940541 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.941830 (+ 1289us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.941831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:34.943183 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:34.943186 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.944181 (+ 995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.944182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:34.944260 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:34.944264 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:17:34.944581 (+ 317us) client_negotiation.cc:240] Negotiation successful
0811 08:17:34.944619 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":107,"threads_started":1}
I20260811 08:17:34.944904 19265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:34.940253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41358 (local address 127.20.158.131:40643)
0811 08:17:34.940782 (+ 529us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:34.940786 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:34.940795 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:17:34.940831 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:34.940833 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:34.940847 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:34.940923 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:34.941166 (+ 243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.942288 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.943554 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:34.944265 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:34.944326 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:34.944375 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:34.944747 (+ 372us) server_negotiation.cc:299] Negotiation successful
0811 08:17:34.944789 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":108,"threads_started":1}
I20260811 08:17:34.945498 18919 tablet_service.cc:1467] Processing CreateTablet for tablet e07e13bb56a9424db5748e9faf4e859f (DEFAULT_TABLE table=test-table [id=3decadbe474240baa2c5c4bdaa7b886f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:17:34.945608 19140 tablet_service.cc:1467] Processing CreateTablet for tablet e07e13bb56a9424db5748e9faf4e859f (DEFAULT_TABLE table=test-table [id=3decadbe474240baa2c5c4bdaa7b886f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:17:34.945770 18700 tablet_service.cc:1467] Processing CreateTablet for tablet e07e13bb56a9424db5748e9faf4e859f (DEFAULT_TABLE table=test-table [id=3decadbe474240baa2c5c4bdaa7b886f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:17:34.945938 18919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e07e13bb56a9424db5748e9faf4e859f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:34.946010 19140 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e07e13bb56a9424db5748e9faf4e859f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:34.946085 18700 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e07e13bb56a9424db5748e9faf4e859f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:34.948536 19266 tablet_bootstrap.cc:492] T e07e13bb56a9424db5748e9faf4e859f P c5714d0990f243aaab55ef22a7368595: Bootstrap starting.
I20260811 08:17:34.949329 19266 tablet_bootstrap.cc:654] T e07e13bb56a9424db5748e9faf4e859f P c5714d0990f243aaab55ef22a7368595: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:34.949378 19267 tablet_bootstrap.cc:492] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79: Bootstrap starting.
I20260811 08:17:34.949607 19269 tablet_bootstrap.cc:492] T e07e13bb56a9424db5748e9faf4e859f P e597377f1bf7492e967dac84450d2530: Bootstrap starting.
I20260811 08:17:34.950109 19267 tablet_bootstrap.cc:654] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:34.950186 19269 tablet_bootstrap.cc:654] T e07e13bb56a9424db5748e9faf4e859f P e597377f1bf7492e967dac84450d2530: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:34.950173 19266 log.cc:824] T e07e13bb56a9424db5748e9faf4e859f P c5714d0990f243aaab55ef22a7368595: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:34.950680 19267 log.cc:824] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:34.950827 19269 log.cc:824] T e07e13bb56a9424db5748e9faf4e859f P e597377f1bf7492e967dac84450d2530: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:34.951210 19266 tablet_bootstrap.cc:492] T e07e13bb56a9424db5748e9faf4e859f P c5714d0990f243aaab55ef22a7368595: No bootstrap required, opened a new log
I20260811 08:17:34.951289 19266 ts_tablet_manager.cc:1397] T e07e13bb56a9424db5748e9faf4e859f P c5714d0990f243aaab55ef22a7368595: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260811 08:17:34.951462 19267 tablet_bootstrap.cc:492] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79: No bootstrap required, opened a new log
I20260811 08:17:34.951541 19267 ts_tablet_manager.cc:1397] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:17:34.952879 19266 raft_consensus.cc:348] T e07e13bb56a9424db5748e9faf4e859f P c5714d0990f243aaab55ef22a7368595 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11a65e87f4442258644c7e13c7edb79" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36501 } } peers { permanent_uuid: "e597377f1bf7492e967dac84450d2530" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 36403 } } peers { permanent_uuid: "c5714d0990f243aaab55ef22a7368595" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 40643 } }
I20260811 08:17:34.953019 19266 raft_consensus.cc:374] T e07e13bb56a9424db5748e9faf4e859f P c5714d0990f243aaab55ef22a7368595 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:34.953042 19266 raft_consensus.cc:729] T e07e13bb56a9424db5748e9faf4e859f P c5714d0990f243aaab55ef22a7368595 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5714d0990f243aaab55ef22a7368595, State: Initialized, Role: FOLLOWER
I20260811 08:17:34.953011 19267 raft_consensus.cc:348] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11a65e87f4442258644c7e13c7edb79" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36501 } } peers { permanent_uuid: "e597377f1bf7492e967dac84450d2530" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 36403 } } peers { permanent_uuid: "c5714d0990f243aaab55ef22a7368595" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 40643 } }
I20260811 08:17:34.953176 19266 consensus_queue.cc:260] T e07e13bb56a9424db5748e9faf4e859f P c5714d0990f243aaab55ef22a7368595 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11a65e87f4442258644c7e13c7edb79" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36501 } } peers { permanent_uuid: "e597377f1bf7492e967dac84450d2530" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 36403 } } peers { permanent_uuid: "c5714d0990f243aaab55ef22a7368595" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 40643 } }
I20260811 08:17:34.953218 19267 raft_consensus.cc:374] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:34.953260 19267 raft_consensus.cc:729] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b11a65e87f4442258644c7e13c7edb79, State: Initialized, Role: FOLLOWER
I20260811 08:17:34.953378 19267 consensus_queue.cc:260] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11a65e87f4442258644c7e13c7edb79" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36501 } } peers { permanent_uuid: "e597377f1bf7492e967dac84450d2530" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 36403 } } peers { permanent_uuid: "c5714d0990f243aaab55ef22a7368595" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 40643 } }
I20260811 08:17:34.953470 19266 ts_tablet_manager.cc:1428] T e07e13bb56a9424db5748e9faf4e859f P c5714d0990f243aaab55ef22a7368595: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 08:17:34.953518 19243 heartbeater.cc:503] Master 127.20.158.190:34501 was elected leader, sending a full tablet report...
I20260811 08:17:34.953739 19267 ts_tablet_manager.cc:1428] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260811 08:17:34.953804 19035 heartbeater.cc:503] Master 127.20.158.190:34501 was elected leader, sending a full tablet report...
I20260811 08:17:34.954169 19269 tablet_bootstrap.cc:492] T e07e13bb56a9424db5748e9faf4e859f P e597377f1bf7492e967dac84450d2530: No bootstrap required, opened a new log
I20260811 08:17:34.954246 19269 ts_tablet_manager.cc:1397] T e07e13bb56a9424db5748e9faf4e859f P e597377f1bf7492e967dac84450d2530: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260811 08:17:34.955935 19269 raft_consensus.cc:348] T e07e13bb56a9424db5748e9faf4e859f P e597377f1bf7492e967dac84450d2530 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11a65e87f4442258644c7e13c7edb79" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36501 } } peers { permanent_uuid: "e597377f1bf7492e967dac84450d2530" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 36403 } } peers { permanent_uuid: "c5714d0990f243aaab55ef22a7368595" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 40643 } }
I20260811 08:17:34.956082 19269 raft_consensus.cc:374] T e07e13bb56a9424db5748e9faf4e859f P e597377f1bf7492e967dac84450d2530 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:34.956107 19269 raft_consensus.cc:729] T e07e13bb56a9424db5748e9faf4e859f P e597377f1bf7492e967dac84450d2530 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e597377f1bf7492e967dac84450d2530, State: Initialized, Role: FOLLOWER
I20260811 08:17:34.956228 19269 consensus_queue.cc:260] T e07e13bb56a9424db5748e9faf4e859f P e597377f1bf7492e967dac84450d2530 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11a65e87f4442258644c7e13c7edb79" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36501 } } peers { permanent_uuid: "e597377f1bf7492e967dac84450d2530" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 36403 } } peers { permanent_uuid: "c5714d0990f243aaab55ef22a7368595" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 40643 } }
I20260811 08:17:34.956535 19269 ts_tablet_manager.cc:1428] T e07e13bb56a9424db5748e9faf4e859f P e597377f1bf7492e967dac84450d2530: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260811 08:17:34.956576 18803 heartbeater.cc:503] Master 127.20.158.190:34501 was elected leader, sending a full tablet report...
W20260811 08:17:34.990918 19037 tablet.cc:2369] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260811 08:17:35.071395 18806 tablet.cc:2369] T e07e13bb56a9424db5748e9faf4e859f P e597377f1bf7492e967dac84450d2530: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:17:35.154666 19277 raft_consensus.cc:482] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:17:35.154834 19277 raft_consensus.cc:504] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11a65e87f4442258644c7e13c7edb79" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36501 } } peers { permanent_uuid: "e597377f1bf7492e967dac84450d2530" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 36403 } } peers { permanent_uuid: "c5714d0990f243aaab55ef22a7368595" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 40643 } }
I20260811 08:17:35.155455 19277 leader_election.cc:288] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e597377f1bf7492e967dac84450d2530 (127.20.158.129:36403), c5714d0990f243aaab55ef22a7368595 (127.20.158.131:40643)
W20260811 08:17:35.155529 19244 tablet.cc:2369] T e07e13bb56a9424db5748e9faf4e859f P c5714d0990f243aaab55ef22a7368595: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260811 08:17:35.160045 19265 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:35.155958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:51529 (local address 127.20.158.131:40643)
0811 08:17:35.156043 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:35.156046 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:35.156109 (+ 63us) server_negotiation.cc:407] Connection header received
0811 08:17:35.156191 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:35.156192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:35.156201 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:35.156285 (+ 84us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:35.156435 (+ 150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.157200 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.158938 (+ 1738us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.159608 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.159708 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:35.159718 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:35.159920 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 08:17:35.159966 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260811 08:17:35.160045 19261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:35.155807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:41209 (local address 127.20.158.129:36403)
0811 08:17:35.155870 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:35.155874 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:35.155888 (+ 14us) server_negotiation.cc:407] Connection header received
0811 08:17:35.155929 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:35.155930 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:35.155943 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:35.156086 (+ 143us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:35.156276 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.157160 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.158938 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.159600 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.159707 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:35.159718 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:35.159920 (+ 202us) server_negotiation.cc:299] Negotiation successful
0811 08:17:35.159971 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 08:17:35.160084 19039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:35.155732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:36403 (local address 127.20.158.130:41209)
0811 08:17:35.155785 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:35.155797 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:35.155847 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:35.156093 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:35.156094 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:35.156096 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:35.156180 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:35.156182 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.157319 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.157320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:35.158797 (+ 1477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:35.158801 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.159730 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.159731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:35.159825 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:35.159827 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:17:35.159896 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 08:17:35.159954 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30,"mutex_wait_us":92}
I20260811 08:17:35.160091 19279 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:35.155866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:40643 (local address 127.20.158.130:51529)
0811 08:17:35.156041 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:35.156053 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:35.156111 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:35.156307 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:35.156307 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:35.156309 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:35.156355 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:35.156355 (+ 0us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.157319 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.157320 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:35.158797 (+ 1477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:35.158801 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.159730 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.159731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:35.159822 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:35.159827 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:17:35.159896 (+ 69us) client_negotiation.cc:240] Negotiation successful
0811 08:17:35.159954 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":149,"thread_start_us":121,"threads_started":1}
I20260811 08:17:35.160557 18728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e07e13bb56a9424db5748e9faf4e859f" candidate_uuid: "b11a65e87f4442258644c7e13c7edb79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e597377f1bf7492e967dac84450d2530" is_pre_election: true
I20260811 08:17:35.160763 18728 raft_consensus.cc:2454] T e07e13bb56a9424db5748e9faf4e859f P e597377f1bf7492e967dac84450d2530 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b11a65e87f4442258644c7e13c7edb79 in term 0.
I20260811 08:17:35.160781 19172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e07e13bb56a9424db5748e9faf4e859f" candidate_uuid: "b11a65e87f4442258644c7e13c7edb79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5714d0990f243aaab55ef22a7368595" is_pre_election: true
I20260811 08:17:35.160929 19172 raft_consensus.cc:2454] T e07e13bb56a9424db5748e9faf4e859f P c5714d0990f243aaab55ef22a7368595 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b11a65e87f4442258644c7e13c7edb79 in term 0.
I20260811 08:17:35.161056 18838 leader_election.cc:302] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b11a65e87f4442258644c7e13c7edb79, e597377f1bf7492e967dac84450d2530; no voters:
I20260811 08:17:35.161216 19277 raft_consensus.cc:2781] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:17:35.161275 19277 raft_consensus.cc:482] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:17:35.161301 19277 raft_consensus.cc:3037] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:35.162145 19277 raft_consensus.cc:504] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11a65e87f4442258644c7e13c7edb79" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36501 } } peers { permanent_uuid: "e597377f1bf7492e967dac84450d2530" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 36403 } } peers { permanent_uuid: "c5714d0990f243aaab55ef22a7368595" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 40643 } }
I20260811 08:17:35.162293 19277 leader_election.cc:288] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79 [CANDIDATE]: Term 1 election: Requested vote from peers e597377f1bf7492e967dac84450d2530 (127.20.158.129:36403), c5714d0990f243aaab55ef22a7368595 (127.20.158.131:40643)
I20260811 08:17:35.162513 18728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e07e13bb56a9424db5748e9faf4e859f" candidate_uuid: "b11a65e87f4442258644c7e13c7edb79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e597377f1bf7492e967dac84450d2530"
I20260811 08:17:35.162514 19172 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e07e13bb56a9424db5748e9faf4e859f" candidate_uuid: "b11a65e87f4442258644c7e13c7edb79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c5714d0990f243aaab55ef22a7368595"
I20260811 08:17:35.162626 19172 raft_consensus.cc:3037] T e07e13bb56a9424db5748e9faf4e859f P c5714d0990f243aaab55ef22a7368595 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:35.162626 18728 raft_consensus.cc:3037] T e07e13bb56a9424db5748e9faf4e859f P e597377f1bf7492e967dac84450d2530 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:35.163645 19172 raft_consensus.cc:2454] T e07e13bb56a9424db5748e9faf4e859f P c5714d0990f243aaab55ef22a7368595 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b11a65e87f4442258644c7e13c7edb79 in term 1.
I20260811 08:17:35.163645 18728 raft_consensus.cc:2454] T e07e13bb56a9424db5748e9faf4e859f P e597377f1bf7492e967dac84450d2530 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b11a65e87f4442258644c7e13c7edb79 in term 1.
I20260811 08:17:35.163885 18838 leader_election.cc:302] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b11a65e87f4442258644c7e13c7edb79, c5714d0990f243aaab55ef22a7368595; no voters:
I20260811 08:17:35.164007 19277 raft_consensus.cc:2781] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:17:35.164222 19277 raft_consensus.cc:686] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79 [term 1 LEADER]: Becoming Leader. State: Replica: b11a65e87f4442258644c7e13c7edb79, State: Running, Role: LEADER
I20260811 08:17:35.164335 19277 consensus_queue.cc:237] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11a65e87f4442258644c7e13c7edb79" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36501 } } peers { permanent_uuid: "e597377f1bf7492e967dac84450d2530" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 36403 } } peers { permanent_uuid: "c5714d0990f243aaab55ef22a7368595" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 40643 } }
I20260811 08:17:35.165313 18507 catalog_manager.cc:5495] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79 reported cstate change: term changed from 0 to 1, leader changed from <none> to b11a65e87f4442258644c7e13c7edb79 (127.20.158.130). New cstate: current_term: 1 leader_uuid: "b11a65e87f4442258644c7e13c7edb79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b11a65e87f4442258644c7e13c7edb79" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 36501 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e597377f1bf7492e967dac84450d2530" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 36403 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c5714d0990f243aaab55ef22a7368595" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 40643 } health_report { overall_health: UNKNOWN } } }
I20260811 08:17:35.176844 19258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:35.173376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44858 (local address 127.20.158.130:36501)
0811 08:17:35.173419 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:35.173421 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:35.173909 (+ 488us) server_negotiation.cc:407] Connection header received
0811 08:17:35.173987 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:35.173988 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:35.174009 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:35.174109 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:17:35.174269 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.174904 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.176005 (+ 1101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.176212 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.176290 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:35.176482 (+ 192us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:17:35.176601 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:17:35.176721 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:35.176739 (+ 18us) server_negotiation.cc:299] Negotiation successful
0811 08:17:35.176760 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 08:17:35.178860 18728 raft_consensus.cc:1261] T e07e13bb56a9424db5748e9faf4e859f P e597377f1bf7492e967dac84450d2530 [term 1 FOLLOWER]: Refusing update from remote peer b11a65e87f4442258644c7e13c7edb79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:17:35.178860 19172 raft_consensus.cc:1261] T e07e13bb56a9424db5748e9faf4e859f P c5714d0990f243aaab55ef22a7368595 [term 1 FOLLOWER]: Refusing update from remote peer b11a65e87f4442258644c7e13c7edb79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:17:35.179246 19277 consensus_queue.cc:1035] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e597377f1bf7492e967dac84450d2530" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 36403 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:17:35.179422 19280 consensus_queue.cc:1035] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c5714d0990f243aaab55ef22a7368595" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 40643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:17:35.184427 18508 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38088:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:17:35.184516 18508 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:38088:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:17:35.185277 18508 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5cc335fc143a411f847fa8175fafb5c3: Sending DeleteTablet for 3 replicas of tablet e07e13bb56a9424db5748e9faf4e859f
I20260811 08:17:35.185621 18919 tablet_service.cc:1514] Processing DeleteTablet for tablet e07e13bb56a9424db5748e9faf4e859f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:17:35 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:44852
I20260811 08:17:35.185681 18700 tablet_service.cc:1514] Processing DeleteTablet for tablet e07e13bb56a9424db5748e9faf4e859f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:17:35 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:35920
I20260811 08:17:35.185875 19298 tablet_replica.cc:330] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79: stopping tablet replica
I20260811 08:17:35.185974 19298 raft_consensus.cc:2229] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79 [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:17:35.186002 19140 tablet_service.cc:1514] Processing DeleteTablet for tablet e07e13bb56a9424db5748e9faf4e859f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:17:35 UTC) from {username='kudu', principal='kudu/127.20.158.190@KRBTEST.COM'} at 127.0.0.1:41358
I20260811 08:17:35.186066 19298 raft_consensus.cc:2258] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:17:35.186118 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 18605
I20260811 08:17:35.204845 19298 ts_tablet_manager.cc:1905] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:17:35.207134 19298 ts_tablet_manager.cc:1918] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:17:35.207221 19298 log.cc:1196] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-1/wal/wals/e07e13bb56a9424db5748e9faf4e859f
I20260811 08:17:35.207464 19298 ts_tablet_manager.cc:1939] T e07e13bb56a9424db5748e9faf4e859f P b11a65e87f4442258644c7e13c7edb79: Deleting consensus metadata
I20260811 08:17:35.208474 18482 catalog_manager.cc:4841] TS b11a65e87f4442258644c7e13c7edb79 (127.20.158.130:36501): tablet e07e13bb56a9424db5748e9faf4e859f (table test-table [id=3decadbe474240baa2c5c4bdaa7b886f]) successfully deleted
I20260811 08:17:35.213742 19301 tablet_replica.cc:330] T e07e13bb56a9424db5748e9faf4e859f P c5714d0990f243aaab55ef22a7368595: stopping tablet replica
I20260811 08:17:35.213922 19301 raft_consensus.cc:2229] T e07e13bb56a9424db5748e9faf4e859f P c5714d0990f243aaab55ef22a7368595 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:17:35.214068 19301 raft_consensus.cc:2258] T e07e13bb56a9424db5748e9faf4e859f P c5714d0990f243aaab55ef22a7368595 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:17:35.214563 19301 ts_tablet_manager.cc:1905] T e07e13bb56a9424db5748e9faf4e859f P c5714d0990f243aaab55ef22a7368595: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260811 08:17:35.216589 18482 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.158.129:36403 (error 108)
I20260811 08:17:35.216738 19301 ts_tablet_manager.cc:1918] T e07e13bb56a9424db5748e9faf4e859f P c5714d0990f243aaab55ef22a7368595: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:17:35.216822 19301 log.cc:1196] T e07e13bb56a9424db5748e9faf4e859f P c5714d0990f243aaab55ef22a7368595: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786436003833085-21114-0/minicluster-data/ts-2/wal/wals/e07e13bb56a9424db5748e9faf4e859f
I20260811 08:17:35.216876 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 18815
I20260811 08:17:35.221179 19301 ts_tablet_manager.cc:1939] T e07e13bb56a9424db5748e9faf4e859f P c5714d0990f243aaab55ef22a7368595: Deleting consensus metadata
I20260811 08:17:35.223651 18482 catalog_manager.cc:4841] TS c5714d0990f243aaab55ef22a7368595 (127.20.158.131:40643): tablet e07e13bb56a9424db5748e9faf4e859f (table test-table [id=3decadbe474240baa2c5c4bdaa7b886f]) successfully deleted
I20260811 08:17:35.226140 19257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:35.225955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:36403 (local address 127.0.0.1:35926)
0811 08:17:35.226023 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:35.226103 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.129:36403: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
W20260811 08:17:35.226310 18482 catalog_manager.cc:4584] TS e597377f1bf7492e967dac84450d2530 (127.20.158.129:36403): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e07e13bb56a9424db5748e9faf4e859f: Network error: Client connection negotiation failed: client connection to 127.20.158.129:36403: connect: Connection refused (error 111)
I20260811 08:17:35.228772 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 19043
I20260811 08:17:35.246587 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 18449
2026-08-11T08:17:35Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2432 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-11T08:17:35Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:17:35Z Disabled control of system clock
I20260811 08:17:35.283911 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:33193
--webserver_interface=127.20.158.190
--webserver_port=0
--builtin_ntp_servers=127.20.158.148:33987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:33193
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 08:17:35.367751 19308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:35.367996 19308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:35.368017 19308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:35.369235 19308 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:17:35.369282 19308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:35.369297 19308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:35.369341 19308 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:17:35.369371 19308 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:17:35.370750 19308 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:33987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:33193
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:33193
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19308
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:35.371022 19308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:35.371349 19308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:17:35.376655 19308 server_base.cc:1034] running on GCE node
W20260811 08:17:35.376592 19320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:35.376626 19316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:35.376621 19314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:35.377049 19308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:35.377377 19308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:35.378561 19308 hybrid_clock.cc:648] HybridClock initialized: now 1786436255378545 us; error 39 us; skew 500 ppm
I20260811 08:17:35.379887 19308 webserver.cc:460] Webserver started at http://127.20.158.190:32887/ using document root <none> and password file <none>
I20260811 08:17:35.380143 19308 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:35.380237 19308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:35.380395 19308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:35.381511 19308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "32ac70f763df4d279f64cd37984d7669"
format_stamp: "Formatted at 2026-08-11 08:17:35 on dist-test-slave-gkw7"
server_key: "5eb0e685dbe979ad0283d5d7389d6151"
server_key_iv: "dc3715b866f1679ca970c014c4ff8a7e"
server_key_version: "encryptionkey@0"
I20260811 08:17:35.381973 19308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "32ac70f763df4d279f64cd37984d7669"
format_stamp: "Formatted at 2026-08-11 08:17:35 on dist-test-slave-gkw7"
server_key: "5eb0e685dbe979ad0283d5d7389d6151"
server_key_iv: "dc3715b866f1679ca970c014c4ff8a7e"
server_key_version: "encryptionkey@0"
I20260811 08:17:35.383373 19308 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:17:35.384222 19335 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:35.384423 19308 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:17:35.384527 19308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "32ac70f763df4d279f64cd37984d7669"
format_stamp: "Formatted at 2026-08-11 08:17:35 on dist-test-slave-gkw7"
server_key: "5eb0e685dbe979ad0283d5d7389d6151"
server_key_iv: "dc3715b866f1679ca970c014c4ff8a7e"
server_key_version: "encryptionkey@0"
I20260811 08:17:35.384627 19308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:35.401078 19308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:35.401453 19308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:35.401649 19308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:35.405902 19308 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:33193
I20260811 08:17:35.405941 19419 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:33193 every 8 connection(s)
I20260811 08:17:35.406301 19308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:17:35.407420 19423 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:35.408969 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 19308
I20260811 08:17:35.409087 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:17:35.409322 21114 external_mini_cluster.cc:1428] Setting key 749accaff1c3538728a9fffd12b74b7b
I20260811 08:17:35.410245 19423 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32ac70f763df4d279f64cd37984d7669: Bootstrap starting.
I20260811 08:17:35.410897 19423 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32ac70f763df4d279f64cd37984d7669: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:35.411247 19423 log.cc:824] T 00000000000000000000000000000000 P 32ac70f763df4d279f64cd37984d7669: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:35.411985 19423 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32ac70f763df4d279f64cd37984d7669: No bootstrap required, opened a new log
I20260811 08:17:35.413930 19423 raft_consensus.cc:348] T 00000000000000000000000000000000 P 32ac70f763df4d279f64cd37984d7669 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32ac70f763df4d279f64cd37984d7669" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 33193 } }
I20260811 08:17:35.414137 19423 raft_consensus.cc:374] T 00000000000000000000000000000000 P 32ac70f763df4d279f64cd37984d7669 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:35.414202 19423 raft_consensus.cc:729] T 00000000000000000000000000000000 P 32ac70f763df4d279f64cd37984d7669 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32ac70f763df4d279f64cd37984d7669, State: Initialized, Role: FOLLOWER
I20260811 08:17:35.414330 19423 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32ac70f763df4d279f64cd37984d7669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32ac70f763df4d279f64cd37984d7669" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 33193 } }
I20260811 08:17:35.414443 19423 raft_consensus.cc:388] T 00000000000000000000000000000000 P 32ac70f763df4d279f64cd37984d7669 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:17:35.414489 19423 raft_consensus.cc:482] T 00000000000000000000000000000000 P 32ac70f763df4d279f64cd37984d7669 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:17:35.414541 19423 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 32ac70f763df4d279f64cd37984d7669 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:35.415094 19429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:35.409959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39830 (local address 127.20.158.190:33193)
0811 08:17:35.410177 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:35.410185 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:35.410211 (+ 26us) server_negotiation.cc:407] Connection header received
0811 08:17:35.410677 (+ 466us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:35.410685 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:35.410749 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:35.410872 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:35.411143 (+ 271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.412075 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.412879 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.413311 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.413447 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:35.414223 (+ 776us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:35.414232 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:35.414232 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:35.414433 (+ 201us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:35.414487 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:35.414501 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:35.414561 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:35.414796 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 08:17:35.414879 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":86,"threads_started":1}
I20260811 08:17:35.415266 19423 raft_consensus.cc:504] T 00000000000000000000000000000000 P 32ac70f763df4d279f64cd37984d7669 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32ac70f763df4d279f64cd37984d7669" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 33193 } }
I20260811 08:17:35.415375 19423 leader_election.cc:302] T 00000000000000000000000000000000 P 32ac70f763df4d279f64cd37984d7669 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 32ac70f763df4d279f64cd37984d7669; no voters:
I20260811 08:17:35.415575 19423 leader_election.cc:288] T 00000000000000000000000000000000 P 32ac70f763df4d279f64cd37984d7669 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:17:35.415643 19432 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 32ac70f763df4d279f64cd37984d7669 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:17:35.415843 19423 sys_catalog.cc:564] T 00000000000000000000000000000000 P 32ac70f763df4d279f64cd37984d7669 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:17:35.415931 19432 raft_consensus.cc:686] T 00000000000000000000000000000000 P 32ac70f763df4d279f64cd37984d7669 [term 1 LEADER]: Becoming Leader. State: Replica: 32ac70f763df4d279f64cd37984d7669, State: Running, Role: LEADER
I20260811 08:17:35.416029 19432 consensus_queue.cc:237] T 00000000000000000000000000000000 P 32ac70f763df4d279f64cd37984d7669 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32ac70f763df4d279f64cd37984d7669" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 33193 } }
I20260811 08:17:35.416371 19432 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32ac70f763df4d279f64cd37984d7669 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 32ac70f763df4d279f64cd37984d7669. Latest consensus state: current_term: 1 leader_uuid: "32ac70f763df4d279f64cd37984d7669" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32ac70f763df4d279f64cd37984d7669" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 33193 } } }
I20260811 08:17:35.416452 19432 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32ac70f763df4d279f64cd37984d7669 [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:35.416615 19436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32ac70f763df4d279f64cd37984d7669 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "32ac70f763df4d279f64cd37984d7669" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32ac70f763df4d279f64cd37984d7669" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 33193 } } }
I20260811 08:17:35.416700 19436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32ac70f763df4d279f64cd37984d7669 [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:35.416822 19447 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:17:35.417495 19447 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:17:35.419256 19447 catalog_manager.cc:1347] Generated new cluster ID: 0d9029b4bd3d43eb99e323fd2bd05bdc
I20260811 08:17:35.419317 19447 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:17:35.426421 19447 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:17:35.427146 19447 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:17:35.447263 19447 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 32ac70f763df4d279f64cd37984d7669: Generated new TSK 0
I20260811 08:17:35.447520 19447 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:17:35.449307 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.129:0
--local_ip_for_outbound_sockets=127.20.158.129
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:33193
--builtin_ntp_servers=127.20.158.148:33987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 08:17:35.549726 19467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:35.549981 19467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:35.550020 19467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:35.551194 19467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:35.551276 19467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:35.551321 19467 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.129
I20260811 08:17:35.552711 19467 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:33987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.20.158.129
--webserver_port=0
--tserver_master_addrs=127.20.158.190:33193
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19467
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.129
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:35.552997 19467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:35.553328 19467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:35.558643 19474 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:35.558629 19477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:35.558630 19480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:35.559376 19467 server_base.cc:1034] running on GCE node
I20260811 08:17:35.559593 19467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:35.559859 19467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:35.561030 19467 hybrid_clock.cc:648] HybridClock initialized: now 1786436255561016 us; error 34 us; skew 500 ppm
I20260811 08:17:35.562443 19467 webserver.cc:460] Webserver started at http://127.20.158.129:39803/ using document root <none> and password file <none>
I20260811 08:17:35.562743 19467 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:35.562819 19467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:35.563041 19467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:35.564167 19467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-0/data/instance:
uuid: "59fb3c4a5a75480fa3e80c022dd5392e"
format_stamp: "Formatted at 2026-08-11 08:17:35 on dist-test-slave-gkw7"
server_key: "e85f09b8e9603ca2b6087c15b284cced"
server_key_iv: "ab9b91dd2bbc347eb98ad0c7f12a27b8"
server_key_version: "encryptionkey@0"
I20260811 08:17:35.564556 19467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance:
uuid: "59fb3c4a5a75480fa3e80c022dd5392e"
format_stamp: "Formatted at 2026-08-11 08:17:35 on dist-test-slave-gkw7"
server_key: "e85f09b8e9603ca2b6087c15b284cced"
server_key_iv: "ab9b91dd2bbc347eb98ad0c7f12a27b8"
server_key_version: "encryptionkey@0"
I20260811 08:17:35.566041 19467 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:17:35.566874 19491 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:35.567044 19467 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:17:35.567157 19467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-0/wal
uuid: "59fb3c4a5a75480fa3e80c022dd5392e"
format_stamp: "Formatted at 2026-08-11 08:17:35 on dist-test-slave-gkw7"
server_key: "e85f09b8e9603ca2b6087c15b284cced"
server_key_iv: "ab9b91dd2bbc347eb98ad0c7f12a27b8"
server_key_version: "encryptionkey@0"
I20260811 08:17:35.567238 19467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:35.576156 19467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:35.576465 19467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:35.576615 19467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:35.576846 19467 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:17:35.577180 19467 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:17:35.577242 19467 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:35.577286 19467 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:17:35.577313 19467 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:35.583545 19467 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.129:39327
I20260811 08:17:35.583595 19668 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.129:39327 every 8 connection(s)
I20260811 08:17:35.583987 19467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-0/data/info.pb
I20260811 08:17:35.586182 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 19467
I20260811 08:17:35.586316 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-0/wal/instance
I20260811 08:17:35.586529 21114 external_mini_cluster.cc:1428] Setting key c2752392c34a16889c22563f98aee6c7
I20260811 08:17:35.587620 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.130:0
--local_ip_for_outbound_sockets=127.20.158.130
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:33193
--builtin_ntp_servers=127.20.158.148:33987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260811 08:17:35.590472 19429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:35.584758 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:58075 (local address 127.20.158.190:33193)
0811 08:17:35.584822 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:35.584824 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:35.585089 (+ 265us) server_negotiation.cc:407] Connection header received
0811 08:17:35.585689 (+ 600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:35.585690 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:35.585703 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:35.585761 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:35.586534 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.587188 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.588864 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.589054 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.589121 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:35.590147 (+ 1026us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:35.590149 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:35.590149 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:35.590155 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:35.590173 (+ 18us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:35.590178 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:35.590239 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:35.590337 (+ 98us) server_negotiation.cc:299] Negotiation successful
0811 08:17:35.590365 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 08:17:35.590590 19671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:35.584751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:33193 (local address 127.20.158.129:58075)
0811 08:17:35.584960 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:35.584994 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:35.585520 (+ 526us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:35.585835 (+ 315us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:35.585840 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:35.585856 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:17:35.586432 (+ 576us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:35.586445 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.587313 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.587314 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:35.588759 (+ 1445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:35.588763 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.589146 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.589147 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:35.589315 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:35.589988 (+ 673us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:17:35.589989 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:17:35.590017 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:17:35.590041 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:17:35.590249 (+ 208us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:17:35.590254 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:17:35.590257 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:17:35.590312 (+ 55us) client_negotiation.cc:240] Negotiation successful
0811 08:17:35.590396 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":94,"threads_started":1}
I20260811 08:17:35.591136 19669 heartbeater.cc:347] Connected to a master server at 127.20.158.190:33193
I20260811 08:17:35.591275 19669 heartbeater.cc:464] Registering TS with master...
I20260811 08:17:35.591465 19669 heartbeater.cc:511] Master 127.20.158.190:33193 requested a full tablet report, sending...
I20260811 08:17:35.592087 19359 ts_manager.cc:194] Registered new tserver with Master: 59fb3c4a5a75480fa3e80c022dd5392e (127.20.158.129:39327)
I20260811 08:17:35.593089 19359 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.158.129:58075
W20260811 08:17:35.672667 19672 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:35.672869 19672 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:35.672891 19672 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:35.674050 19672 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:35.674090 19672 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:35.674116 19672 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.130
I20260811 08:17:35.675400 19672 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:33987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.20.158.130
--webserver_port=0
--tserver_master_addrs=127.20.158.190:33193
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19672
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.130
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:35.675599 19672 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:35.675858 19672 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:35.681151 19679 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:35.681195 19678 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:35.681152 19681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:35.681408 19672 server_base.cc:1034] running on GCE node
I20260811 08:17:35.681715 19672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:35.681986 19672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:35.683166 19672 hybrid_clock.cc:648] HybridClock initialized: now 1786436255683148 us; error 47 us; skew 500 ppm
I20260811 08:17:35.684592 19672 webserver.cc:460] Webserver started at http://127.20.158.130:41669/ using document root <none> and password file <none>
I20260811 08:17:35.684897 19672 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:35.684973 19672 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:35.685142 19672 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:35.686293 19672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-1/data/instance:
uuid: "71a5392558d84299afea8f86a559d1a4"
format_stamp: "Formatted at 2026-08-11 08:17:35 on dist-test-slave-gkw7"
server_key: "676c6a68fae2b6d734ab29570e88acb9"
server_key_iv: "a74e63c0b9633da09f98226bfd0c34c3"
server_key_version: "encryptionkey@0"
I20260811 08:17:35.686682 19672 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance:
uuid: "71a5392558d84299afea8f86a559d1a4"
format_stamp: "Formatted at 2026-08-11 08:17:35 on dist-test-slave-gkw7"
server_key: "676c6a68fae2b6d734ab29570e88acb9"
server_key_iv: "a74e63c0b9633da09f98226bfd0c34c3"
server_key_version: "encryptionkey@0"
I20260811 08:17:35.688112 19672 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:17:35.688931 19691 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:35.689105 19672 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:17:35.689217 19672 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-1/wal
uuid: "71a5392558d84299afea8f86a559d1a4"
format_stamp: "Formatted at 2026-08-11 08:17:35 on dist-test-slave-gkw7"
server_key: "676c6a68fae2b6d734ab29570e88acb9"
server_key_iv: "a74e63c0b9633da09f98226bfd0c34c3"
server_key_version: "encryptionkey@0"
I20260811 08:17:35.689296 19672 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:35.715184 19672 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:35.715648 19672 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:35.715832 19672 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:35.716106 19672 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:17:35.716572 19672 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:17:35.716650 19672 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:35.716702 19672 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:17:35.716729 19672 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:35.728207 19672 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.130:46335
I20260811 08:17:35.728272 19878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.130:46335 every 8 connection(s)
I20260811 08:17:35.728665 19672 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-1/data/info.pb
I20260811 08:17:35.733846 19429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:35.729500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.130:41239 (local address 127.20.158.190:33193)
0811 08:17:35.729565 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:35.729567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:35.729800 (+ 233us) server_negotiation.cc:407] Connection header received
0811 08:17:35.730286 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:35.730287 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:35.730298 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:35.730366 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:35.731042 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.731551 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.732537 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.732722 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.732773 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:35.733589 (+ 816us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:35.733591 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:35.733591 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:35.733596 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:35.733612 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:35.733617 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:35.733672 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:35.733764 (+ 92us) server_negotiation.cc:299] Negotiation successful
0811 08:17:35.733786 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:17:35.734036 19887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:35.729441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:33193 (local address 127.20.158.130:41239)
0811 08:17:35.729660 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:35.729704 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:35.730198 (+ 494us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:35.730421 (+ 223us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:35.730425 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:35.730434 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:17:35.730960 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:35.730964 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.731639 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.731640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:35.732460 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:35.732462 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.732796 (+ 334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.732797 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:35.732904 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:35.733402 (+ 498us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:17:35.733403 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:17:35.733433 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:17:35.733456 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:17:35.733688 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:17:35.733693 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:17:35.733695 (+ 2us) client_negotiation.cc:769] Sending connection context
0811 08:17:35.733753 (+ 58us) client_negotiation.cc:240] Negotiation successful
0811 08:17:35.733835 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":121,"threads_started":1}
I20260811 08:17:35.734594 19880 heartbeater.cc:347] Connected to a master server at 127.20.158.190:33193
I20260811 08:17:35.734606 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 19672
I20260811 08:17:35.734707 19880 heartbeater.cc:464] Registering TS with master...
I20260811 08:17:35.734715 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-1/wal/instance
I20260811 08:17:35.734920 19880 heartbeater.cc:511] Master 127.20.158.190:33193 requested a full tablet report, sending...
I20260811 08:17:35.734929 21114 external_mini_cluster.cc:1428] Setting key 4d464042d0c89cfd1e81037d24a28693
I20260811 08:17:35.735409 19357 ts_manager.cc:194] Registered new tserver with Master: 71a5392558d84299afea8f86a559d1a4 (127.20.158.130:46335)
I20260811 08:17:35.735908 19357 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.158.130:41239
I20260811 08:17:35.736014 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.20.158.131:0
--local_ip_for_outbound_sockets=127.20.158.131
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:33193
--builtin_ntp_servers=127.20.158.148:33987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260811 08:17:35.820493 19888 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:35.820745 19888 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:35.820783 19888 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:35.821987 19888 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:35.822055 19888 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:35.822096 19888 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.20.158.131
I20260811 08:17:35.823470 19888 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:33987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.20.158.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.20.158.131
--webserver_port=0
--tserver_master_addrs=127.20.158.190:33193
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.19888
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.20.158.131
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:35.823753 19888 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:35.824059 19888 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:35.829224 19897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:35.829252 19900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:35.829278 19896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:35.829764 19888 server_base.cc:1034] running on GCE node
I20260811 08:17:35.830035 19888 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:35.830322 19888 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:35.831499 19888 hybrid_clock.cc:648] HybridClock initialized: now 1786436255831494 us; error 47 us; skew 500 ppm
I20260811 08:17:35.832893 19888 webserver.cc:460] Webserver started at http://127.20.158.131:38227/ using document root <none> and password file <none>
I20260811 08:17:35.833154 19888 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:35.833230 19888 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:35.833391 19888 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:35.834653 19888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-2/data/instance:
uuid: "476f055c775e44c8bb421290dca7a799"
format_stamp: "Formatted at 2026-08-11 08:17:35 on dist-test-slave-gkw7"
server_key: "5cf68730f6018d0907b0d160627e4fb5"
server_key_iv: "19d22a5f5ffeaa3da40a896bb65ee76f"
server_key_version: "encryptionkey@0"
I20260811 08:17:35.835017 19888 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance:
uuid: "476f055c775e44c8bb421290dca7a799"
format_stamp: "Formatted at 2026-08-11 08:17:35 on dist-test-slave-gkw7"
server_key: "5cf68730f6018d0907b0d160627e4fb5"
server_key_iv: "19d22a5f5ffeaa3da40a896bb65ee76f"
server_key_version: "encryptionkey@0"
I20260811 08:17:35.836431 19888 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260811 08:17:35.837335 19910 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:35.837580 19888 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:17:35.837723 19888 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-2/wal
uuid: "476f055c775e44c8bb421290dca7a799"
format_stamp: "Formatted at 2026-08-11 08:17:35 on dist-test-slave-gkw7"
server_key: "5cf68730f6018d0907b0d160627e4fb5"
server_key_iv: "19d22a5f5ffeaa3da40a896bb65ee76f"
server_key_version: "encryptionkey@0"
I20260811 08:17:35.837808 19888 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:35.856216 19888 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:35.856575 19888 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:35.856750 19888 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:35.857025 19888 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260811 08:17:35.857406 19888 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260811 08:17:35.857472 19888 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:35.857518 19888 ts_tablet_manager.cc:610] Registered 0 tablets
I20260811 08:17:35.857592 19888 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:35.864123 19888 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.131:33959
I20260811 08:17:35.864202 20095 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.131:33959 every 8 connection(s)
I20260811 08:17:35.864615 19888 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-2/data/info.pb
I20260811 08:17:35.870262 19429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:35.865584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.131:55009 (local address 127.20.158.190:33193)
0811 08:17:35.865635 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:35.865638 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:35.865983 (+ 345us) server_negotiation.cc:407] Connection header received
0811 08:17:35.866475 (+ 492us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:35.866477 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:35.866488 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:35.866546 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:35.867249 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.867800 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.868800 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.869008 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.869068 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:35.869943 (+ 875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:35.869944 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:35.869945 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:35.869949 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:35.869965 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:35.869969 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:35.870022 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:35.870129 (+ 107us) server_negotiation.cc:299] Negotiation successful
0811 08:17:35.870159 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:17:35.870486 20098 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:35.865525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:33193 (local address 127.20.158.131:55009)
0811 08:17:35.865837 (+ 312us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:35.865874 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:35.866374 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:35.866611 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:35.866614 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:35.866623 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:17:35.867149 (+ 526us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:35.867154 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.867894 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.867895 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:35.868699 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:35.868702 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.869090 (+ 388us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.869091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:35.869200 (+ 109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:35.869809 (+ 609us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0811 08:17:35.869810 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:17:35.869838 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0811 08:17:35.869862 (+ 24us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:17:35.870024 (+ 162us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:17:35.870026 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:17:35.870029 (+ 3us) client_negotiation.cc:769] Sending connection context
0811 08:17:35.870121 (+ 92us) client_negotiation.cc:240] Negotiation successful
0811 08:17:35.870223 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":185,"thread_start_us":97,"threads_started":1}
I20260811 08:17:35.871011 20096 heartbeater.cc:347] Connected to a master server at 127.20.158.190:33193
I20260811 08:17:35.871095 20096 heartbeater.cc:464] Registering TS with master...
I20260811 08:17:35.871284 20096 heartbeater.cc:511] Master 127.20.158.190:33193 requested a full tablet report, sending...
I20260811 08:17:35.871701 19357 ts_manager.cc:194] Registered new tserver with Master: 476f055c775e44c8bb421290dca7a799 (127.20.158.131:33959)
I20260811 08:17:35.872053 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 19888
I20260811 08:17:35.872186 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-2/wal/instance
I20260811 08:17:35.872318 19357 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.20.158.131:55009
I20260811 08:17:35.872447 21114 external_mini_cluster.cc:1428] Setting key 76dcad1adc2ba7232d9afb4a4854659f
I20260811 08:17:35.873392 21114 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260811 08:17:35.878253 19429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:35.874940 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39842 (local address 127.20.158.190:33193)
0811 08:17:35.875026 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:35.875029 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:35.875144 (+ 115us) server_negotiation.cc:407] Connection header received
0811 08:17:35.875227 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:35.875228 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:35.875240 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:35.875320 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:35.875503 (+ 183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.876018 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.876854 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.877070 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.877171 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:35.877986 (+ 815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:35.877988 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:35.877988 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:35.877993 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:35.878008 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:35.878013 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:35.878066 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:35.878131 (+ 65us) server_negotiation.cc:299] Negotiation successful
0811 08:17:35.878163 (+ 32us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260811 08:17:35.880229 19357 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:39842:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260811 08:17:35.881984 19357 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260811 08:17:35.888679 20108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:35.884220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:46335 (local address 127.0.0.1:36930)
0811 08:17:35.884399 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:35.884443 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:35.884514 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:35.884771 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:35.884774 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:35.884776 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:35.884919 (+ 143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:35.884922 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.886041 (+ 1119us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.886042 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:35.887235 (+ 1193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:35.887238 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.888334 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.888335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:35.888431 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:35.888447 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 08:17:35.888501 (+ 54us) client_negotiation.cc:240] Negotiation successful
0811 08:17:35.888564 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"spinlock_wait_cycles":384,"thread_start_us":78,"threads_started":1}
I20260811 08:17:35.888682 20113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:35.884392 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39322 (local address 127.20.158.131:33959)
0811 08:17:35.884685 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:35.884690 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:35.884703 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:17:35.884753 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:35.884756 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:35.884773 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:35.884859 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:35.885085 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.886379 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.887620 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.888218 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.888296 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:35.888382 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:35.888552 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 08:17:35.888593 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":236,"thread_start_us":71,"threads_started":1}
I20260811 08:17:35.888921 20112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:35.884325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36930 (local address 127.20.158.130:46335)
0811 08:17:35.884591 (+ 266us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:35.884596 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:35.884609 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:17:35.884651 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:35.884653 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:35.884669 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:35.884767 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:35.885007 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.885957 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.887336 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.888229 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.888625 (+ 396us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:35.888727 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:35.888758 (+ 31us) server_negotiation.cc:299] Negotiation successful
0811 08:17:35.888813 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":227,"thread_start_us":89,"threads_started":1}
I20260811 08:17:35.889072 20114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:35.884221 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:33959 (local address 127.0.0.1:39322)
0811 08:17:35.884577 (+ 356us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:35.884589 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:35.884647 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:35.884937 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:35.884938 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:35.884940 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:35.884996 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:35.884998 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.886473 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.886474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:35.887531 (+ 1057us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:35.887534 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.888333 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.888334 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:35.888431 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:35.888447 (+ 16us) client_negotiation.cc:769] Sending connection context
0811 08:17:35.888535 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 08:17:35.888566 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":5,"thread_start_us":60,"threads_started":1}
I20260811 08:17:35.889794 20106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:35.884433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:39327 (local address 127.0.0.1:55022)
0811 08:17:35.884964 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:35.884976 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:35.885029 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:35.885274 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:35.885275 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:35.885278 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:35.885316 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:35.885317 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.886700 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.886701 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:35.887905 (+ 1204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:35.887908 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.889607 (+ 1699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.889608 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:35.889665 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:35.889669 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:17:35.889711 (+ 42us) client_negotiation.cc:240] Negotiation successful
0811 08:17:35.889746 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":93,"threads_started":1}
I20260811 08:17:35.889753 19780 tablet_service.cc:1467] Processing CreateTablet for tablet 6346863fe2804758b2585a8c54fca6a6 (DEFAULT_TABLE table=test-table [id=eb5b963d5e65497bb5461d3dc1cd7959]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:17:35.889843 19987 tablet_service.cc:1467] Processing CreateTablet for tablet 6346863fe2804758b2585a8c54fca6a6 (DEFAULT_TABLE table=test-table [id=eb5b963d5e65497bb5461d3dc1cd7959]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:17:35.890156 19987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6346863fe2804758b2585a8c54fca6a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:35.890156 19780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6346863fe2804758b2585a8c54fca6a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:35.893692 20118 tablet_bootstrap.cc:492] T 6346863fe2804758b2585a8c54fca6a6 P 476f055c775e44c8bb421290dca7a799: Bootstrap starting.
I20260811 08:17:35.893878 20117 tablet_bootstrap.cc:492] T 6346863fe2804758b2585a8c54fca6a6 P 71a5392558d84299afea8f86a559d1a4: Bootstrap starting.
I20260811 08:17:35.894126 20115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:35.884681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55022 (local address 127.20.158.129:39327)
0811 08:17:35.884908 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:35.884913 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:35.885092 (+ 179us) server_negotiation.cc:407] Connection header received
0811 08:17:35.885139 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:35.885142 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:35.885173 (+ 31us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:35.885260 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:35.885406 (+ 146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.886605 (+ 1199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.888004 (+ 1399us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.888748 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.893831 (+ 5083us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:35.893935 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:35.893989 (+ 54us) server_negotiation.cc:299] Negotiation successful
0811 08:17:35.894040 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":189,"thread_start_us":98,"threads_started":1}
I20260811 08:17:35.894539 20118 tablet_bootstrap.cc:654] T 6346863fe2804758b2585a8c54fca6a6 P 476f055c775e44c8bb421290dca7a799: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:35.894574 20117 tablet_bootstrap.cc:654] T 6346863fe2804758b2585a8c54fca6a6 P 71a5392558d84299afea8f86a559d1a4: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:35.894791 19560 tablet_service.cc:1467] Processing CreateTablet for tablet 6346863fe2804758b2585a8c54fca6a6 (DEFAULT_TABLE table=test-table [id=eb5b963d5e65497bb5461d3dc1cd7959]), partition=RANGE (key) PARTITION UNBOUNDED
I20260811 08:17:35.894938 20117 log.cc:824] T 6346863fe2804758b2585a8c54fca6a6 P 71a5392558d84299afea8f86a559d1a4: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:35.894938 20118 log.cc:824] T 6346863fe2804758b2585a8c54fca6a6 P 476f055c775e44c8bb421290dca7a799: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:35.895150 19560 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6346863fe2804758b2585a8c54fca6a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:35.895912 20118 tablet_bootstrap.cc:492] T 6346863fe2804758b2585a8c54fca6a6 P 476f055c775e44c8bb421290dca7a799: No bootstrap required, opened a new log
I20260811 08:17:35.895995 20118 ts_tablet_manager.cc:1397] T 6346863fe2804758b2585a8c54fca6a6 P 476f055c775e44c8bb421290dca7a799: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260811 08:17:35.896065 20117 tablet_bootstrap.cc:492] T 6346863fe2804758b2585a8c54fca6a6 P 71a5392558d84299afea8f86a559d1a4: No bootstrap required, opened a new log
I20260811 08:17:35.896143 20117 ts_tablet_manager.cc:1397] T 6346863fe2804758b2585a8c54fca6a6 P 71a5392558d84299afea8f86a559d1a4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:17:35.898051 20122 tablet_bootstrap.cc:492] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e: Bootstrap starting.
I20260811 08:17:35.898691 20122 tablet_bootstrap.cc:654] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:35.899013 20122 log.cc:824] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:35.898984 20117 raft_consensus.cc:348] T 6346863fe2804758b2585a8c54fca6a6 P 71a5392558d84299afea8f86a559d1a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "476f055c775e44c8bb421290dca7a799" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 33959 } } peers { permanent_uuid: "59fb3c4a5a75480fa3e80c022dd5392e" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 39327 } } peers { permanent_uuid: "71a5392558d84299afea8f86a559d1a4" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 46335 } }
I20260811 08:17:35.898959 20118 raft_consensus.cc:348] T 6346863fe2804758b2585a8c54fca6a6 P 476f055c775e44c8bb421290dca7a799 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "476f055c775e44c8bb421290dca7a799" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 33959 } } peers { permanent_uuid: "59fb3c4a5a75480fa3e80c022dd5392e" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 39327 } } peers { permanent_uuid: "71a5392558d84299afea8f86a559d1a4" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 46335 } }
I20260811 08:17:35.899169 20117 raft_consensus.cc:374] T 6346863fe2804758b2585a8c54fca6a6 P 71a5392558d84299afea8f86a559d1a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:35.899169 20118 raft_consensus.cc:374] T 6346863fe2804758b2585a8c54fca6a6 P 476f055c775e44c8bb421290dca7a799 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:35.899222 20118 raft_consensus.cc:729] T 6346863fe2804758b2585a8c54fca6a6 P 476f055c775e44c8bb421290dca7a799 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 476f055c775e44c8bb421290dca7a799, State: Initialized, Role: FOLLOWER
I20260811 08:17:35.899222 20117 raft_consensus.cc:729] T 6346863fe2804758b2585a8c54fca6a6 P 71a5392558d84299afea8f86a559d1a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71a5392558d84299afea8f86a559d1a4, State: Initialized, Role: FOLLOWER
I20260811 08:17:35.899355 20117 consensus_queue.cc:260] T 6346863fe2804758b2585a8c54fca6a6 P 71a5392558d84299afea8f86a559d1a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "476f055c775e44c8bb421290dca7a799" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 33959 } } peers { permanent_uuid: "59fb3c4a5a75480fa3e80c022dd5392e" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 39327 } } peers { permanent_uuid: "71a5392558d84299afea8f86a559d1a4" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 46335 } }
I20260811 08:17:35.899355 20118 consensus_queue.cc:260] T 6346863fe2804758b2585a8c54fca6a6 P 476f055c775e44c8bb421290dca7a799 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "476f055c775e44c8bb421290dca7a799" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 33959 } } peers { permanent_uuid: "59fb3c4a5a75480fa3e80c022dd5392e" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 39327 } } peers { permanent_uuid: "71a5392558d84299afea8f86a559d1a4" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 46335 } }
I20260811 08:17:35.899673 20118 ts_tablet_manager.cc:1428] T 6346863fe2804758b2585a8c54fca6a6 P 476f055c775e44c8bb421290dca7a799: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260811 08:17:35.899667 20117 ts_tablet_manager.cc:1428] T 6346863fe2804758b2585a8c54fca6a6 P 71a5392558d84299afea8f86a559d1a4: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260811 08:17:35.899760 19880 heartbeater.cc:503] Master 127.20.158.190:33193 was elected leader, sending a full tablet report...
I20260811 08:17:35.899848 20096 heartbeater.cc:503] Master 127.20.158.190:33193 was elected leader, sending a full tablet report...
I20260811 08:17:35.900381 20122 tablet_bootstrap.cc:492] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e: No bootstrap required, opened a new log
I20260811 08:17:35.900450 20122 ts_tablet_manager.cc:1397] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260811 08:17:35.902669 20122 raft_consensus.cc:348] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "476f055c775e44c8bb421290dca7a799" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 33959 } } peers { permanent_uuid: "59fb3c4a5a75480fa3e80c022dd5392e" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 39327 } } peers { permanent_uuid: "71a5392558d84299afea8f86a559d1a4" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 46335 } }
I20260811 08:17:35.902808 20122 raft_consensus.cc:374] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:35.902833 20122 raft_consensus.cc:729] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59fb3c4a5a75480fa3e80c022dd5392e, State: Initialized, Role: FOLLOWER
I20260811 08:17:35.902992 20122 consensus_queue.cc:260] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "476f055c775e44c8bb421290dca7a799" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 33959 } } peers { permanent_uuid: "59fb3c4a5a75480fa3e80c022dd5392e" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 39327 } } peers { permanent_uuid: "71a5392558d84299afea8f86a559d1a4" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 46335 } }
I20260811 08:17:35.903291 20122 ts_tablet_manager.cc:1428] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260811 08:17:35.903353 19669 heartbeater.cc:503] Master 127.20.158.190:33193 was elected leader, sending a full tablet report...
I20260811 08:17:35.912487 20126 raft_consensus.cc:482] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260811 08:17:35.912581 20126 raft_consensus.cc:504] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "476f055c775e44c8bb421290dca7a799" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 33959 } } peers { permanent_uuid: "59fb3c4a5a75480fa3e80c022dd5392e" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 39327 } } peers { permanent_uuid: "71a5392558d84299afea8f86a559d1a4" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 46335 } }
I20260811 08:17:35.912978 20126 leader_election.cc:288] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 476f055c775e44c8bb421290dca7a799 (127.20.158.131:33959), 71a5392558d84299afea8f86a559d1a4 (127.20.158.130:46335)
I20260811 08:17:35.916913 19671 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:35.913112 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.131:33959 (local address 127.20.158.129:45955)
0811 08:17:35.913209 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:35.913221 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:35.913273 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:35.913450 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:35.913451 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:35.913453 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:35.913565 (+ 112us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:35.913567 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.914483 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.914484 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:35.915807 (+ 1323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:35.915811 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.916592 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.916594 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:35.916695 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:35.916700 (+ 5us) client_negotiation.cc:769] Sending connection context
0811 08:17:35.916775 (+ 75us) client_negotiation.cc:240] Negotiation successful
0811 08:17:35.916828 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":80,"mutex_wait_us":72}
I20260811 08:17:35.916930 20113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:35.913163 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:45955 (local address 127.20.158.131:33959)
0811 08:17:35.913210 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:35.913212 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:35.913327 (+ 115us) server_negotiation.cc:407] Connection header received
0811 08:17:35.913357 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:35.913357 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:35.913368 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:35.913421 (+ 53us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:35.913629 (+ 208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.914392 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.915911 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.916494 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.916570 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:35.916578 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:35.916792 (+ 214us) server_negotiation.cc:299] Negotiation successful
0811 08:17:35.916865 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:17:35.916949 20112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:35.913229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.20.158.129:36477 (local address 127.20.158.130:46335)
0811 08:17:35.913277 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:35.913279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:35.913380 (+ 101us) server_negotiation.cc:407] Connection header received
0811 08:17:35.913453 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:35.913454 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:35.913466 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:35.913516 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0811 08:17:35.913685 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.914407 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.915911 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.916494 (+ 583us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.916570 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:35.916578 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:35.916848 (+ 270us) server_negotiation.cc:299] Negotiation successful
0811 08:17:35.916889 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:17:35.917337 20021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6346863fe2804758b2585a8c54fca6a6" candidate_uuid: "59fb3c4a5a75480fa3e80c022dd5392e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "476f055c775e44c8bb421290dca7a799" is_pre_election: true
I20260811 08:17:35.917550 20021 raft_consensus.cc:2454] T 6346863fe2804758b2585a8c54fca6a6 P 476f055c775e44c8bb421290dca7a799 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fb3c4a5a75480fa3e80c022dd5392e in term 0.
I20260811 08:17:35.916918 20128 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:35.913161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.130:46335 (local address 127.20.158.129:36477)
0811 08:17:35.913307 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:35.913317 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:17:35.913383 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:17:35.913555 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:17:35.913555 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:17:35.913557 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0811 08:17:35.913617 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:35.913618 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.914482 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.914484 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:35.915834 (+ 1350us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:17:35.915836 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.916593 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.916594 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:17:35.916716 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:35.916720 (+ 4us) client_negotiation.cc:769] Sending connection context
0811 08:17:35.916818 (+ 98us) client_negotiation.cc:240] Negotiation successful
0811 08:17:35.916847 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"mutex_wait_us":62,"thread_start_us":96,"threads_started":1}
I20260811 08:17:35.917835 19496 leader_election.cc:302] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 476f055c775e44c8bb421290dca7a799, 59fb3c4a5a75480fa3e80c022dd5392e; no voters:
I20260811 08:17:35.917876 19814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6346863fe2804758b2585a8c54fca6a6" candidate_uuid: "59fb3c4a5a75480fa3e80c022dd5392e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a5392558d84299afea8f86a559d1a4" is_pre_election: true
I20260811 08:17:35.917977 20126 raft_consensus.cc:2781] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260811 08:17:35.918031 19814 raft_consensus.cc:2454] T 6346863fe2804758b2585a8c54fca6a6 P 71a5392558d84299afea8f86a559d1a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59fb3c4a5a75480fa3e80c022dd5392e in term 0.
I20260811 08:17:35.918053 20126 raft_consensus.cc:482] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260811 08:17:35.918079 20126 raft_consensus.cc:3037] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:35.918813 20126 raft_consensus.cc:504] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "476f055c775e44c8bb421290dca7a799" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 33959 } } peers { permanent_uuid: "59fb3c4a5a75480fa3e80c022dd5392e" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 39327 } } peers { permanent_uuid: "71a5392558d84299afea8f86a559d1a4" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 46335 } }
I20260811 08:17:35.918952 20126 leader_election.cc:288] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e [CANDIDATE]: Term 1 election: Requested vote from peers 476f055c775e44c8bb421290dca7a799 (127.20.158.131:33959), 71a5392558d84299afea8f86a559d1a4 (127.20.158.130:46335)
I20260811 08:17:35.919088 19814 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6346863fe2804758b2585a8c54fca6a6" candidate_uuid: "59fb3c4a5a75480fa3e80c022dd5392e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "71a5392558d84299afea8f86a559d1a4"
I20260811 08:17:35.919101 20021 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6346863fe2804758b2585a8c54fca6a6" candidate_uuid: "59fb3c4a5a75480fa3e80c022dd5392e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "476f055c775e44c8bb421290dca7a799"
I20260811 08:17:35.919183 20021 raft_consensus.cc:3037] T 6346863fe2804758b2585a8c54fca6a6 P 476f055c775e44c8bb421290dca7a799 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:35.919189 19814 raft_consensus.cc:3037] T 6346863fe2804758b2585a8c54fca6a6 P 71a5392558d84299afea8f86a559d1a4 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:35.919920 20021 raft_consensus.cc:2454] T 6346863fe2804758b2585a8c54fca6a6 P 476f055c775e44c8bb421290dca7a799 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fb3c4a5a75480fa3e80c022dd5392e in term 1.
I20260811 08:17:35.919924 19814 raft_consensus.cc:2454] T 6346863fe2804758b2585a8c54fca6a6 P 71a5392558d84299afea8f86a559d1a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59fb3c4a5a75480fa3e80c022dd5392e in term 1.
I20260811 08:17:35.920109 19492 leader_election.cc:302] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59fb3c4a5a75480fa3e80c022dd5392e, 71a5392558d84299afea8f86a559d1a4; no voters:
I20260811 08:17:35.920291 20126 raft_consensus.cc:2781] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:17:35.920439 20126 raft_consensus.cc:686] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e [term 1 LEADER]: Becoming Leader. State: Replica: 59fb3c4a5a75480fa3e80c022dd5392e, State: Running, Role: LEADER
I20260811 08:17:35.920565 20126 consensus_queue.cc:237] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "476f055c775e44c8bb421290dca7a799" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 33959 } } peers { permanent_uuid: "59fb3c4a5a75480fa3e80c022dd5392e" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 39327 } } peers { permanent_uuid: "71a5392558d84299afea8f86a559d1a4" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 46335 } }
I20260811 08:17:35.921485 19359 catalog_manager.cc:5495] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e reported cstate change: term changed from 0 to 1, leader changed from <none> to 59fb3c4a5a75480fa3e80c022dd5392e (127.20.158.129). New cstate: current_term: 1 leader_uuid: "59fb3c4a5a75480fa3e80c022dd5392e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "476f055c775e44c8bb421290dca7a799" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 33959 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59fb3c4a5a75480fa3e80c022dd5392e" member_type: VOTER last_known_addr { host: "127.20.158.129" port: 39327 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "71a5392558d84299afea8f86a559d1a4" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 46335 } health_report { overall_health: UNKNOWN } } }
I20260811 08:17:35.934104 20115 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:35.931926 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55032 (local address 127.20.158.129:39327)
0811 08:17:35.931990 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:35.931992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:35.932000 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:17:35.932032 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:35.932033 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:35.932051 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:35.932113 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:17:35.932231 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.932687 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.933422 (+ 735us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:35.933670 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:35.933727 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:35.933844 (+ 117us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:17:35.933942 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:17:35.933994 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:35.934007 (+ 13us) server_negotiation.cc:299] Negotiation successful
0811 08:17:35.934025 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260811 08:17:35.936043 20021 raft_consensus.cc:1261] T 6346863fe2804758b2585a8c54fca6a6 P 476f055c775e44c8bb421290dca7a799 [term 1 FOLLOWER]: Refusing update from remote peer 59fb3c4a5a75480fa3e80c022dd5392e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:17:35.936093 19814 raft_consensus.cc:1261] T 6346863fe2804758b2585a8c54fca6a6 P 71a5392558d84299afea8f86a559d1a4 [term 1 FOLLOWER]: Refusing update from remote peer 59fb3c4a5a75480fa3e80c022dd5392e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:17:35.936401 20126 consensus_queue.cc:1035] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e [LEADER]: Connected to new peer: Peer: permanent_uuid: "71a5392558d84299afea8f86a559d1a4" member_type: VOTER last_known_addr { host: "127.20.158.130" port: 46335 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:17:35.936574 20130 consensus_queue.cc:1035] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e [LEADER]: Connected to new peer: Peer: permanent_uuid: "476f055c775e44c8bb421290dca7a799" member_type: VOTER last_known_addr { host: "127.20.158.131" port: 33959 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:17:35.941689 19359 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:39842:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:17:35.941808 19359 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:39842:
table { table_name: "test-table" } modify_external_catalogs: true
I20260811 08:17:35.942562 19359 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 32ac70f763df4d279f64cd37984d7669: Sending DeleteTablet for 3 replicas of tablet 6346863fe2804758b2585a8c54fca6a6
I20260811 08:17:35.942919 19560 tablet_service.cc:1514] Processing DeleteTablet for tablet 6346863fe2804758b2585a8c54fca6a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:17:35 UTC) from {username='slave'} at 127.0.0.1:55022
I20260811 08:17:35.942936 19987 tablet_service.cc:1514] Processing DeleteTablet for tablet 6346863fe2804758b2585a8c54fca6a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:17:35 UTC) from {username='slave'} at 127.0.0.1:39322
I20260811 08:17:35.942930 19780 tablet_service.cc:1514] Processing DeleteTablet for tablet 6346863fe2804758b2585a8c54fca6a6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 08:17:35 UTC) from {username='slave'} at 127.0.0.1:36930
I20260811 08:17:35.943181 20148 tablet_replica.cc:330] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e: stopping tablet replica
I20260811 08:17:35.943377 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 19467
I20260811 08:17:35.949282 20149 tablet_replica.cc:330] T 6346863fe2804758b2585a8c54fca6a6 P 71a5392558d84299afea8f86a559d1a4: stopping tablet replica
I20260811 08:17:35.949424 20149 raft_consensus.cc:2229] T 6346863fe2804758b2585a8c54fca6a6 P 71a5392558d84299afea8f86a559d1a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:17:35.949572 20149 raft_consensus.cc:2258] T 6346863fe2804758b2585a8c54fca6a6 P 71a5392558d84299afea8f86a559d1a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:17:35.943291 20148 raft_consensus.cc:2229] T 6346863fe2804758b2585a8c54fca6a6 P 59fb3c4a5a75480fa3e80c022dd5392e [term 1 LEADER]: Raft consensus shutting down.
I20260811 08:17:35.949802 20150 tablet_replica.cc:330] T 6346863fe2804758b2585a8c54fca6a6 P 476f055c775e44c8bb421290dca7a799: stopping tablet replica
I20260811 08:17:35.949896 20150 raft_consensus.cc:2229] T 6346863fe2804758b2585a8c54fca6a6 P 476f055c775e44c8bb421290dca7a799 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260811 08:17:35.949991 20150 raft_consensus.cc:2258] T 6346863fe2804758b2585a8c54fca6a6 P 476f055c775e44c8bb421290dca7a799 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260811 08:17:35.950326 20149 ts_tablet_manager.cc:1905] T 6346863fe2804758b2585a8c54fca6a6 P 71a5392558d84299afea8f86a559d1a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:17:35.950459 20150 ts_tablet_manager.cc:1905] T 6346863fe2804758b2585a8c54fca6a6 P 476f055c775e44c8bb421290dca7a799: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260811 08:17:35.952128 20149 ts_tablet_manager.cc:1918] T 6346863fe2804758b2585a8c54fca6a6 P 71a5392558d84299afea8f86a559d1a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:17:35.952128 20150 ts_tablet_manager.cc:1918] T 6346863fe2804758b2585a8c54fca6a6 P 476f055c775e44c8bb421290dca7a799: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260811 08:17:35.952214 20150 log.cc:1196] T 6346863fe2804758b2585a8c54fca6a6 P 476f055c775e44c8bb421290dca7a799: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-2/wal/wals/6346863fe2804758b2585a8c54fca6a6
I20260811 08:17:35.952214 20149 log.cc:1196] T 6346863fe2804758b2585a8c54fca6a6 P 71a5392558d84299afea8f86a559d1a4: Deleting WAL directory at /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786436003833085-21114-0/minicluster-data/ts-1/wal/wals/6346863fe2804758b2585a8c54fca6a6
I20260811 08:17:35.952497 20149 ts_tablet_manager.cc:1939] T 6346863fe2804758b2585a8c54fca6a6 P 71a5392558d84299afea8f86a559d1a4: Deleting consensus metadata
I20260811 08:17:35.952505 20150 ts_tablet_manager.cc:1939] T 6346863fe2804758b2585a8c54fca6a6 P 476f055c775e44c8bb421290dca7a799: Deleting consensus metadata
I20260811 08:17:35.952984 19336 catalog_manager.cc:4841] TS 71a5392558d84299afea8f86a559d1a4 (127.20.158.130:46335): tablet 6346863fe2804758b2585a8c54fca6a6 (table test-table [id=eb5b963d5e65497bb5461d3dc1cd7959]) successfully deleted
I20260811 08:17:35.953071 19340 catalog_manager.cc:4841] TS 476f055c775e44c8bb421290dca7a799 (127.20.158.131:33959): tablet 6346863fe2804758b2585a8c54fca6a6 (table test-table [id=eb5b963d5e65497bb5461d3dc1cd7959]) successfully deleted
W20260811 08:17:35.957638 19340 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.20.158.129:39327 (error 108)
I20260811 08:17:35.957947 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 19672
I20260811 08:17:35.960111 20106 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:35.958039 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.129:39327 (local address 127.0.0.1:55036)
0811 08:17:35.960011 (+ 1972us) negotiation.cc:107] Waiting for socket to connect
0811 08:17:35.960078 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.129:39327: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1941}
W20260811 08:17:35.963765 19340 catalog_manager.cc:4584] TS 59fb3c4a5a75480fa3e80c022dd5392e (127.20.158.129:39327): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6346863fe2804758b2585a8c54fca6a6: Network error: Client connection negotiation failed: client connection to 127.20.158.129:39327: connect: Connection refused (error 111)
I20260811 08:17:35.967514 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 19888
I20260811 08:17:35.978803 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 19308
2026-08-11T08:17:35Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (732 ms)
[----------] 6 tests from EncryptionPolicyTest (9462 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:17:36 dist-test-slave-gkw7 krb5kdc[20156](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:17:36 dist-test-slave-gkw7 krb5kdc[20156](info): set up 2 sockets
Aug 11 08:17:36 dist-test-slave-gkw7 krb5kdc[20156](info): commencing operation
krb5kdc: starting...
W20260811 08:17:37.262890 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.257s user 0.002s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:17:37 dist-test-slave-gkw7 krb5kdc[20156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436257, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:17:37Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:17:37Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:17:37.396456 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34965
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42483
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34965
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:37.481462 20177 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:37.481747 20177 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:37.481778 20177 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:37.482972 20177 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:17:37.483016 20177 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:37.483031 20177 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:37.483044 20177 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:17:37.483057 20177 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:17:37.484597 20177 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42483
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34965
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34965
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20177
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:37.484858 20177 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:37.485100 20177 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:37.490239 20186 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:37.490315 20183 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:37.490253 20182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:37.490478 20177 server_base.cc:1034] running on GCE node
I20260811 08:17:37.490720 20177 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:37.490967 20177 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:37.492151 20177 hybrid_clock.cc:648] HybridClock initialized: now 1786436257492131 us; error 34 us; skew 500 ppm
Aug 11 08:17:37 dist-test-slave-gkw7 krb5kdc[20156](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436257, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:37.494840 20177 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:17:37.495316 20177 webserver.cc:460] Webserver started at http://127.0.0.1:37739/ using document root <none> and password file <none>
I20260811 08:17:37.495579 20177 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:37.495657 20177 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:37.495810 20177 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:37.496899 20177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "2bfa815a80314f99b69804d2bde3a35f"
format_stamp: "Formatted at 2026-08-11 08:17:37 on dist-test-slave-gkw7"
server_key: "b744b90a9594e9da3537945ec1d80de7"
server_key_iv: "78f4fdd4c4dbe909096ce1093201403b"
server_key_version: "encryptionkey@0"
I20260811 08:17:37.497278 20177 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "2bfa815a80314f99b69804d2bde3a35f"
format_stamp: "Formatted at 2026-08-11 08:17:37 on dist-test-slave-gkw7"
server_key: "b744b90a9594e9da3537945ec1d80de7"
server_key_iv: "78f4fdd4c4dbe909096ce1093201403b"
server_key_version: "encryptionkey@0"
I20260811 08:17:37.498747 20177 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:17:37.499550 20198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:37.499763 20177 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:17:37.499868 20177 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "2bfa815a80314f99b69804d2bde3a35f"
format_stamp: "Formatted at 2026-08-11 08:17:37 on dist-test-slave-gkw7"
server_key: "b744b90a9594e9da3537945ec1d80de7"
server_key_iv: "78f4fdd4c4dbe909096ce1093201403b"
server_key_version: "encryptionkey@0"
I20260811 08:17:37.499951 20177 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:37.525683 20177 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:37.527838 20177 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:37.528023 20177 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:37.532812 20177 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34965
I20260811 08:17:37.532907 20276 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34965 every 8 connection(s)
I20260811 08:17:37.533319 20177 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:17:37.534365 20277 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:37.536649 20277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2bfa815a80314f99b69804d2bde3a35f: Bootstrap starting.
I20260811 08:17:37.537190 20277 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2bfa815a80314f99b69804d2bde3a35f: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:37.537459 20277 log.cc:824] T 00000000000000000000000000000000 P 2bfa815a80314f99b69804d2bde3a35f: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:37.538329 20277 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2bfa815a80314f99b69804d2bde3a35f: No bootstrap required, opened a new log
I20260811 08:17:37.540050 20277 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2bfa815a80314f99b69804d2bde3a35f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bfa815a80314f99b69804d2bde3a35f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34965 } }
I20260811 08:17:37.540200 20277 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2bfa815a80314f99b69804d2bde3a35f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:37.540226 20277 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2bfa815a80314f99b69804d2bde3a35f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bfa815a80314f99b69804d2bde3a35f, State: Initialized, Role: FOLLOWER
I20260811 08:17:37.540390 20277 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2bfa815a80314f99b69804d2bde3a35f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bfa815a80314f99b69804d2bde3a35f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34965 } }
I20260811 08:17:37.540486 20277 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2bfa815a80314f99b69804d2bde3a35f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:17:37.540512 20277 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2bfa815a80314f99b69804d2bde3a35f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:17:37.540552 20277 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2bfa815a80314f99b69804d2bde3a35f [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:37.541096 20277 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2bfa815a80314f99b69804d2bde3a35f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bfa815a80314f99b69804d2bde3a35f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34965 } }
I20260811 08:17:37.541188 20277 leader_election.cc:302] T 00000000000000000000000000000000 P 2bfa815a80314f99b69804d2bde3a35f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2bfa815a80314f99b69804d2bde3a35f; no voters:
I20260811 08:17:37.541321 20277 leader_election.cc:288] T 00000000000000000000000000000000 P 2bfa815a80314f99b69804d2bde3a35f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:17:37.541374 20285 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2bfa815a80314f99b69804d2bde3a35f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:17:37.541563 20285 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2bfa815a80314f99b69804d2bde3a35f [term 1 LEADER]: Becoming Leader. State: Replica: 2bfa815a80314f99b69804d2bde3a35f, State: Running, Role: LEADER
I20260811 08:17:37.541674 20277 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2bfa815a80314f99b69804d2bde3a35f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:17:37.541656 20285 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2bfa815a80314f99b69804d2bde3a35f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bfa815a80314f99b69804d2bde3a35f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34965 } }
I20260811 08:17:37.542111 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 20177
I20260811 08:17:37.542279 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:17:37.542280 20288 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2bfa815a80314f99b69804d2bde3a35f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2bfa815a80314f99b69804d2bde3a35f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bfa815a80314f99b69804d2bde3a35f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34965 } } }
I20260811 08:17:37.542363 20288 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2bfa815a80314f99b69804d2bde3a35f [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:37.542505 21114 external_mini_cluster.cc:1428] Setting key 9d6e9320bfbec3f01f1dbe74ebf227cd
I20260811 08:17:37.542558 20289 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2bfa815a80314f99b69804d2bde3a35f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2bfa815a80314f99b69804d2bde3a35f. Latest consensus state: current_term: 1 leader_uuid: "2bfa815a80314f99b69804d2bde3a35f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bfa815a80314f99b69804d2bde3a35f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34965 } } }
I20260811 08:17:37.542613 20289 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2bfa815a80314f99b69804d2bde3a35f [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:37.543010 20302 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:17:37.543633 20302 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:17:37.545291 20302 catalog_manager.cc:1347] Generated new cluster ID: ccae3187298f49b793d4c6e5266e8ffb
I20260811 08:17:37.545348 20302 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:17:37 dist-test-slave-gkw7 krb5kdc[20156](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436257, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 08:17:37.555830 20318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:37.543382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48865 (local address 127.0.0.1:34965)
0811 08:17:37.543614 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:37.543635 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:37.543676 (+ 41us) server_negotiation.cc:407] Connection header received
0811 08:17:37.543803 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:37.543811 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:37.543872 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:37.544026 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:37.545297 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:37.546704 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:37.547772 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:37.548500 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:37.548630 (+ 130us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:37.551803 (+ 3173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:37.551807 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:37.551808 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:17:37.551821 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:37.553935 (+ 2114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:37.554465 (+ 530us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:37.554468 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:37.554469 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:37.554582 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:37.554847 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:37.554848 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:37.554848 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:37.555177 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:37.555358 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:37.555492 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 08:17:37.555594 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":75,"threads_started":1}
I20260811 08:17:37.556861 21114 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:17:37.562618 20302 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:17:37.563369 20302 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:17:37.566432 20318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:37.558511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44701 (local address 127.0.0.1:34965)
0811 08:17:37.558603 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:37.558605 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:37.558676 (+ 71us) server_negotiation.cc:407] Connection header received
0811 08:17:37.558758 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:37.558759 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:37.558768 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:37.558813 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:37.559513 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:37.560276 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:37.561410 (+ 1134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:37.561754 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:37.561829 (+ 75us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:37.563374 (+ 1545us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:37.563376 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:37.563376 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:17:37.563384 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:37.565103 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:37.565575 (+ 472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:37.565576 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:37.565576 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:37.565642 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:37.565891 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:37.565892 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:37.565892 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:37.566033 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:37.566170 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:37.566263 (+ 93us) server_negotiation.cc:299] Negotiation successful
0811 08:17:37.566331 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260811 08:17:37.573377 20302 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2bfa815a80314f99b69804d2bde3a35f: Generated new TSK 0
I20260811 08:17:37.573623 20302 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:17:37.579458 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 20177
W20260811 08:17:37.595709 20153 connection.cc:535] client connection to 127.0.0.1:34965 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34965): Connection reset by peer (error 104)
2026-08-11T08:17:37Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1603 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:17:37 dist-test-slave-gkw7 krb5kdc[20335](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:17:37 dist-test-slave-gkw7 krb5kdc[20335](info): set up 2 sockets
Aug 11 08:17:37 dist-test-slave-gkw7 krb5kdc[20335](info): commencing operation
krb5kdc: starting...
W20260811 08:17:38.924006 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.315s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:17:39 dist-test-slave-gkw7 krb5kdc[20335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436259, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:17:39Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:17:39Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:17:39.054773 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34867
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33433
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34867
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:39.141893 20357 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:39.142109 20357 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:39.142143 20357 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:39.143289 20357 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:17:39.143332 20357 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:39.143347 20357 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:39.143359 20357 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:17:39.143371 20357 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:17:39.144887 20357 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33433
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34867
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34867
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20357
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:39.145153 20357 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:39.145391 20357 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:39.150465 20363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:39.150507 20365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:39.150496 20368 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:39.150732 20357 server_base.cc:1034] running on GCE node
I20260811 08:17:39.150970 20357 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:39.151293 20357 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:39.152442 20357 hybrid_clock.cc:648] HybridClock initialized: now 1786436259152432 us; error 27 us; skew 500 ppm
Aug 11 08:17:39 dist-test-slave-gkw7 krb5kdc[20335](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436259, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:39.155097 20357 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:17:39.155575 20357 webserver.cc:460] Webserver started at http://127.0.0.1:38659/ using document root <none> and password file <none>
I20260811 08:17:39.155831 20357 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:39.155879 20357 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:39.156010 20357 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:39.157099 20357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "dce6f02397d84d289e8c4d5815016321"
format_stamp: "Formatted at 2026-08-11 08:17:39 on dist-test-slave-gkw7"
server_key: "3f2bf2e4a4850e1b9aa9a6699fd1dcaa"
server_key_iv: "2a5187d5d52f4e3627a94fe142fc2f0e"
server_key_version: "encryptionkey@0"
I20260811 08:17:39.157476 20357 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "dce6f02397d84d289e8c4d5815016321"
format_stamp: "Formatted at 2026-08-11 08:17:39 on dist-test-slave-gkw7"
server_key: "3f2bf2e4a4850e1b9aa9a6699fd1dcaa"
server_key_iv: "2a5187d5d52f4e3627a94fe142fc2f0e"
server_key_version: "encryptionkey@0"
I20260811 08:17:39.158978 20357 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:17:39.159792 20376 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:39.160013 20357 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:17:39.160092 20357 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "dce6f02397d84d289e8c4d5815016321"
format_stamp: "Formatted at 2026-08-11 08:17:39 on dist-test-slave-gkw7"
server_key: "3f2bf2e4a4850e1b9aa9a6699fd1dcaa"
server_key_iv: "2a5187d5d52f4e3627a94fe142fc2f0e"
server_key_version: "encryptionkey@0"
I20260811 08:17:39.160208 20357 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:39.179240 20357 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:39.181447 20357 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:39.181656 20357 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:39.185949 20357 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34867
I20260811 08:17:39.186031 20465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34867 every 8 connection(s)
I20260811 08:17:39.186398 20357 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:17:39.187330 20466 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:39.190294 20466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dce6f02397d84d289e8c4d5815016321: Bootstrap starting.
I20260811 08:17:39.190959 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 20357
I20260811 08:17:39.191093 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:17:39.191138 20466 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dce6f02397d84d289e8c4d5815016321: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:39.191324 21114 external_mini_cluster.cc:1428] Setting key 1501d8ce8eaf2431b0838c43b5fbf680
I20260811 08:17:39.191501 20466 log.cc:824] T 00000000000000000000000000000000 P dce6f02397d84d289e8c4d5815016321: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:39.192325 20466 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dce6f02397d84d289e8c4d5815016321: No bootstrap required, opened a new log
I20260811 08:17:39.194271 20466 raft_consensus.cc:348] T 00000000000000000000000000000000 P dce6f02397d84d289e8c4d5815016321 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dce6f02397d84d289e8c4d5815016321" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34867 } }
I20260811 08:17:39.194438 20466 raft_consensus.cc:374] T 00000000000000000000000000000000 P dce6f02397d84d289e8c4d5815016321 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:39.194491 20466 raft_consensus.cc:729] T 00000000000000000000000000000000 P dce6f02397d84d289e8c4d5815016321 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dce6f02397d84d289e8c4d5815016321, State: Initialized, Role: FOLLOWER
I20260811 08:17:39.194650 20466 consensus_queue.cc:260] T 00000000000000000000000000000000 P dce6f02397d84d289e8c4d5815016321 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dce6f02397d84d289e8c4d5815016321" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34867 } }
I20260811 08:17:39.194761 20466 raft_consensus.cc:388] T 00000000000000000000000000000000 P dce6f02397d84d289e8c4d5815016321 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:17:39.194805 20466 raft_consensus.cc:482] T 00000000000000000000000000000000 P dce6f02397d84d289e8c4d5815016321 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:17:39.194855 20466 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dce6f02397d84d289e8c4d5815016321 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:39.195406 20466 raft_consensus.cc:504] T 00000000000000000000000000000000 P dce6f02397d84d289e8c4d5815016321 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dce6f02397d84d289e8c4d5815016321" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34867 } }
I20260811 08:17:39.195531 20466 leader_election.cc:302] T 00000000000000000000000000000000 P dce6f02397d84d289e8c4d5815016321 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dce6f02397d84d289e8c4d5815016321; no voters:
I20260811 08:17:39.195708 20466 leader_election.cc:288] T 00000000000000000000000000000000 P dce6f02397d84d289e8c4d5815016321 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:17:39.195770 20480 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dce6f02397d84d289e8c4d5815016321 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:17:39.195947 20480 raft_consensus.cc:686] T 00000000000000000000000000000000 P dce6f02397d84d289e8c4d5815016321 [term 1 LEADER]: Becoming Leader. State: Replica: dce6f02397d84d289e8c4d5815016321, State: Running, Role: LEADER
I20260811 08:17:39.195994 20466 sys_catalog.cc:564] T 00000000000000000000000000000000 P dce6f02397d84d289e8c4d5815016321 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:17:39.196034 20480 consensus_queue.cc:237] T 00000000000000000000000000000000 P dce6f02397d84d289e8c4d5815016321 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dce6f02397d84d289e8c4d5815016321" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34867 } }
I20260811 08:17:39.196445 20482 sys_catalog.cc:455] T 00000000000000000000000000000000 P dce6f02397d84d289e8c4d5815016321 [sys.catalog]: SysCatalogTable state changed. Reason: New leader dce6f02397d84d289e8c4d5815016321. Latest consensus state: current_term: 1 leader_uuid: "dce6f02397d84d289e8c4d5815016321" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dce6f02397d84d289e8c4d5815016321" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34867 } } }
I20260811 08:17:39.196455 20481 sys_catalog.cc:455] T 00000000000000000000000000000000 P dce6f02397d84d289e8c4d5815016321 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dce6f02397d84d289e8c4d5815016321" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dce6f02397d84d289e8c4d5815016321" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34867 } } }
I20260811 08:17:39.196631 20482 sys_catalog.cc:458] T 00000000000000000000000000000000 P dce6f02397d84d289e8c4d5815016321 [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:39.196652 20481 sys_catalog.cc:458] T 00000000000000000000000000000000 P dce6f02397d84d289e8c4d5815016321 [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:39.197021 20499 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:17:39.197506 20499 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:17:39.198662 20479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:39.191824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41119 (local address 127.0.0.1:34867)
0811 08:17:39.192002 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:39.192013 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:39.192050 (+ 37us) server_negotiation.cc:407] Connection header received
0811 08:17:39.192573 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:39.192580 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:39.192630 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:39.192786 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:39.192987 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:39.193962 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:39.194875 (+ 913us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:39.195340 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:39.195467 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:39.197887 (+ 2420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:39.197892 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:39.197892 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:39.198111 (+ 219us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:39.198162 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:39.198174 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:39.198273 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:39.198402 (+ 129us) server_negotiation.cc:299] Negotiation successful
0811 08:17:39.198433 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":71,"threads_started":1}
I20260811 08:17:39.199671 21114 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:17:39.200934 20499 catalog_manager.cc:1347] Generated new cluster ID: 8b82d3e22ba34b16949bd154eec6a450
I20260811 08:17:39.200996 20499 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:17:39.205163 20479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:39.201079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37773 (local address 127.0.0.1:34867)
0811 08:17:39.201118 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:39.201120 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:39.201681 (+ 561us) server_negotiation.cc:407] Connection header received
0811 08:17:39.201775 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:39.201777 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:39.201787 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:39.201869 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:39.202027 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:39.202799 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:39.203791 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:39.204127 (+ 336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:39.204206 (+ 79us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:39.204903 (+ 697us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:39.204905 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:39.204905 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:39.204911 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:39.204927 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:39.204931 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:39.204998 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:39.205070 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 08:17:39.205082 (+ 12us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:17:39.219134 20499 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:17:39.219755 20499 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:17:39.223500 20499 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dce6f02397d84d289e8c4d5815016321: Generated new TSK 0
I20260811 08:17:39.223719 20499 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:17:39.231035 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 20357
W20260811 08:17:39.249639 20330 connection.cc:535] client connection to 127.0.0.1:34867 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34867): Connection reset by peer (error 104)
2026-08-11T08:17:39Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1654 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:17:39 dist-test-slave-gkw7 krb5kdc[20520](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:17:39 dist-test-slave-gkw7 krb5kdc[20520](info): set up 2 sockets
Aug 11 08:17:39 dist-test-slave-gkw7 krb5kdc[20520](info): commencing operation
krb5kdc: starting...
W20260811 08:17:40.493746 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.230s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:17:40 dist-test-slave-gkw7 krb5kdc[20520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436260, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:17:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:17:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:17:40.622498 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42229
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44895
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42229
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:40.706403 20544 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:40.706650 20544 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:40.706688 20544 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:40.707831 20544 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:17:40.707903 20544 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:40.707938 20544 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:40.707960 20544 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:17:40.707988 20544 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:17:40.709512 20544 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44895
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42229
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42229
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20544
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:40.709808 20544 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:40.710037 20544 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:40.715555 20559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:40.715574 20554 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:40.715582 20555 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:40.715626 20544 server_base.cc:1034] running on GCE node
I20260811 08:17:40.716037 20544 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:40.716284 20544 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:40.717447 20544 hybrid_clock.cc:648] HybridClock initialized: now 1786436260717434 us; error 31 us; skew 500 ppm
Aug 11 08:17:40 dist-test-slave-gkw7 krb5kdc[20520](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436260, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:40.724100 20544 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:17:40.724604 20544 webserver.cc:460] Webserver started at http://127.0.0.1:34315/ using document root <none> and password file <none>
I20260811 08:17:40.724869 20544 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:40.724938 20544 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:40.725083 20544 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:40.726251 20544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "af272651de07495380545d9b562a9936"
format_stamp: "Formatted at 2026-08-11 08:17:40 on dist-test-slave-gkw7"
server_key: "420bc89aa73cd48f6e4ffad0eebf920c"
server_key_iv: "b54943817924b719b06976a434077d64"
server_key_version: "encryptionkey@0"
I20260811 08:17:40.726675 20544 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "af272651de07495380545d9b562a9936"
format_stamp: "Formatted at 2026-08-11 08:17:40 on dist-test-slave-gkw7"
server_key: "420bc89aa73cd48f6e4ffad0eebf920c"
server_key_iv: "b54943817924b719b06976a434077d64"
server_key_version: "encryptionkey@0"
I20260811 08:17:40.728654 20544 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s
I20260811 08:17:40.729671 20568 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:40.729882 20544 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:17:40.729985 20544 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "af272651de07495380545d9b562a9936"
format_stamp: "Formatted at 2026-08-11 08:17:40 on dist-test-slave-gkw7"
server_key: "420bc89aa73cd48f6e4ffad0eebf920c"
server_key_iv: "b54943817924b719b06976a434077d64"
server_key_version: "encryptionkey@0"
I20260811 08:17:40.730067 20544 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:40.736352 20544 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:40.738912 20544 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:40.739022 20544 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:40.743197 20544 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42229
I20260811 08:17:40.743233 20658 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42229 every 8 connection(s)
I20260811 08:17:40.743566 20544 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:17:40.744514 20659 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:40.746932 20659 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af272651de07495380545d9b562a9936: Bootstrap starting.
I20260811 08:17:40.747527 20659 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af272651de07495380545d9b562a9936: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:40.747829 20659 log.cc:824] T 00000000000000000000000000000000 P af272651de07495380545d9b562a9936: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:40.748591 20659 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af272651de07495380545d9b562a9936: No bootstrap required, opened a new log
I20260811 08:17:40.748595 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 20544
I20260811 08:17:40.748726 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:17:40.748924 21114 external_mini_cluster.cc:1428] Setting key 6821e2b08d16fea54465d0fac495b826
I20260811 08:17:40.750501 20659 raft_consensus.cc:348] T 00000000000000000000000000000000 P af272651de07495380545d9b562a9936 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af272651de07495380545d9b562a9936" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42229 } }
I20260811 08:17:40.750672 20659 raft_consensus.cc:374] T 00000000000000000000000000000000 P af272651de07495380545d9b562a9936 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:40.750720 20659 raft_consensus.cc:729] T 00000000000000000000000000000000 P af272651de07495380545d9b562a9936 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af272651de07495380545d9b562a9936, State: Initialized, Role: FOLLOWER
I20260811 08:17:40.750855 20659 consensus_queue.cc:260] T 00000000000000000000000000000000 P af272651de07495380545d9b562a9936 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af272651de07495380545d9b562a9936" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42229 } }
I20260811 08:17:40.750965 20659 raft_consensus.cc:388] T 00000000000000000000000000000000 P af272651de07495380545d9b562a9936 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:17:40.751012 20659 raft_consensus.cc:482] T 00000000000000000000000000000000 P af272651de07495380545d9b562a9936 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:17:40.751063 20659 raft_consensus.cc:3037] T 00000000000000000000000000000000 P af272651de07495380545d9b562a9936 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:40.751838 20664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:40.749437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54207 (local address 127.0.0.1:42229)
0811 08:17:40.749643 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:40.749653 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:40.749689 (+ 36us) server_negotiation.cc:407] Connection header received
0811 08:17:40.750482 (+ 793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:40.750488 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:40.750514 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:40.750656 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:40.751397 (+ 741us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:40.751400 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:40.751401 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:40.751405 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:40.751453 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:40.751465 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:40.751542 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:40.751616 (+ 74us) server_negotiation.cc:299] Negotiation successful
0811 08:17:40.751658 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":147,"thread_start_us":91,"threads_started":1}
I20260811 08:17:40.752251 20659 raft_consensus.cc:504] T 00000000000000000000000000000000 P af272651de07495380545d9b562a9936 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af272651de07495380545d9b562a9936" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42229 } }
I20260811 08:17:40.752367 20659 leader_election.cc:302] T 00000000000000000000000000000000 P af272651de07495380545d9b562a9936 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: af272651de07495380545d9b562a9936; no voters:
I20260811 08:17:40.752521 20659 leader_election.cc:288] T 00000000000000000000000000000000 P af272651de07495380545d9b562a9936 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:17:40.752544 20665 raft_consensus.cc:2781] T 00000000000000000000000000000000 P af272651de07495380545d9b562a9936 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:17:40.752663 20665 raft_consensus.cc:686] T 00000000000000000000000000000000 P af272651de07495380545d9b562a9936 [term 1 LEADER]: Becoming Leader. State: Replica: af272651de07495380545d9b562a9936, State: Running, Role: LEADER
I20260811 08:17:40.752738 21114 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:17:40.752743 20665 consensus_queue.cc:237] T 00000000000000000000000000000000 P af272651de07495380545d9b562a9936 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af272651de07495380545d9b562a9936" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42229 } }
I20260811 08:17:40.752791 20659 sys_catalog.cc:564] T 00000000000000000000000000000000 P af272651de07495380545d9b562a9936 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:17:40.753077 20665 sys_catalog.cc:455] T 00000000000000000000000000000000 P af272651de07495380545d9b562a9936 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "af272651de07495380545d9b562a9936" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af272651de07495380545d9b562a9936" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42229 } } }
I20260811 08:17:40.753147 20665 sys_catalog.cc:458] T 00000000000000000000000000000000 P af272651de07495380545d9b562a9936 [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:40.753367 20671 sys_catalog.cc:455] T 00000000000000000000000000000000 P af272651de07495380545d9b562a9936 [sys.catalog]: SysCatalogTable state changed. Reason: New leader af272651de07495380545d9b562a9936. Latest consensus state: current_term: 1 leader_uuid: "af272651de07495380545d9b562a9936" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "af272651de07495380545d9b562a9936" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42229 } } }
I20260811 08:17:40.753425 20671 sys_catalog.cc:458] T 00000000000000000000000000000000 P af272651de07495380545d9b562a9936 [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:40.754490 20685 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:17:40.755223 20685 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:17:40.755774 20664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:40.754414 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33997 (local address 127.0.0.1:42229)
0811 08:17:40.754466 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:40.754469 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:40.754840 (+ 371us) server_negotiation.cc:407] Connection header received
0811 08:17:40.754900 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:40.754901 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:40.754906 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:40.754958 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:40.755540 (+ 582us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:40.755541 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:40.755542 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:40.755546 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:40.755560 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:40.755565 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:40.755634 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:40.755698 (+ 64us) server_negotiation.cc:299] Negotiation successful
0811 08:17:40.755711 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260811 08:17:40.757009 20685 catalog_manager.cc:1347] Generated new cluster ID: 6c26348aa3c34a2da591ce93ee76c306
I20260811 08:17:40.757059 20685 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:17:40.776129 20685 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:17:40.776345 20685 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:17:40.784518 20685 catalog_manager.cc:5868] T 00000000000000000000000000000000 P af272651de07495380545d9b562a9936: Generated new TSK 0
I20260811 08:17:40.784744 20685 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:17:40.789157 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 20544
2026-08-11T08:17:40Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1557 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:17:40 dist-test-slave-gkw7 krb5kdc[20716](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:17:40 dist-test-slave-gkw7 krb5kdc[20716](info): set up 2 sockets
Aug 11 08:17:40 dist-test-slave-gkw7 krb5kdc[20716](info): commencing operation
krb5kdc: starting...
W20260811 08:17:42.064987 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.244s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:17:42 dist-test-slave-gkw7 krb5kdc[20716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:17:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:17:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:17:42.193194 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41953
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35639
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41953
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:42.278102 20745 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:42.278365 20745 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:42.278406 20745 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:42.279569 20745 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:17:42.279642 20745 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:42.279666 20745 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:42.279687 20745 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:17:42.279716 20745 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:17:42.281180 20745 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35639
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41953
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41953
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:42.281479 20745 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:42.281740 20745 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:42.286886 20755 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:42.286978 20756 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:42.286893 20758 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:42.287217 20745 server_base.cc:1034] running on GCE node
I20260811 08:17:42.287484 20745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:42.287740 20745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:42.288919 20745 hybrid_clock.cc:648] HybridClock initialized: now 1786436262288903 us; error 28 us; skew 500 ppm
Aug 11 08:17:42 dist-test-slave-gkw7 krb5kdc[20716](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436262, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:42.291622 20745 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:17:42.292141 20745 webserver.cc:460] Webserver started at http://127.0.0.1:40275/ using document root <none> and password file <none>
I20260811 08:17:42.292397 20745 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:42.292471 20745 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:42.292625 20745 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:42.293819 20745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "ca3820e9e30e491ba2eb8673830b4349"
format_stamp: "Formatted at 2026-08-11 08:17:42 on dist-test-slave-gkw7"
server_key: "5c9b8a313a2990f0a3ad4e73b80e52fb"
server_key_iv: "e605fa5b0a27a956e4fb8754d00f9a84"
server_key_version: "encryptionkey@0"
I20260811 08:17:42.294193 20745 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "ca3820e9e30e491ba2eb8673830b4349"
format_stamp: "Formatted at 2026-08-11 08:17:42 on dist-test-slave-gkw7"
server_key: "5c9b8a313a2990f0a3ad4e73b80e52fb"
server_key_iv: "e605fa5b0a27a956e4fb8754d00f9a84"
server_key_version: "encryptionkey@0"
I20260811 08:17:42.295583 20745 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:17:42.296413 20770 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:42.296622 20745 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:17:42.296736 20745 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "ca3820e9e30e491ba2eb8673830b4349"
format_stamp: "Formatted at 2026-08-11 08:17:42 on dist-test-slave-gkw7"
server_key: "5c9b8a313a2990f0a3ad4e73b80e52fb"
server_key_iv: "e605fa5b0a27a956e4fb8754d00f9a84"
server_key_version: "encryptionkey@0"
I20260811 08:17:42.296818 20745 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:42.310513 20745 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:42.312978 20745 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:42.313153 20745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:42.317391 20745 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41953
I20260811 08:17:42.317431 20838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41953 every 8 connection(s)
I20260811 08:17:42.317852 20745 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:17:42.318779 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 20745
I20260811 08:17:42.318869 20841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:42.318912 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:17:42.319152 21114 external_mini_cluster.cc:1428] Setting key 76b1a01b1003bada89876459922478d1
I20260811 08:17:42.322326 20841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca3820e9e30e491ba2eb8673830b4349: Bootstrap starting.
I20260811 08:17:42.323117 20841 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ca3820e9e30e491ba2eb8673830b4349: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:42.323434 20841 log.cc:824] T 00000000000000000000000000000000 P ca3820e9e30e491ba2eb8673830b4349: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:42.324343 20841 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ca3820e9e30e491ba2eb8673830b4349: No bootstrap required, opened a new log
Aug 11 08:17:42 dist-test-slave-gkw7 krb5kdc[20716](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436262, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 08:17:42.326983 20841 raft_consensus.cc:348] T 00000000000000000000000000000000 P ca3820e9e30e491ba2eb8673830b4349 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca3820e9e30e491ba2eb8673830b4349" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41953 } }
I20260811 08:17:42.327126 20841 raft_consensus.cc:374] T 00000000000000000000000000000000 P ca3820e9e30e491ba2eb8673830b4349 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:42.327150 20841 raft_consensus.cc:729] T 00000000000000000000000000000000 P ca3820e9e30e491ba2eb8673830b4349 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ca3820e9e30e491ba2eb8673830b4349, State: Initialized, Role: FOLLOWER
I20260811 08:17:42.327303 20841 consensus_queue.cc:260] T 00000000000000000000000000000000 P ca3820e9e30e491ba2eb8673830b4349 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca3820e9e30e491ba2eb8673830b4349" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41953 } }
I20260811 08:17:42.327399 20841 raft_consensus.cc:388] T 00000000000000000000000000000000 P ca3820e9e30e491ba2eb8673830b4349 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:17:42.327461 20841 raft_consensus.cc:482] T 00000000000000000000000000000000 P ca3820e9e30e491ba2eb8673830b4349 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:17:42.327515 20841 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ca3820e9e30e491ba2eb8673830b4349 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:42.328071 20841 raft_consensus.cc:504] T 00000000000000000000000000000000 P ca3820e9e30e491ba2eb8673830b4349 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca3820e9e30e491ba2eb8673830b4349" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41953 } }
I20260811 08:17:42.328199 20841 leader_election.cc:302] T 00000000000000000000000000000000 P ca3820e9e30e491ba2eb8673830b4349 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ca3820e9e30e491ba2eb8673830b4349; no voters:
I20260811 08:17:42.328424 20841 leader_election.cc:288] T 00000000000000000000000000000000 P ca3820e9e30e491ba2eb8673830b4349 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:17:42.328457 20847 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ca3820e9e30e491ba2eb8673830b4349 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:17:42.328575 20847 raft_consensus.cc:686] T 00000000000000000000000000000000 P ca3820e9e30e491ba2eb8673830b4349 [term 1 LEADER]: Becoming Leader. State: Replica: ca3820e9e30e491ba2eb8673830b4349, State: Running, Role: LEADER
I20260811 08:17:42.328734 20841 sys_catalog.cc:564] T 00000000000000000000000000000000 P ca3820e9e30e491ba2eb8673830b4349 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:17:42.328744 20847 consensus_queue.cc:237] T 00000000000000000000000000000000 P ca3820e9e30e491ba2eb8673830b4349 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca3820e9e30e491ba2eb8673830b4349" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41953 } }
I20260811 08:17:42.330070 20848 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca3820e9e30e491ba2eb8673830b4349 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ca3820e9e30e491ba2eb8673830b4349" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca3820e9e30e491ba2eb8673830b4349" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41953 } } }
I20260811 08:17:42.330171 20848 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca3820e9e30e491ba2eb8673830b4349 [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:42.330603 20849 sys_catalog.cc:455] T 00000000000000000000000000000000 P ca3820e9e30e491ba2eb8673830b4349 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ca3820e9e30e491ba2eb8673830b4349. Latest consensus state: current_term: 1 leader_uuid: "ca3820e9e30e491ba2eb8673830b4349" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ca3820e9e30e491ba2eb8673830b4349" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41953 } } }
W20260811 08:17:42.330868 20874 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ca3820e9e30e491ba2eb8673830b4349: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:17:42.330941 20874 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:17:42.330760 20849 sys_catalog.cc:458] T 00000000000000000000000000000000 P ca3820e9e30e491ba2eb8673830b4349 [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:42.331139 20875 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:17:42.331341 20875 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:17:42.331658 20844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:42.319710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37889 (local address 127.0.0.1:41953)
0811 08:17:42.319897 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:42.319905 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:42.319930 (+ 25us) server_negotiation.cc:407] Connection header received
0811 08:17:42.320446 (+ 516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:42.320453 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:42.320500 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:42.320616 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:42.321462 (+ 846us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:42.322542 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:42.323636 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:42.324229 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:42.324316 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:42.326983 (+ 2667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:42.326987 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:42.326987 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:17:42.326998 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:42.329268 (+ 2270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:42.329763 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:42.329780 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:42.329780 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:42.329896 (+ 116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:42.330158 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:42.330159 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:42.330159 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:42.330578 (+ 419us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:42.331201 (+ 623us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:42.331288 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 08:17:42.331437 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":89,"threads_started":1}
I20260811 08:17:42.332685 21114 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:17:42.332975 20875 catalog_manager.cc:1347] Generated new cluster ID: 1de414a0a69246d7b8c2a10b851ecaa8
I20260811 08:17:42.333024 20875 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:17:42.345197 20844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:42.337665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54517 (local address 127.0.0.1:41953)
0811 08:17:42.337707 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:42.337708 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:42.337718 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:17:42.337739 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:42.337740 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:42.337750 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:42.337811 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:42.338663 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:42.339414 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:42.340461 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:42.340794 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:42.340861 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:42.342393 (+ 1532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:42.342394 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:42.342395 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:17:42.342401 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:42.343981 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:42.344373 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:42.344374 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:42.344375 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:42.344430 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:42.344636 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:42.344637 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:42.344637 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:42.344756 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:42.344841 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:42.344975 (+ 134us) server_negotiation.cc:299] Negotiation successful
0811 08:17:42.345051 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:17:42.355439 20875 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:17:42.355988 20875 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:17:42.361560 20875 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ca3820e9e30e491ba2eb8673830b4349: Generated new TSK 0
I20260811 08:17:42.361764 20875 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:17:42.364732 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 20745
2026-08-11T08:17:42Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1577 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:17:42 dist-test-slave-gkw7 krb5kdc[20896](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:17:42 dist-test-slave-gkw7 krb5kdc[20896](info): set up 2 sockets
Aug 11 08:17:42 dist-test-slave-gkw7 krb5kdc[20896](info): commencing operation
krb5kdc: starting...
W20260811 08:17:43.648012 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.249s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:17:43 dist-test-slave-gkw7 krb5kdc[20896](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436263, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:17:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:17:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:17:43.772799 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46621
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:46621
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:43.855500 20924 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:43.855705 20924 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:43.855729 20924 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:43.856806 20924 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:17:43.856842 20924 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:43.856858 20924 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:43.856869 20924 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:17:43.856881 20924 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:17:43.858316 20924 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:46621
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:46621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.20924
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:43.858513 20924 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:43.858687 20924 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:43.863677 20936 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:43.863648 20933 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:43.863708 20934 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:43.863943 20924 server_base.cc:1034] running on GCE node
I20260811 08:17:43.864176 20924 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:43.864426 20924 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:43.865609 20924 hybrid_clock.cc:648] HybridClock initialized: now 1786436263865578 us; error 34 us; skew 500 ppm
Aug 11 08:17:43 dist-test-slave-gkw7 krb5kdc[20896](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436263, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:43.868192 20924 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:17:43.868626 20924 webserver.cc:460] Webserver started at http://127.0.0.1:35031/ using document root <none> and password file <none>
I20260811 08:17:43.868865 20924 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:43.868935 20924 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:43.869098 20924 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:43.870252 20924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "c8c70476ae89428ca5bb64b08b452a17"
format_stamp: "Formatted at 2026-08-11 08:17:43 on dist-test-slave-gkw7"
server_key: "82acceda0854e5677f87d624f4a6f585"
server_key_iv: "aed890c8b97fa27479baf3edabff7da4"
server_key_version: "encryptionkey@0"
I20260811 08:17:43.870622 20924 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "c8c70476ae89428ca5bb64b08b452a17"
format_stamp: "Formatted at 2026-08-11 08:17:43 on dist-test-slave-gkw7"
server_key: "82acceda0854e5677f87d624f4a6f585"
server_key_iv: "aed890c8b97fa27479baf3edabff7da4"
server_key_version: "encryptionkey@0"
I20260811 08:17:43.871973 20924 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:17:43.872730 20946 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:43.872910 20924 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260811 08:17:43.873020 20924 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "c8c70476ae89428ca5bb64b08b452a17"
format_stamp: "Formatted at 2026-08-11 08:17:43 on dist-test-slave-gkw7"
server_key: "82acceda0854e5677f87d624f4a6f585"
server_key_iv: "aed890c8b97fa27479baf3edabff7da4"
server_key_version: "encryptionkey@0"
I20260811 08:17:43.873096 20924 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:43.888701 20924 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:43.891238 20924 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:43.891410 20924 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:43.895597 20924 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:46621
I20260811 08:17:43.895632 21024 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:46621 every 8 connection(s)
I20260811 08:17:43.896004 20924 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:17:43.896992 21025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:43.898283 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 20924
I20260811 08:17:43.898434 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:17:43.898646 21114 external_mini_cluster.cc:1428] Setting key a886e4f0227ecf4d55adfc0ede8cdfaf
I20260811 08:17:43.899849 21025 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8c70476ae89428ca5bb64b08b452a17: Bootstrap starting.
I20260811 08:17:43.900576 21025 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8c70476ae89428ca5bb64b08b452a17: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:43.900887 21025 log.cc:824] T 00000000000000000000000000000000 P c8c70476ae89428ca5bb64b08b452a17: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:43.901664 21025 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8c70476ae89428ca5bb64b08b452a17: No bootstrap required, opened a new log
I20260811 08:17:43.903474 21025 raft_consensus.cc:348] T 00000000000000000000000000000000 P c8c70476ae89428ca5bb64b08b452a17 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8c70476ae89428ca5bb64b08b452a17" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46621 } }
I20260811 08:17:43.903636 21025 raft_consensus.cc:374] T 00000000000000000000000000000000 P c8c70476ae89428ca5bb64b08b452a17 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:43.903685 21025 raft_consensus.cc:729] T 00000000000000000000000000000000 P c8c70476ae89428ca5bb64b08b452a17 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8c70476ae89428ca5bb64b08b452a17, State: Initialized, Role: FOLLOWER
I20260811 08:17:43.903823 21025 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8c70476ae89428ca5bb64b08b452a17 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8c70476ae89428ca5bb64b08b452a17" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46621 } }
I20260811 08:17:43.903924 21025 raft_consensus.cc:388] T 00000000000000000000000000000000 P c8c70476ae89428ca5bb64b08b452a17 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:17:43.903986 21025 raft_consensus.cc:482] T 00000000000000000000000000000000 P c8c70476ae89428ca5bb64b08b452a17 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:17:43.904040 21025 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c8c70476ae89428ca5bb64b08b452a17 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:43.904204 21030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:43.899198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52901 (local address 127.0.0.1:46621)
0811 08:17:43.899379 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:43.899387 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:43.899412 (+ 25us) server_negotiation.cc:407] Connection header received
0811 08:17:43.899821 (+ 409us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:43.899827 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:43.899886 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:43.900042 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:43.900258 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:43.901244 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:43.902207 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:43.902641 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:43.902774 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:43.903494 (+ 720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:43.903499 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:43.903499 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:43.903699 (+ 200us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:43.903738 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:43.903752 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:43.903808 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:43.903883 (+ 75us) server_negotiation.cc:299] Negotiation successful
0811 08:17:43.903948 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":82,"threads_started":1}
I20260811 08:17:43.904763 21025 raft_consensus.cc:504] T 00000000000000000000000000000000 P c8c70476ae89428ca5bb64b08b452a17 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8c70476ae89428ca5bb64b08b452a17" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46621 } }
I20260811 08:17:43.904886 21025 leader_election.cc:302] T 00000000000000000000000000000000 P c8c70476ae89428ca5bb64b08b452a17 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c8c70476ae89428ca5bb64b08b452a17; no voters:
I20260811 08:17:43.905055 21025 leader_election.cc:288] T 00000000000000000000000000000000 P c8c70476ae89428ca5bb64b08b452a17 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:17:43.905140 21036 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c8c70476ae89428ca5bb64b08b452a17 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:17:43.905174 21114 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:17:43.905328 21025 sys_catalog.cc:564] T 00000000000000000000000000000000 P c8c70476ae89428ca5bb64b08b452a17 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:17:43.905319 21036 raft_consensus.cc:686] T 00000000000000000000000000000000 P c8c70476ae89428ca5bb64b08b452a17 [term 1 LEADER]: Becoming Leader. State: Replica: c8c70476ae89428ca5bb64b08b452a17, State: Running, Role: LEADER
I20260811 08:17:43.906502 21036 consensus_queue.cc:237] T 00000000000000000000000000000000 P c8c70476ae89428ca5bb64b08b452a17 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8c70476ae89428ca5bb64b08b452a17" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46621 } }
I20260811 08:17:43.907220 21037 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8c70476ae89428ca5bb64b08b452a17 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c8c70476ae89428ca5bb64b08b452a17. Latest consensus state: current_term: 1 leader_uuid: "c8c70476ae89428ca5bb64b08b452a17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8c70476ae89428ca5bb64b08b452a17" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46621 } } }
I20260811 08:17:43.907220 21038 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8c70476ae89428ca5bb64b08b452a17 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c8c70476ae89428ca5bb64b08b452a17" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c8c70476ae89428ca5bb64b08b452a17" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 46621 } } }
W20260811 08:17:43.907717 21068 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c8c70476ae89428ca5bb64b08b452a17: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:17:43.908133 21068 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:17:43.908107 21037 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8c70476ae89428ca5bb64b08b452a17 [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:43.908118 21038 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8c70476ae89428ca5bb64b08b452a17 [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:43.908453 21075 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:17:43.908674 21075 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:17:43.910382 21030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:43.906710 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37203 (local address 127.0.0.1:46621)
0811 08:17:43.906744 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:43.906746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:43.906892 (+ 146us) server_negotiation.cc:407] Connection header received
0811 08:17:43.906964 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:43.906965 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:43.906976 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:43.907007 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:43.907220 (+ 213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:43.907931 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:43.909056 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:43.909339 (+ 283us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:43.909436 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:43.910121 (+ 685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:43.910122 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:43.910123 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:43.910127 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:43.910143 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:43.910148 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:43.910213 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:43.910285 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 08:17:43.910308 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260811 08:17:43.910581 21075 catalog_manager.cc:1347] Generated new cluster ID: 965ef72dd5ae4fa08592962f98dc1e10
I20260811 08:17:43.910638 21075 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:17:43.916605 21075 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:17:43.917109 21075 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:17:43.920982 21075 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c8c70476ae89428ca5bb64b08b452a17: Generated new TSK 0
I20260811 08:17:43.921149 21075 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:17:43.926167 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 20924
2026-08-11T08:17:43Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1555 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:17:43 dist-test-slave-gkw7 krb5kdc[21081](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:17:43 dist-test-slave-gkw7 krb5kdc[21081](info): set up 2 sockets
Aug 11 08:17:43 dist-test-slave-gkw7 krb5kdc[21081](info): commencing operation
krb5kdc: starting...
W20260811 08:17:45.188568 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.234s user 0.006s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:17:45 dist-test-slave-gkw7 krb5kdc[21081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436265, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:17:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:17:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:17:45.321368 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33455
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36307
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33455
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:45.406275 21104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:45.406512 21104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:45.406538 21104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:45.407774 21104 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:17:45.407825 21104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:45.407840 21104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:45.407853 21104 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:17:45.407912 21104 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:17:45.409499 21104 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36307
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33455
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33455
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:45.409850 21104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:45.410112 21104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:45.415411 21120 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:45.415441 21124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:45.415452 21121 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:45.415488 21104 server_base.cc:1034] running on GCE node
I20260811 08:17:45.415917 21104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:45.416256 21104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:45.417438 21104 hybrid_clock.cc:648] HybridClock initialized: now 1786436265417416 us; error 44 us; skew 500 ppm
Aug 11 08:17:45 dist-test-slave-gkw7 krb5kdc[21081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436265, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:45.420110 21104 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:17:45.420661 21104 webserver.cc:460] Webserver started at http://127.0.0.1:43679/ using document root <none> and password file <none>
I20260811 08:17:45.420914 21104 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:45.420985 21104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:45.421144 21104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:45.422461 21104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "5417cb23057044e4ad974214d33f79a2"
format_stamp: "Formatted at 2026-08-11 08:17:45 on dist-test-slave-gkw7"
server_key: "815a9a6653df017d2f8d9e3b5b7268dd"
server_key_iv: "cf8a82aa9a8fad9b89ac124c07036abe"
server_key_version: "encryptionkey@0"
I20260811 08:17:45.422861 21104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "5417cb23057044e4ad974214d33f79a2"
format_stamp: "Formatted at 2026-08-11 08:17:45 on dist-test-slave-gkw7"
server_key: "815a9a6653df017d2f8d9e3b5b7268dd"
server_key_iv: "cf8a82aa9a8fad9b89ac124c07036abe"
server_key_version: "encryptionkey@0"
I20260811 08:17:45.424448 21104 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 08:17:45.425315 21134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:45.425580 21104 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:17:45.425702 21104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "5417cb23057044e4ad974214d33f79a2"
format_stamp: "Formatted at 2026-08-11 08:17:45 on dist-test-slave-gkw7"
server_key: "815a9a6653df017d2f8d9e3b5b7268dd"
server_key_iv: "cf8a82aa9a8fad9b89ac124c07036abe"
server_key_version: "encryptionkey@0"
I20260811 08:17:45.425792 21104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:45.429311 21104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:45.431559 21104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:45.431735 21104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:45.436863 21104 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33455
I20260811 08:17:45.436941 21216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33455 every 8 connection(s)
I20260811 08:17:45.437361 21104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:17:45.438556 21217 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:45.440868 21217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5417cb23057044e4ad974214d33f79a2: Bootstrap starting.
I20260811 08:17:45.441439 21217 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5417cb23057044e4ad974214d33f79a2: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:45.441803 21217 log.cc:824] T 00000000000000000000000000000000 P 5417cb23057044e4ad974214d33f79a2: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:45.442512 21217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5417cb23057044e4ad974214d33f79a2: No bootstrap required, opened a new log
I20260811 08:17:45.444079 21217 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5417cb23057044e4ad974214d33f79a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5417cb23057044e4ad974214d33f79a2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33455 } }
I20260811 08:17:45.444222 21217 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5417cb23057044e4ad974214d33f79a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:45.444247 21217 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5417cb23057044e4ad974214d33f79a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5417cb23057044e4ad974214d33f79a2, State: Initialized, Role: FOLLOWER
I20260811 08:17:45.444391 21217 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5417cb23057044e4ad974214d33f79a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5417cb23057044e4ad974214d33f79a2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33455 } }
I20260811 08:17:45.444474 21217 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5417cb23057044e4ad974214d33f79a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:17:45.444499 21217 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5417cb23057044e4ad974214d33f79a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:17:45.444528 21217 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5417cb23057044e4ad974214d33f79a2 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:45.445013 21217 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5417cb23057044e4ad974214d33f79a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5417cb23057044e4ad974214d33f79a2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33455 } }
I20260811 08:17:45.445106 21217 leader_election.cc:302] T 00000000000000000000000000000000 P 5417cb23057044e4ad974214d33f79a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5417cb23057044e4ad974214d33f79a2; no voters:
I20260811 08:17:45.445247 21217 leader_election.cc:288] T 00000000000000000000000000000000 P 5417cb23057044e4ad974214d33f79a2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:17:45.445335 21221 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5417cb23057044e4ad974214d33f79a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:17:45.445493 21217 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5417cb23057044e4ad974214d33f79a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:17:45.445595 21221 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5417cb23057044e4ad974214d33f79a2 [term 1 LEADER]: Becoming Leader. State: Replica: 5417cb23057044e4ad974214d33f79a2, State: Running, Role: LEADER
I20260811 08:17:45.445734 21221 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5417cb23057044e4ad974214d33f79a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5417cb23057044e4ad974214d33f79a2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33455 } }
I20260811 08:17:45.446512 21225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5417cb23057044e4ad974214d33f79a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5417cb23057044e4ad974214d33f79a2. Latest consensus state: current_term: 1 leader_uuid: "5417cb23057044e4ad974214d33f79a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5417cb23057044e4ad974214d33f79a2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33455 } } }
I20260811 08:17:45.446606 21225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5417cb23057044e4ad974214d33f79a2 [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:45.446738 21223 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5417cb23057044e4ad974214d33f79a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5417cb23057044e4ad974214d33f79a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5417cb23057044e4ad974214d33f79a2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33455 } } }
I20260811 08:17:45.446831 21223 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5417cb23057044e4ad974214d33f79a2 [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:45.447023 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 21104
I20260811 08:17:45.447152 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:17:45.447360 21114 external_mini_cluster.cc:1428] Setting key ab70b04c79f52b5705a7b411715842f7
I20260811 08:17:45.447137 21235 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:17:45.448292 21235 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:17:45.450166 21235 catalog_manager.cc:1347] Generated new cluster ID: 738cc08bb29642bc87879556fea6aa66
I20260811 08:17:45.450240 21235 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:17:45.450417 21256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:45.447896 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36407 (local address 127.0.0.1:33455)
0811 08:17:45.448070 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:45.448081 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:45.448187 (+ 106us) server_negotiation.cc:407] Connection header received
0811 08:17:45.448410 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:45.448418 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:45.448461 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:45.448591 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:45.449786 (+ 1195us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:45.449790 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:45.449790 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:45.449794 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:45.449841 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:45.449853 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:45.449950 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:45.450113 (+ 163us) server_negotiation.cc:299] Negotiation successful
0811 08:17:45.450159 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":74,"threads_started":1}
I20260811 08:17:45.451404 21114 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:17:45.458814 21256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:45.453889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55415 (local address 127.0.0.1:33455)
0811 08:17:45.453933 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:45.453936 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:45.457731 (+ 3795us) server_negotiation.cc:407] Connection header received
0811 08:17:45.457810 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:45.457811 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:45.457817 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:45.457892 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:45.458559 (+ 667us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:45.458561 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:45.458561 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:45.458566 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:45.458582 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:45.458586 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:45.458633 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:45.458695 (+ 62us) server_negotiation.cc:299] Negotiation successful
0811 08:17:45.458712 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:17:45.505615 21235 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:17:45.505836 21235 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:17:45.516036 21235 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5417cb23057044e4ad974214d33f79a2: Generated new TSK 0
I20260811 08:17:45.516283 21235 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:17:45.520701 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 21104
2026-08-11T08:17:45Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1590 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:17:45 dist-test-slave-gkw7 krb5kdc[21272](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:17:45 dist-test-slave-gkw7 krb5kdc[21272](info): set up 2 sockets
Aug 11 08:17:45 dist-test-slave-gkw7 krb5kdc[21272](info): commencing operation
krb5kdc: starting...
W20260811 08:17:46.773283 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.228s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:17:46 dist-test-slave-gkw7 krb5kdc[21272](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436266, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:17:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:17:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:17:46.904132 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45311
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39745
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45311
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:46.989367 21294 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:46.989677 21294 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:46.989734 21294 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:46.990978 21294 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:17:46.991055 21294 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:46.991081 21294 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:46.991124 21294 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:17:46.991151 21294 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:17:46.992734 21294 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39745
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45311
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45311
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21294
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:46.993053 21294 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:46.993314 21294 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:46.998865 21302 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:46.998888 21303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:46.998870 21305 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:46.999243 21294 server_base.cc:1034] running on GCE node
I20260811 08:17:46.999500 21294 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:46.999883 21294 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:47.001068 21294 hybrid_clock.cc:648] HybridClock initialized: now 1786436267001043 us; error 44 us; skew 500 ppm
Aug 11 08:17:47 dist-test-slave-gkw7 krb5kdc[21272](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436267, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:47.009277 21294 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:17:47.009941 21294 webserver.cc:460] Webserver started at http://127.0.0.1:46543/ using document root <none> and password file <none>
I20260811 08:17:47.010191 21294 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:47.010270 21294 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:47.010430 21294 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:47.011582 21294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "2a46786a4f6647ec9118c4f20e3baa43"
format_stamp: "Formatted at 2026-08-11 08:17:47 on dist-test-slave-gkw7"
server_key: "933b57a39a5eef47e8154c2f83015428"
server_key_iv: "90db280c8e94cd9c9032af7745e969f7"
server_key_version: "encryptionkey@0"
I20260811 08:17:47.011969 21294 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "2a46786a4f6647ec9118c4f20e3baa43"
format_stamp: "Formatted at 2026-08-11 08:17:47 on dist-test-slave-gkw7"
server_key: "933b57a39a5eef47e8154c2f83015428"
server_key_iv: "90db280c8e94cd9c9032af7745e969f7"
server_key_version: "encryptionkey@0"
I20260811 08:17:47.013514 21294 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:17:47.014385 21313 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:47.014624 21294 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:17:47.014748 21294 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "2a46786a4f6647ec9118c4f20e3baa43"
format_stamp: "Formatted at 2026-08-11 08:17:47 on dist-test-slave-gkw7"
server_key: "933b57a39a5eef47e8154c2f83015428"
server_key_iv: "90db280c8e94cd9c9032af7745e969f7"
server_key_version: "encryptionkey@0"
I20260811 08:17:47.014837 21294 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:47.031545 21294 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:47.034255 21294 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:47.034438 21294 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:47.038836 21294 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45311
I20260811 08:17:47.038887 21397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45311 every 8 connection(s)
I20260811 08:17:47.039305 21294 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:17:47.040267 21398 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:47.040498 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 21294
I20260811 08:17:47.040644 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:17:47.040874 21114 external_mini_cluster.cc:1428] Setting key b9117d89b074c56dc23f6605a92b7e02
I20260811 08:17:47.043558 21398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a46786a4f6647ec9118c4f20e3baa43: Bootstrap starting.
I20260811 08:17:47.044317 21398 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2a46786a4f6647ec9118c4f20e3baa43: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:47.044631 21398 log.cc:824] T 00000000000000000000000000000000 P 2a46786a4f6647ec9118c4f20e3baa43: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:47.045387 21398 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2a46786a4f6647ec9118c4f20e3baa43: No bootstrap required, opened a new log
I20260811 08:17:47.047632 21398 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2a46786a4f6647ec9118c4f20e3baa43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a46786a4f6647ec9118c4f20e3baa43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45311 } }
I20260811 08:17:47.047812 21398 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2a46786a4f6647ec9118c4f20e3baa43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:47.047861 21398 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2a46786a4f6647ec9118c4f20e3baa43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a46786a4f6647ec9118c4f20e3baa43, State: Initialized, Role: FOLLOWER
I20260811 08:17:47.048002 21398 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2a46786a4f6647ec9118c4f20e3baa43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a46786a4f6647ec9118c4f20e3baa43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45311 } }
I20260811 08:17:47.048087 21398 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2a46786a4f6647ec9118c4f20e3baa43 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:17:47.048134 21398 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2a46786a4f6647ec9118c4f20e3baa43 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:17:47.048187 21398 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2a46786a4f6647ec9118c4f20e3baa43 [term 0 FOLLOWER]: Advancing to term 1
Aug 11 08:17:47 dist-test-slave-gkw7 krb5kdc[21272](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436266, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 08:17:47.048942 21398 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2a46786a4f6647ec9118c4f20e3baa43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a46786a4f6647ec9118c4f20e3baa43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45311 } }
I20260811 08:17:47.049068 21398 leader_election.cc:302] T 00000000000000000000000000000000 P 2a46786a4f6647ec9118c4f20e3baa43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2a46786a4f6647ec9118c4f20e3baa43; no voters:
I20260811 08:17:47.049265 21398 leader_election.cc:288] T 00000000000000000000000000000000 P 2a46786a4f6647ec9118c4f20e3baa43 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:17:47.049439 21405 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2a46786a4f6647ec9118c4f20e3baa43 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:17:47.049630 21398 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2a46786a4f6647ec9118c4f20e3baa43 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:17:47.049669 21405 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2a46786a4f6647ec9118c4f20e3baa43 [term 1 LEADER]: Becoming Leader. State: Replica: 2a46786a4f6647ec9118c4f20e3baa43, State: Running, Role: LEADER
I20260811 08:17:47.049853 21405 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2a46786a4f6647ec9118c4f20e3baa43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a46786a4f6647ec9118c4f20e3baa43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45311 } }
I20260811 08:17:47.050318 21409 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a46786a4f6647ec9118c4f20e3baa43 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2a46786a4f6647ec9118c4f20e3baa43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a46786a4f6647ec9118c4f20e3baa43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45311 } } }
I20260811 08:17:47.050475 21409 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a46786a4f6647ec9118c4f20e3baa43 [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:47.051584 21404 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2a46786a4f6647ec9118c4f20e3baa43 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2a46786a4f6647ec9118c4f20e3baa43. Latest consensus state: current_term: 1 leader_uuid: "2a46786a4f6647ec9118c4f20e3baa43" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2a46786a4f6647ec9118c4f20e3baa43" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45311 } } }
I20260811 08:17:47.051874 21404 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2a46786a4f6647ec9118c4f20e3baa43 [sys.catalog]: This master's current role is: LEADER
W20260811 08:17:47.051586 21432 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 2a46786a4f6647ec9118c4f20e3baa43: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:17:47.051937 21432 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:17:47.052011 21424 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:17:47.052241 21424 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:17:47.053186 21402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:47.041525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:59141 (local address 127.0.0.1:45311)
0811 08:17:47.041731 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:47.041741 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:47.041785 (+ 44us) server_negotiation.cc:407] Connection header received
0811 08:17:47.042331 (+ 546us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:47.042340 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:47.042410 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:47.042568 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:47.043238 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:47.044631 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:47.045442 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:47.046070 (+ 628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:47.046203 (+ 133us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:47.048932 (+ 2729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:47.048937 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:47.048937 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:17:47.048951 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:47.051223 (+ 2272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:47.051814 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:47.051818 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:47.051819 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:47.051930 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:47.052200 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:47.052202 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:47.052202 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:47.052531 (+ 329us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:47.052694 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:47.052880 (+ 186us) server_negotiation.cc:299] Negotiation successful
0811 08:17:47.052989 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":80,"threads_started":1}
I20260811 08:17:47.054036 21424 catalog_manager.cc:1347] Generated new cluster ID: 95a1eb2cfd0843f3a7c361fc12d2214e
I20260811 08:17:47.054147 21424 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:17:47.054255 21114 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:17:47.069487 21402 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:47.057942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:53337 (local address 127.0.0.1:45311)
0811 08:17:47.057990 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:47.057992 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:47.061824 (+ 3832us) server_negotiation.cc:407] Connection header received
0811 08:17:47.061910 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:47.061911 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:47.061926 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:47.061995 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:47.062756 (+ 761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:47.063514 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:47.064577 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:47.064914 (+ 337us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:47.064973 (+ 59us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:47.066561 (+ 1588us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:47.066562 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:47.066562 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:17:47.066570 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:47.068194 (+ 1624us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:47.068643 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:47.068644 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:47.068644 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:47.068701 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:47.068944 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:47.068944 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:47.068945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:47.069065 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:47.069161 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:47.069322 (+ 161us) server_negotiation.cc:299] Negotiation successful
0811 08:17:47.069389 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260811 08:17:47.076547 21424 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:17:47.077128 21424 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:17:47.083968 21424 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2a46786a4f6647ec9118c4f20e3baa43: Generated new TSK 0
I20260811 08:17:47.084199 21424 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:17:47.090250 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 21294
W20260811 08:17:47.108503 21270 connection.cc:535] client connection to 127.0.0.1:45311 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45311): Connection reset by peer (error 104)
2026-08-11T08:17:47Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1577 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:17:47 dist-test-slave-gkw7 krb5kdc[21448](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:17:47 dist-test-slave-gkw7 krb5kdc[21448](info): set up 2 sockets
Aug 11 08:17:47 dist-test-slave-gkw7 krb5kdc[21448](info): commencing operation
krb5kdc: starting...
W20260811 08:17:48.420217 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.298s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:17:48 dist-test-slave-gkw7 krb5kdc[21448](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436268, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:17:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:17:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:17:48.553031 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40911
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40911
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:48.639827 21464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:48.640117 21464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:48.640162 21464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:48.641470 21464 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:17:48.641577 21464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:48.641609 21464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:48.641659 21464 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:17:48.641692 21464 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:17:48.643275 21464 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40911
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40911
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21464
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:48.643603 21464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:48.643867 21464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:48.649241 21485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:48.649256 21479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:48.649402 21481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:48.649559 21464 server_base.cc:1034] running on GCE node
I20260811 08:17:48.649837 21464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:48.650223 21464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:48.651391 21464 hybrid_clock.cc:648] HybridClock initialized: now 1786436268651378 us; error 31 us; skew 500 ppm
Aug 11 08:17:48 dist-test-slave-gkw7 krb5kdc[21448](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436268, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:48.654059 21464 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:17:48.654559 21464 webserver.cc:460] Webserver started at http://127.0.0.1:42597/ using document root <none> and password file <none>
I20260811 08:17:48.654757 21464 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:48.654798 21464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:48.654892 21464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:48.655934 21464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "8799b7ed579644769a5b17738add57db"
format_stamp: "Formatted at 2026-08-11 08:17:48 on dist-test-slave-gkw7"
server_key: "141a7cae8277d497dd34695986486436"
server_key_iv: "c501760ecd79b11acc28685ab5941c0e"
server_key_version: "encryptionkey@0"
I20260811 08:17:48.656255 21464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "8799b7ed579644769a5b17738add57db"
format_stamp: "Formatted at 2026-08-11 08:17:48 on dist-test-slave-gkw7"
server_key: "141a7cae8277d497dd34695986486436"
server_key_iv: "c501760ecd79b11acc28685ab5941c0e"
server_key_version: "encryptionkey@0"
I20260811 08:17:48.657689 21464 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:17:48.658476 21494 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:48.658704 21464 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:17:48.658814 21464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "8799b7ed579644769a5b17738add57db"
format_stamp: "Formatted at 2026-08-11 08:17:48 on dist-test-slave-gkw7"
server_key: "141a7cae8277d497dd34695986486436"
server_key_iv: "c501760ecd79b11acc28685ab5941c0e"
server_key_version: "encryptionkey@0"
I20260811 08:17:48.658896 21464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:48.674453 21464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:48.676735 21464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:48.676926 21464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:48.681397 21464 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40911
I20260811 08:17:48.681453 21581 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40911 every 8 connection(s)
I20260811 08:17:48.681896 21464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:17:48.682832 21583 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:48.685303 21583 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8799b7ed579644769a5b17738add57db: Bootstrap starting.
I20260811 08:17:48.686014 21583 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8799b7ed579644769a5b17738add57db: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:48.686326 21583 log.cc:824] T 00000000000000000000000000000000 P 8799b7ed579644769a5b17738add57db: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:48.687160 21583 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8799b7ed579644769a5b17738add57db: No bootstrap required, opened a new log
I20260811 08:17:48.688795 21583 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8799b7ed579644769a5b17738add57db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8799b7ed579644769a5b17738add57db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40911 } }
I20260811 08:17:48.688941 21583 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8799b7ed579644769a5b17738add57db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:48.688964 21583 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8799b7ed579644769a5b17738add57db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8799b7ed579644769a5b17738add57db, State: Initialized, Role: FOLLOWER
I20260811 08:17:48.689150 21583 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8799b7ed579644769a5b17738add57db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8799b7ed579644769a5b17738add57db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40911 } }
I20260811 08:17:48.689256 21583 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8799b7ed579644769a5b17738add57db [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:17:48.689296 21583 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8799b7ed579644769a5b17738add57db [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:17:48.689342 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 21464
I20260811 08:17:48.689353 21583 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8799b7ed579644769a5b17738add57db [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:48.689468 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:17:48.689723 21114 external_mini_cluster.cc:1428] Setting key 3e305684a85dfebdf71e4373ac624e1c
I20260811 08:17:48.690142 21583 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8799b7ed579644769a5b17738add57db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8799b7ed579644769a5b17738add57db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40911 } }
I20260811 08:17:48.690258 21583 leader_election.cc:302] T 00000000000000000000000000000000 P 8799b7ed579644769a5b17738add57db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8799b7ed579644769a5b17738add57db; no voters:
I20260811 08:17:48.690438 21583 leader_election.cc:288] T 00000000000000000000000000000000 P 8799b7ed579644769a5b17738add57db [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:17:48.690471 21588 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8799b7ed579644769a5b17738add57db [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:17:48.690681 21588 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8799b7ed579644769a5b17738add57db [term 1 LEADER]: Becoming Leader. State: Replica: 8799b7ed579644769a5b17738add57db, State: Running, Role: LEADER
I20260811 08:17:48.690853 21583 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8799b7ed579644769a5b17738add57db [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:17:48.690821 21588 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8799b7ed579644769a5b17738add57db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8799b7ed579644769a5b17738add57db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40911 } }
I20260811 08:17:48.691383 21592 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8799b7ed579644769a5b17738add57db [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8799b7ed579644769a5b17738add57db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8799b7ed579644769a5b17738add57db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40911 } } }
I20260811 08:17:48.691493 21592 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8799b7ed579644769a5b17738add57db [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:48.691684 21593 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8799b7ed579644769a5b17738add57db [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8799b7ed579644769a5b17738add57db. Latest consensus state: current_term: 1 leader_uuid: "8799b7ed579644769a5b17738add57db" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8799b7ed579644769a5b17738add57db" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40911 } } }
I20260811 08:17:48.691785 21593 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8799b7ed579644769a5b17738add57db [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:48.692106 21595 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:17:48.692651 21595 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:17:48.694370 21595 catalog_manager.cc:1347] Generated new cluster ID: 378c8f74abf44f6f92a7c656d4864613
I20260811 08:17:48.694428 21595 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:17:48.696314 21587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:48.690257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:58713 (local address 127.0.0.1:40911)
0811 08:17:48.690459 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:48.690469 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:48.690512 (+ 43us) server_negotiation.cc:407] Connection header received
0811 08:17:48.690693 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:48.690701 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:48.690769 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:48.691186 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:48.691311 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:48.692817 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:48.693969 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:48.694550 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:48.694675 (+ 125us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:48.695448 (+ 773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:48.695452 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:48.695452 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:48.695712 (+ 260us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:48.695751 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:48.695767 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:48.695859 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:48.695948 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 08:17:48.696096 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":82,"threads_started":1}
I20260811 08:17:48.697206 21114 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:17:48.702584 21587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:48.698757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:50785 (local address 127.0.0.1:40911)
0811 08:17:48.698810 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:48.698812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:48.699058 (+ 246us) server_negotiation.cc:407] Connection header received
0811 08:17:48.699101 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:48.699102 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:48.699113 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:48.699168 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:48.699324 (+ 156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:48.700130 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:48.701140 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:48.701462 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:48.701563 (+ 101us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:48.702310 (+ 747us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:48.702311 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:48.702312 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:48.702316 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:48.702331 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:48.702336 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:48.702402 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:48.702474 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 08:17:48.702488 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260811 08:17:48.714128 21595 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:17:48.714720 21595 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:17:48.717895 21595 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8799b7ed579644769a5b17738add57db: Generated new TSK 0
I20260811 08:17:48.718148 21595 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:17:48.726531 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 21464
W20260811 08:17:48.740276 21445 connection.cc:535] client connection to 127.0.0.1:40911 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:40911): Connection reset by peer (error 104)
2026-08-11T08:17:48Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1631 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:17:48 dist-test-slave-gkw7 krb5kdc[21630](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:17:48 dist-test-slave-gkw7 krb5kdc[21630](info): set up 2 sockets
Aug 11 08:17:48 dist-test-slave-gkw7 krb5kdc[21630](info): commencing operation
krb5kdc: starting...
W20260811 08:17:50.012509 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.258s user 0.002s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:17:50 dist-test-slave-gkw7 krb5kdc[21630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436270, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:17:50Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:17:50Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:17:50.140846 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36463
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36099
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36463
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:50.225001 21653 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:50.225208 21653 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:50.225239 21653 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:50.226408 21653 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:17:50.226451 21653 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:50.226465 21653 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:50.226478 21653 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:17:50.226536 21653 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:17:50.227972 21653 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36099
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36463
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36463
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21653
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:50.228235 21653 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:50.228467 21653 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:50.233747 21661 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:50.233685 21665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:50.233685 21662 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:50.234099 21653 server_base.cc:1034] running on GCE node
I20260811 08:17:50.234457 21653 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:50.234838 21653 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:50.236018 21653 hybrid_clock.cc:648] HybridClock initialized: now 1786436270235991 us; error 40 us; skew 500 ppm
Aug 11 08:17:50 dist-test-slave-gkw7 krb5kdc[21630](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436270, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:50.238955 21653 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:17:50.239387 21653 webserver.cc:460] Webserver started at http://127.0.0.1:39689/ using document root <none> and password file <none>
I20260811 08:17:50.239573 21653 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:50.239617 21653 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:50.239709 21653 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:50.240703 21653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "8ae972fc87fe41bb8c36c5d6c63906f5"
format_stamp: "Formatted at 2026-08-11 08:17:50 on dist-test-slave-gkw7"
server_key: "60c8ffcb39c61ac518b1b3d37ed6ae8b"
server_key_iv: "eba726c7186d3cfbfbfa55fe4daa9e32"
server_key_version: "encryptionkey@0"
I20260811 08:17:50.241007 21653 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "8ae972fc87fe41bb8c36c5d6c63906f5"
format_stamp: "Formatted at 2026-08-11 08:17:50 on dist-test-slave-gkw7"
server_key: "60c8ffcb39c61ac518b1b3d37ed6ae8b"
server_key_iv: "eba726c7186d3cfbfbfa55fe4daa9e32"
server_key_version: "encryptionkey@0"
I20260811 08:17:50.242447 21653 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:17:50.243220 21675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:50.243441 21653 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:17:50.243541 21653 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "8ae972fc87fe41bb8c36c5d6c63906f5"
format_stamp: "Formatted at 2026-08-11 08:17:50 on dist-test-slave-gkw7"
server_key: "60c8ffcb39c61ac518b1b3d37ed6ae8b"
server_key_iv: "eba726c7186d3cfbfbfa55fe4daa9e32"
server_key_version: "encryptionkey@0"
I20260811 08:17:50.243602 21653 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:50.247291 21653 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:50.249289 21653 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:50.249418 21653 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:50.253705 21653 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36463
I20260811 08:17:50.253839 21757 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36463 every 8 connection(s)
I20260811 08:17:50.254153 21653 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:17:50.255388 21758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:50.256456 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 21653
I20260811 08:17:50.256608 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:17:50.256825 21114 external_mini_cluster.cc:1428] Setting key 4ae2d5e113ec30ef329b99f954fc84a1
I20260811 08:17:50.259183 21758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ae972fc87fe41bb8c36c5d6c63906f5: Bootstrap starting.
I20260811 08:17:50.259439 21762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:50.257453 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:57505 (local address 127.0.0.1:36463)
0811 08:17:50.257668 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:50.257676 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:50.257702 (+ 26us) server_negotiation.cc:407] Connection header received
0811 08:17:50.258104 (+ 402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:50.258110 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:50.258135 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:50.258249 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:50.258954 (+ 705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:50.258958 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:50.258958 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:50.258962 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:50.259000 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:50.259010 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:50.259066 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:50.259180 (+ 114us) server_negotiation.cc:299] Negotiation successful
0811 08:17:50.259245 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":102,"threads_started":1}
I20260811 08:17:50.259966 21758 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8ae972fc87fe41bb8c36c5d6c63906f5: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:50.260335 21758 log.cc:824] T 00000000000000000000000000000000 P 8ae972fc87fe41bb8c36c5d6c63906f5: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:50.260473 21114 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:17:50.261111 21758 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8ae972fc87fe41bb8c36c5d6c63906f5: No bootstrap required, opened a new log
I20260811 08:17:50.262998 21762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:50.261982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:40627 (local address 127.0.0.1:36463)
0811 08:17:50.262020 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:50.262021 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:50.262114 (+ 93us) server_negotiation.cc:407] Connection header received
0811 08:17:50.262191 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:50.262192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:50.262195 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:50.262241 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:50.262787 (+ 546us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:50.262788 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:50.262788 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:50.262792 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:50.262803 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:50.262806 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:50.262850 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:50.262913 (+ 63us) server_negotiation.cc:299] Negotiation successful
0811 08:17:50.262923 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:17:50.263845 21758 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8ae972fc87fe41bb8c36c5d6c63906f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ae972fc87fe41bb8c36c5d6c63906f5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36463 } }
I20260811 08:17:50.263989 21758 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8ae972fc87fe41bb8c36c5d6c63906f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:50.264014 21758 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8ae972fc87fe41bb8c36c5d6c63906f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8ae972fc87fe41bb8c36c5d6c63906f5, State: Initialized, Role: FOLLOWER
I20260811 08:17:50.264144 21758 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8ae972fc87fe41bb8c36c5d6c63906f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ae972fc87fe41bb8c36c5d6c63906f5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36463 } }
I20260811 08:17:50.264248 21758 raft_consensus.cc:388] T 00000000000000000000000000000000 P 8ae972fc87fe41bb8c36c5d6c63906f5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:17:50.264276 21758 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8ae972fc87fe41bb8c36c5d6c63906f5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:17:50.264315 21758 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8ae972fc87fe41bb8c36c5d6c63906f5 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:50.264937 21758 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8ae972fc87fe41bb8c36c5d6c63906f5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ae972fc87fe41bb8c36c5d6c63906f5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36463 } }
I20260811 08:17:50.265062 21758 leader_election.cc:302] T 00000000000000000000000000000000 P 8ae972fc87fe41bb8c36c5d6c63906f5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8ae972fc87fe41bb8c36c5d6c63906f5; no voters:
I20260811 08:17:50.265196 21758 leader_election.cc:288] T 00000000000000000000000000000000 P 8ae972fc87fe41bb8c36c5d6c63906f5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:17:50.265282 21769 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8ae972fc87fe41bb8c36c5d6c63906f5 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:17:50.265460 21769 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8ae972fc87fe41bb8c36c5d6c63906f5 [term 1 LEADER]: Becoming Leader. State: Replica: 8ae972fc87fe41bb8c36c5d6c63906f5, State: Running, Role: LEADER
I20260811 08:17:50.265465 21758 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8ae972fc87fe41bb8c36c5d6c63906f5 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:17:50.265691 21769 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8ae972fc87fe41bb8c36c5d6c63906f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ae972fc87fe41bb8c36c5d6c63906f5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36463 } }
I20260811 08:17:50.266040 21773 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ae972fc87fe41bb8c36c5d6c63906f5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8ae972fc87fe41bb8c36c5d6c63906f5. Latest consensus state: current_term: 1 leader_uuid: "8ae972fc87fe41bb8c36c5d6c63906f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ae972fc87fe41bb8c36c5d6c63906f5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36463 } } }
I20260811 08:17:50.266047 21772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8ae972fc87fe41bb8c36c5d6c63906f5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8ae972fc87fe41bb8c36c5d6c63906f5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8ae972fc87fe41bb8c36c5d6c63906f5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36463 } } }
I20260811 08:17:50.266150 21773 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ae972fc87fe41bb8c36c5d6c63906f5 [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:50.266153 21772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8ae972fc87fe41bb8c36c5d6c63906f5 [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:50.266855 21780 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:17:50.267403 21780 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:17:50.268949 21780 catalog_manager.cc:1347] Generated new cluster ID: e062f86a0f8d4af1a724517a5c4b0926
I20260811 08:17:50.269032 21780 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:17:50.282397 21780 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:17:50.282600 21780 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:17:50.290820 21780 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8ae972fc87fe41bb8c36c5d6c63906f5: Generated new TSK 0
I20260811 08:17:50.291054 21780 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:17:50.293522 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 21653
2026-08-11T08:17:50Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1568 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:17:50 dist-test-slave-gkw7 krb5kdc[21798](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:17:50 dist-test-slave-gkw7 krb5kdc[21798](info): set up 2 sockets
Aug 11 08:17:50 dist-test-slave-gkw7 krb5kdc[21798](info): commencing operation
krb5kdc: starting...
W20260811 08:17:51.570999 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.248s user 0.003s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:17:51 dist-test-slave-gkw7 krb5kdc[21798](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436271, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:17:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:17:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:17:51.701254 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43261
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46669
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43261
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:51.786348 21816 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:51.786599 21816 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:51.786644 21816 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:51.787791 21816 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:17:51.787864 21816 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:51.787887 21816 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:51.787909 21816 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:17:51.787938 21816 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:17:51.789386 21816 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46669
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43261
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43261
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21816
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:51.789695 21816 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:51.789925 21816 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:51.795035 21823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:51.795028 21828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:51.795029 21825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:51.795399 21816 server_base.cc:1034] running on GCE node
I20260811 08:17:51.795714 21816 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:51.796023 21816 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:51.797273 21816 hybrid_clock.cc:648] HybridClock initialized: now 1786436271797244 us; error 42 us; skew 500 ppm
Aug 11 08:17:51 dist-test-slave-gkw7 krb5kdc[21798](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436271, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:51.800127 21816 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:17:51.800697 21816 webserver.cc:460] Webserver started at http://127.0.0.1:41831/ using document root <none> and password file <none>
I20260811 08:17:51.800954 21816 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:51.801031 21816 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:51.801251 21816 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:51.802544 21816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "b8695afd4e024eae9e33e4d63736c0c1"
format_stamp: "Formatted at 2026-08-11 08:17:51 on dist-test-slave-gkw7"
server_key: "7fdc9ae7824dafab6ab6aabb7d516498"
server_key_iv: "7fd47ef0e309efb06472e62bf72cb52d"
server_key_version: "encryptionkey@0"
I20260811 08:17:51.802963 21816 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "b8695afd4e024eae9e33e4d63736c0c1"
format_stamp: "Formatted at 2026-08-11 08:17:51 on dist-test-slave-gkw7"
server_key: "7fdc9ae7824dafab6ab6aabb7d516498"
server_key_iv: "7fd47ef0e309efb06472e62bf72cb52d"
server_key_version: "encryptionkey@0"
I20260811 08:17:51.804553 21816 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:17:51.805526 21837 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:51.805783 21816 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:17:51.805899 21816 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "b8695afd4e024eae9e33e4d63736c0c1"
format_stamp: "Formatted at 2026-08-11 08:17:51 on dist-test-slave-gkw7"
server_key: "7fdc9ae7824dafab6ab6aabb7d516498"
server_key_iv: "7fd47ef0e309efb06472e62bf72cb52d"
server_key_version: "encryptionkey@0"
I20260811 08:17:51.805992 21816 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:51.820161 21816 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:51.822372 21816 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:51.822549 21816 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:51.827068 21816 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43261
I20260811 08:17:51.827107 21915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43261 every 8 connection(s)
I20260811 08:17:51.827531 21816 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:17:51.828480 21916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:51.830991 21916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8695afd4e024eae9e33e4d63736c0c1: Bootstrap starting.
I20260811 08:17:51.831640 21916 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8695afd4e024eae9e33e4d63736c0c1: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:51.831943 21916 log.cc:824] T 00000000000000000000000000000000 P b8695afd4e024eae9e33e4d63736c0c1: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:51.832710 21916 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8695afd4e024eae9e33e4d63736c0c1: No bootstrap required, opened a new log
I20260811 08:17:51.834372 21916 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8695afd4e024eae9e33e4d63736c0c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8695afd4e024eae9e33e4d63736c0c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43261 } }
I20260811 08:17:51.834537 21916 raft_consensus.cc:374] T 00000000000000000000000000000000 P b8695afd4e024eae9e33e4d63736c0c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:51.834559 21916 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8695afd4e024eae9e33e4d63736c0c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8695afd4e024eae9e33e4d63736c0c1, State: Initialized, Role: FOLLOWER
I20260811 08:17:51.834722 21916 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8695afd4e024eae9e33e4d63736c0c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8695afd4e024eae9e33e4d63736c0c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43261 } }
I20260811 08:17:51.834805 21916 raft_consensus.cc:388] T 00000000000000000000000000000000 P b8695afd4e024eae9e33e4d63736c0c1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:17:51.834828 21916 raft_consensus.cc:482] T 00000000000000000000000000000000 P b8695afd4e024eae9e33e4d63736c0c1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:17:51.834909 21916 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8695afd4e024eae9e33e4d63736c0c1 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:51.835470 21916 raft_consensus.cc:504] T 00000000000000000000000000000000 P b8695afd4e024eae9e33e4d63736c0c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8695afd4e024eae9e33e4d63736c0c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43261 } }
I20260811 08:17:51.835589 21916 leader_election.cc:302] T 00000000000000000000000000000000 P b8695afd4e024eae9e33e4d63736c0c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b8695afd4e024eae9e33e4d63736c0c1; no voters:
I20260811 08:17:51.835779 21916 leader_election.cc:288] T 00000000000000000000000000000000 P b8695afd4e024eae9e33e4d63736c0c1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:17:51.835842 21923 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b8695afd4e024eae9e33e4d63736c0c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:17:51.836023 21923 raft_consensus.cc:686] T 00000000000000000000000000000000 P b8695afd4e024eae9e33e4d63736c0c1 [term 1 LEADER]: Becoming Leader. State: Replica: b8695afd4e024eae9e33e4d63736c0c1, State: Running, Role: LEADER
I20260811 08:17:51.836048 21916 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8695afd4e024eae9e33e4d63736c0c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:17:51.836123 21923 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8695afd4e024eae9e33e4d63736c0c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8695afd4e024eae9e33e4d63736c0c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43261 } }
I20260811 08:17:51.836540 21926 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8695afd4e024eae9e33e4d63736c0c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8695afd4e024eae9e33e4d63736c0c1. Latest consensus state: current_term: 1 leader_uuid: "b8695afd4e024eae9e33e4d63736c0c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8695afd4e024eae9e33e4d63736c0c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43261 } } }
I20260811 08:17:51.836643 21926 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8695afd4e024eae9e33e4d63736c0c1 [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:51.836790 21924 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8695afd4e024eae9e33e4d63736c0c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b8695afd4e024eae9e33e4d63736c0c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8695afd4e024eae9e33e4d63736c0c1" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43261 } } }
I20260811 08:17:51.836944 21924 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8695afd4e024eae9e33e4d63736c0c1 [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:51.837131 21933 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:17:51.837621 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 21816
I20260811 08:17:51.837769 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:17:51.838006 21114 external_mini_cluster.cc:1428] Setting key 55f6b0cda8678581409c8091577b4eb2
I20260811 08:17:51.838151 21933 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:17:51.842005 21933 catalog_manager.cc:1347] Generated new cluster ID: f357fd26d84748a3b4f0f0b0ec851a0a
I20260811 08:17:51.842061 21933 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Aug 11 08:17:51 dist-test-slave-gkw7 krb5kdc[21798](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436271, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260811 08:17:51.849627 21947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:51.838542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:53045 (local address 127.0.0.1:43261)
0811 08:17:51.838951 (+ 409us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:51.838961 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:51.839004 (+ 43us) server_negotiation.cc:407] Connection header received
0811 08:17:51.839103 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:51.839108 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:51.839189 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:51.839341 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:51.840001 (+ 660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:51.840945 (+ 944us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:51.841845 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:51.842512 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:51.842636 (+ 124us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:51.845671 (+ 3035us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:51.845675 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:51.845675 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:17:51.845689 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:51.847761 (+ 2072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:51.848253 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:51.848256 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:51.848256 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:51.848366 (+ 110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:51.848624 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:51.848625 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:51.848626 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:51.848947 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:51.849105 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:51.849258 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 08:17:51.849358 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":273,"thread_start_us":98,"threads_started":1}
I20260811 08:17:51.850817 21114 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:17:51.859722 21947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:51.852257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:37757 (local address 127.0.0.1:43261)
0811 08:17:51.852291 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:51.852293 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:51.852429 (+ 136us) server_negotiation.cc:407] Connection header received
0811 08:17:51.852485 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:51.852486 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:51.852496 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:51.852550 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:51.853170 (+ 620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:51.853934 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:51.854968 (+ 1034us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:51.855287 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:51.855351 (+ 64us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:51.856794 (+ 1443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:51.856795 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:51.856796 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:17:51.856803 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:51.858445 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:51.858890 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:51.858891 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:51.858891 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:51.858949 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:51.859188 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:51.859189 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:51.859189 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:51.859309 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:51.859404 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:51.859566 (+ 162us) server_negotiation.cc:299] Negotiation successful
0811 08:17:51.859630 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260811 08:17:51.895728 21933 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:17:51.896486 21933 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:17:51.901705 21933 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b8695afd4e024eae9e33e4d63736c0c1: Generated new TSK 0
I20260811 08:17:51.901923 21933 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:17:51.905519 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 21816
W20260811 08:17:51.921919 21795 connection.cc:535] client connection to 127.0.0.1:43261 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43261): Connection reset by peer (error 104)
2026-08-11T08:17:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1613 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:17:51 dist-test-slave-gkw7 krb5kdc[21961](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:17:51 dist-test-slave-gkw7 krb5kdc[21961](info): set up 2 sockets
Aug 11 08:17:51 dist-test-slave-gkw7 krb5kdc[21961](info): commencing operation
krb5kdc: starting...
W20260811 08:17:53.211198 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.275s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:17:53 dist-test-slave-gkw7 krb5kdc[21961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436273, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:17:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:17:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:17:53.340806 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44469
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40299
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44469
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:53.425786 21985 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:53.426045 21985 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:53.426096 21985 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:53.427279 21985 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:17:53.427359 21985 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:53.427383 21985 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:53.427405 21985 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:17:53.427433 21985 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:17:53.428959 21985 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40299
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44469
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44469
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.21985
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:53.429266 21985 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:53.429517 21985 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:53.434763 21999 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:53.434758 22001 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:53.434994 21985 server_base.cc:1034] running on GCE node
W20260811 08:17:53.434794 21997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:53.435338 21985 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:53.435684 21985 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:53.436858 21985 hybrid_clock.cc:648] HybridClock initialized: now 1786436273436835 us; error 39 us; skew 500 ppm
Aug 11 08:17:53 dist-test-slave-gkw7 krb5kdc[21961](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436273, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:53.439503 21985 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:17:53.439953 21985 webserver.cc:460] Webserver started at http://127.0.0.1:35707/ using document root <none> and password file <none>
I20260811 08:17:53.440196 21985 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:53.440265 21985 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:53.440418 21985 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:53.441612 21985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "52670d8678374ba0bd6b8d2eff01899b"
format_stamp: "Formatted at 2026-08-11 08:17:53 on dist-test-slave-gkw7"
server_key: "d9f6bd4713ce7449b96b9809cfefb524"
server_key_iv: "7e7639fad574dd8b3e20bf791e83b3aa"
server_key_version: "encryptionkey@0"
I20260811 08:17:53.442016 21985 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "52670d8678374ba0bd6b8d2eff01899b"
format_stamp: "Formatted at 2026-08-11 08:17:53 on dist-test-slave-gkw7"
server_key: "d9f6bd4713ce7449b96b9809cfefb524"
server_key_iv: "7e7639fad574dd8b3e20bf791e83b3aa"
server_key_version: "encryptionkey@0"
I20260811 08:17:53.443434 21985 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 08:17:53.444325 22011 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:53.444586 21985 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:17:53.444710 21985 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "52670d8678374ba0bd6b8d2eff01899b"
format_stamp: "Formatted at 2026-08-11 08:17:53 on dist-test-slave-gkw7"
server_key: "d9f6bd4713ce7449b96b9809cfefb524"
server_key_iv: "7e7639fad574dd8b3e20bf791e83b3aa"
server_key_version: "encryptionkey@0"
I20260811 08:17:53.444789 21985 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:53.460992 21985 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:53.463384 21985 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:53.463558 21985 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:53.467859 21985 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44469
I20260811 08:17:53.467905 22090 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44469 every 8 connection(s)
I20260811 08:17:53.468297 21985 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:17:53.469403 22092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:53.472188 22092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52670d8678374ba0bd6b8d2eff01899b: Bootstrap starting.
I20260811 08:17:53.472900 22092 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 52670d8678374ba0bd6b8d2eff01899b: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:53.473261 22092 log.cc:824] T 00000000000000000000000000000000 P 52670d8678374ba0bd6b8d2eff01899b: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:53.474189 22092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 52670d8678374ba0bd6b8d2eff01899b: No bootstrap required, opened a new log
I20260811 08:17:53.476037 22092 raft_consensus.cc:348] T 00000000000000000000000000000000 P 52670d8678374ba0bd6b8d2eff01899b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52670d8678374ba0bd6b8d2eff01899b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44469 } }
I20260811 08:17:53.476204 22092 raft_consensus.cc:374] T 00000000000000000000000000000000 P 52670d8678374ba0bd6b8d2eff01899b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:53.476233 22092 raft_consensus.cc:729] T 00000000000000000000000000000000 P 52670d8678374ba0bd6b8d2eff01899b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52670d8678374ba0bd6b8d2eff01899b, State: Initialized, Role: FOLLOWER
I20260811 08:17:53.476434 22092 consensus_queue.cc:260] T 00000000000000000000000000000000 P 52670d8678374ba0bd6b8d2eff01899b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52670d8678374ba0bd6b8d2eff01899b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44469 } }
I20260811 08:17:53.476513 22092 raft_consensus.cc:388] T 00000000000000000000000000000000 P 52670d8678374ba0bd6b8d2eff01899b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:17:53.476547 22092 raft_consensus.cc:482] T 00000000000000000000000000000000 P 52670d8678374ba0bd6b8d2eff01899b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:17:53.476632 22092 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 52670d8678374ba0bd6b8d2eff01899b [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:53.476814 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 21985
I20260811 08:17:53.476960 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:17:53.477183 21114 external_mini_cluster.cc:1428] Setting key f3dc976d39e45e639341b223e5c59f0e
I20260811 08:17:53.477566 22092 raft_consensus.cc:504] T 00000000000000000000000000000000 P 52670d8678374ba0bd6b8d2eff01899b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52670d8678374ba0bd6b8d2eff01899b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44469 } }
I20260811 08:17:53.477720 22092 leader_election.cc:302] T 00000000000000000000000000000000 P 52670d8678374ba0bd6b8d2eff01899b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 52670d8678374ba0bd6b8d2eff01899b; no voters:
I20260811 08:17:53.477946 22092 leader_election.cc:288] T 00000000000000000000000000000000 P 52670d8678374ba0bd6b8d2eff01899b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:17:53.478052 22096 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 52670d8678374ba0bd6b8d2eff01899b [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:17:53.478259 22096 raft_consensus.cc:686] T 00000000000000000000000000000000 P 52670d8678374ba0bd6b8d2eff01899b [term 1 LEADER]: Becoming Leader. State: Replica: 52670d8678374ba0bd6b8d2eff01899b, State: Running, Role: LEADER
I20260811 08:17:53.478286 22092 sys_catalog.cc:564] T 00000000000000000000000000000000 P 52670d8678374ba0bd6b8d2eff01899b [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:17:53.478425 22096 consensus_queue.cc:237] T 00000000000000000000000000000000 P 52670d8678374ba0bd6b8d2eff01899b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52670d8678374ba0bd6b8d2eff01899b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44469 } }
I20260811 08:17:53.479777 22099 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52670d8678374ba0bd6b8d2eff01899b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "52670d8678374ba0bd6b8d2eff01899b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52670d8678374ba0bd6b8d2eff01899b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44469 } } }
I20260811 08:17:53.479897 22099 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52670d8678374ba0bd6b8d2eff01899b [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:53.480217 22098 sys_catalog.cc:455] T 00000000000000000000000000000000 P 52670d8678374ba0bd6b8d2eff01899b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 52670d8678374ba0bd6b8d2eff01899b. Latest consensus state: current_term: 1 leader_uuid: "52670d8678374ba0bd6b8d2eff01899b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "52670d8678374ba0bd6b8d2eff01899b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44469 } } }
I20260811 08:17:53.480332 22098 sys_catalog.cc:458] T 00000000000000000000000000000000 P 52670d8678374ba0bd6b8d2eff01899b [sys.catalog]: This master's current role is: LEADER
W20260811 08:17:53.480669 22120 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 52670d8678374ba0bd6b8d2eff01899b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:17:53.480733 22120 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:17:53.480795 22118 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:17:53.480968 22118 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:17:53.482594 22118 catalog_manager.cc:1347] Generated new cluster ID: e220f69fc1e14abdabff008026fd19f3
I20260811 08:17:53.482666 22118 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:17:53.484567 22097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:53.477853 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:57879 (local address 127.0.0.1:44469)
0811 08:17:53.478228 (+ 375us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:53.478239 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:53.478281 (+ 42us) server_negotiation.cc:407] Connection header received
0811 08:17:53.478418 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:53.478426 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:53.478495 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:53.478950 (+ 455us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:53.479083 (+ 133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:53.480769 (+ 1686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:53.482141 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:53.482758 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:53.482885 (+ 127us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:53.483774 (+ 889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:53.483778 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:53.483779 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:53.484004 (+ 225us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:53.484043 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:53.484058 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:53.484150 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:53.484310 (+ 160us) server_negotiation.cc:299] Negotiation successful
0811 08:17:53.484341 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":234,"thread_start_us":144,"threads_started":1}
I20260811 08:17:53.485709 21114 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:17:53.491715 22097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:53.487387 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:42769 (local address 127.0.0.1:44469)
0811 08:17:53.487424 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:53.487426 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:53.487738 (+ 312us) server_negotiation.cc:407] Connection header received
0811 08:17:53.487816 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:53.487817 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:53.487829 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:53.487884 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:53.488070 (+ 186us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:53.488883 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:53.490101 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:53.490475 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:53.490540 (+ 65us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:53.491415 (+ 875us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:53.491416 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:53.491417 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:53.491422 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:53.491438 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:53.491443 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:53.491503 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:53.491624 (+ 121us) server_negotiation.cc:299] Negotiation successful
0811 08:17:53.491638 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 08:17:53.492842 22118 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:17:53.493434 22118 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:17:53.500895 22118 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 52670d8678374ba0bd6b8d2eff01899b: Generated new TSK 0
I20260811 08:17:53.501142 22118 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:17:53.504323 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 21985
W20260811 08:17:53.519521 21957 connection.cc:535] client connection to 127.0.0.1:44469 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44469): Connection reset by peer (error 104)
2026-08-11T08:17:53Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1597 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:17:53 dist-test-slave-gkw7 krb5kdc[22136](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:17:53 dist-test-slave-gkw7 krb5kdc[22136](info): set up 2 sockets
Aug 11 08:17:53 dist-test-slave-gkw7 krb5kdc[22136](info): commencing operation
krb5kdc: starting...
W20260811 08:17:54.864859 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.331s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:17:54 dist-test-slave-gkw7 krb5kdc[22136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436274, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:17:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:17:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260811 08:17:55.000706 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42213
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:42213
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:55.087270 22155 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:55.087531 22155 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:55.087575 22155 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:55.088733 22155 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:17:55.088810 22155 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:55.088835 22155 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:55.088855 22155 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:17:55.088886 22155 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:17:55.090430 22155 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:42213
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786436003833085-21114-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:42213
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22155
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:55.090739 22155 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:55.090986 22155 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:55.096470 22166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:55.096580 22164 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:55.096472 22163 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:55.096524 22155 server_base.cc:1034] running on GCE node
I20260811 08:17:55.097043 22155 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:55.097386 22155 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:55.098543 22155 hybrid_clock.cc:648] HybridClock initialized: now 1786436275098524 us; error 39 us; skew 500 ppm
Aug 11 08:17:55 dist-test-slave-gkw7 krb5kdc[22136](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436275, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:55.101336 22155 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260811 08:17:55.101928 22155 webserver.cc:460] Webserver started at http://127.0.0.1:43109/ using document root <none> and password file <none>
I20260811 08:17:55.102188 22155 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:55.102242 22155 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:55.102402 22155 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:55.103590 22155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "ee7ea63faa73409cb9e4994709b93cda"
format_stamp: "Formatted at 2026-08-11 08:17:55 on dist-test-slave-gkw7"
server_key: "74d0a248f03c2e88a1932098a262fb8e"
server_key_iv: "7e27eaaa65fad91bd3f495fb9905745c"
server_key_version: "encryptionkey@0"
I20260811 08:17:55.103986 22155 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "ee7ea63faa73409cb9e4994709b93cda"
format_stamp: "Formatted at 2026-08-11 08:17:55 on dist-test-slave-gkw7"
server_key: "74d0a248f03c2e88a1932098a262fb8e"
server_key_iv: "7e27eaaa65fad91bd3f495fb9905745c"
server_key_version: "encryptionkey@0"
I20260811 08:17:55.105479 22155 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:17:55.106498 22174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:55.106752 22155 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:17:55.106891 22155 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "ee7ea63faa73409cb9e4994709b93cda"
format_stamp: "Formatted at 2026-08-11 08:17:55 on dist-test-slave-gkw7"
server_key: "74d0a248f03c2e88a1932098a262fb8e"
server_key_iv: "7e27eaaa65fad91bd3f495fb9905745c"
server_key_version: "encryptionkey@0"
I20260811 08:17:55.106987 22155 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:55.110944 22155 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:55.113303 22155 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:55.113487 22155 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:55.117920 22155 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:42213
I20260811 08:17:55.117954 22254 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:42213 every 8 connection(s)
I20260811 08:17:55.118330 22155 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:17:55.119367 22258 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:55.121778 22258 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee7ea63faa73409cb9e4994709b93cda: Bootstrap starting.
I20260811 08:17:55.122412 22258 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ee7ea63faa73409cb9e4994709b93cda: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:55.122722 22258 log.cc:824] T 00000000000000000000000000000000 P ee7ea63faa73409cb9e4994709b93cda: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:55.123466 22258 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ee7ea63faa73409cb9e4994709b93cda: No bootstrap required, opened a new log
I20260811 08:17:55.125077 22258 raft_consensus.cc:348] T 00000000000000000000000000000000 P ee7ea63faa73409cb9e4994709b93cda [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee7ea63faa73409cb9e4994709b93cda" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42213 } }
I20260811 08:17:55.125221 22258 raft_consensus.cc:374] T 00000000000000000000000000000000 P ee7ea63faa73409cb9e4994709b93cda [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:55.125252 22258 raft_consensus.cc:729] T 00000000000000000000000000000000 P ee7ea63faa73409cb9e4994709b93cda [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee7ea63faa73409cb9e4994709b93cda, State: Initialized, Role: FOLLOWER
I20260811 08:17:55.125425 22258 consensus_queue.cc:260] T 00000000000000000000000000000000 P ee7ea63faa73409cb9e4994709b93cda [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee7ea63faa73409cb9e4994709b93cda" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42213 } }
I20260811 08:17:55.125489 22258 raft_consensus.cc:388] T 00000000000000000000000000000000 P ee7ea63faa73409cb9e4994709b93cda [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:17:55.125581 22258 raft_consensus.cc:482] T 00000000000000000000000000000000 P ee7ea63faa73409cb9e4994709b93cda [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:17:55.125641 22258 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ee7ea63faa73409cb9e4994709b93cda [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:55.126212 22258 raft_consensus.cc:504] T 00000000000000000000000000000000 P ee7ea63faa73409cb9e4994709b93cda [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee7ea63faa73409cb9e4994709b93cda" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42213 } }
I20260811 08:17:55.126335 22258 leader_election.cc:302] T 00000000000000000000000000000000 P ee7ea63faa73409cb9e4994709b93cda [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee7ea63faa73409cb9e4994709b93cda; no voters:
I20260811 08:17:55.126528 22258 leader_election.cc:288] T 00000000000000000000000000000000 P ee7ea63faa73409cb9e4994709b93cda [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:17:55.126590 22261 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ee7ea63faa73409cb9e4994709b93cda [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:17:55.126803 22258 sys_catalog.cc:564] T 00000000000000000000000000000000 P ee7ea63faa73409cb9e4994709b93cda [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:17:55.126801 22261 raft_consensus.cc:686] T 00000000000000000000000000000000 P ee7ea63faa73409cb9e4994709b93cda [term 1 LEADER]: Becoming Leader. State: Replica: ee7ea63faa73409cb9e4994709b93cda, State: Running, Role: LEADER
I20260811 08:17:55.127018 22261 consensus_queue.cc:237] T 00000000000000000000000000000000 P ee7ea63faa73409cb9e4994709b93cda [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee7ea63faa73409cb9e4994709b93cda" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42213 } }
I20260811 08:17:55.127142 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 22155
I20260811 08:17:55.127274 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:17:55.127496 21114 external_mini_cluster.cc:1428] Setting key 5efa8862da1604a28bb90ab28848d1a4
I20260811 08:17:55.127699 22263 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee7ea63faa73409cb9e4994709b93cda [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee7ea63faa73409cb9e4994709b93cda. Latest consensus state: current_term: 1 leader_uuid: "ee7ea63faa73409cb9e4994709b93cda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee7ea63faa73409cb9e4994709b93cda" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42213 } } }
I20260811 08:17:55.127790 22263 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee7ea63faa73409cb9e4994709b93cda [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:55.128187 22262 sys_catalog.cc:455] T 00000000000000000000000000000000 P ee7ea63faa73409cb9e4994709b93cda [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee7ea63faa73409cb9e4994709b93cda" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee7ea63faa73409cb9e4994709b93cda" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 42213 } } }
I20260811 08:17:55.128262 22262 sys_catalog.cc:458] T 00000000000000000000000000000000 P ee7ea63faa73409cb9e4994709b93cda [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:55.128564 22273 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:17:55.129079 22273 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:17:55.130751 22273 catalog_manager.cc:1347] Generated new cluster ID: 57aa3c4d3c334499b13ab1807d33818a
I20260811 08:17:55.130806 22273 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:17:55.131479 22280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:55.128412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:42015 (local address 127.0.0.1:42213)
0811 08:17:55.128556 (+ 144us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:55.128567 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:55.129882 (+ 1315us) server_negotiation.cc:407] Connection header received
0811 08:17:55.130008 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:55.130015 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:55.130064 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:55.130262 (+ 198us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:55.131025 (+ 763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:55.131029 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:55.131029 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:55.131033 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:55.131081 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:55.131092 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:55.131166 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:55.131238 (+ 72us) server_negotiation.cc:299] Negotiation successful
0811 08:17:55.131292 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":65,"threads_started":1}
I20260811 08:17:55.132390 21114 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:17:55.134950 22280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:55.133781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.125:36891 (local address 127.0.0.1:42213)
0811 08:17:55.133818 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:55.133820 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:55.133958 (+ 138us) server_negotiation.cc:407] Connection header received
0811 08:17:55.134030 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:55.134031 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:55.134037 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:55.134093 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:55.134707 (+ 614us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:55.134708 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:55.134708 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:55.134712 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:55.134727 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:55.134731 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:55.134791 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:55.134852 (+ 61us) server_negotiation.cc:299] Negotiation successful
0811 08:17:55.134867 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:17:55.147435 22273 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:17:55.147624 22273 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:17:55.150302 22273 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ee7ea63faa73409cb9e4994709b93cda: Generated new TSK 0
I20260811 08:17:55.150475 22273 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:17:55.157946 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 22155
2026-08-11T08:17:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1654 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:17:55 dist-test-slave-gkw7 krb5kdc[22295](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:17:55 dist-test-slave-gkw7 krb5kdc[22295](info): set up 2 sockets
Aug 11 08:17:55 dist-test-slave-gkw7 krb5kdc[22295](info): commencing operation
krb5kdc: starting...
W20260811 08:17:56.448088 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.260s user 0.004s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:17:56 dist-test-slave-gkw7 krb5kdc[22295](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436276, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:17:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:17:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:17:56.577661 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:37179
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:43479
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:37179
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:56.661931 22321 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:56.662148 22321 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:56.662171 22321 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:56.663368 22321 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:17:56.663414 22321 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:56.663429 22321 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:56.663441 22321 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:17:56.663453 22321 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:17:56.664907 22321 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:43479
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:37179
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:37179
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22321
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:56.665095 22321 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:56.665273 22321 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:56.670696 22326 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:56.670710 22327 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:56.670825 22329 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:56.670842 22321 server_base.cc:1034] running on GCE node
I20260811 08:17:56.671329 22321 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:56.671664 22321 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:56.672848 22321 hybrid_clock.cc:648] HybridClock initialized: now 1786436276672844 us; error 40 us; skew 500 ppm
Aug 11 08:17:56 dist-test-slave-gkw7 krb5kdc[22295](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436276, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:56.675631 22321 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:17:56.676108 22321 webserver.cc:460] Webserver started at http://127.20.158.190:41451/ using document root <none> and password file <none>
I20260811 08:17:56.676353 22321 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:56.676425 22321 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:56.676577 22321 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:56.677752 22321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "f6197f43c2914b4f848d6c8f62f67ac0"
format_stamp: "Formatted at 2026-08-11 08:17:56 on dist-test-slave-gkw7"
server_key: "ca88ebbba6e634fa99fd71d2182c296c"
server_key_iv: "c2b2cc0c9250fcc6f3fe393b5768b045"
server_key_version: "encryptionkey@0"
I20260811 08:17:56.678123 22321 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "f6197f43c2914b4f848d6c8f62f67ac0"
format_stamp: "Formatted at 2026-08-11 08:17:56 on dist-test-slave-gkw7"
server_key: "ca88ebbba6e634fa99fd71d2182c296c"
server_key_iv: "c2b2cc0c9250fcc6f3fe393b5768b045"
server_key_version: "encryptionkey@0"
I20260811 08:17:56.679545 22321 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:17:56.680456 22339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:56.680668 22321 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:17:56.680794 22321 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "f6197f43c2914b4f848d6c8f62f67ac0"
format_stamp: "Formatted at 2026-08-11 08:17:56 on dist-test-slave-gkw7"
server_key: "ca88ebbba6e634fa99fd71d2182c296c"
server_key_iv: "c2b2cc0c9250fcc6f3fe393b5768b045"
server_key_version: "encryptionkey@0"
I20260811 08:17:56.680881 22321 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:56.713757 22321 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:56.716547 22321 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:56.716756 22321 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:56.721740 22321 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:37179
I20260811 08:17:56.721808 22407 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:37179 every 8 connection(s)
I20260811 08:17:56.722250 22321 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:17:56.723199 22408 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:56.723618 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 22321
I20260811 08:17:56.723773 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:17:56.723978 21114 external_mini_cluster.cc:1428] Setting key e0a2c1918ccc1ed0b3d75bf832060346
I20260811 08:17:56.725999 22408 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6197f43c2914b4f848d6c8f62f67ac0: Bootstrap starting.
I20260811 08:17:56.726604 22408 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f6197f43c2914b4f848d6c8f62f67ac0: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:56.726902 22408 log.cc:824] T 00000000000000000000000000000000 P f6197f43c2914b4f848d6c8f62f67ac0: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:56.727613 22408 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f6197f43c2914b4f848d6c8f62f67ac0: No bootstrap required, opened a new log
I20260811 08:17:56.729512 22408 raft_consensus.cc:348] T 00000000000000000000000000000000 P f6197f43c2914b4f848d6c8f62f67ac0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6197f43c2914b4f848d6c8f62f67ac0" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37179 } }
I20260811 08:17:56.729748 22408 raft_consensus.cc:374] T 00000000000000000000000000000000 P f6197f43c2914b4f848d6c8f62f67ac0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:56.729799 22408 raft_consensus.cc:729] T 00000000000000000000000000000000 P f6197f43c2914b4f848d6c8f62f67ac0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6197f43c2914b4f848d6c8f62f67ac0, State: Initialized, Role: FOLLOWER
I20260811 08:17:56.729938 22408 consensus_queue.cc:260] T 00000000000000000000000000000000 P f6197f43c2914b4f848d6c8f62f67ac0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6197f43c2914b4f848d6c8f62f67ac0" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37179 } }
I20260811 08:17:56.730036 22408 raft_consensus.cc:388] T 00000000000000000000000000000000 P f6197f43c2914b4f848d6c8f62f67ac0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:17:56.730080 22408 raft_consensus.cc:482] T 00000000000000000000000000000000 P f6197f43c2914b4f848d6c8f62f67ac0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:17:56.730131 22408 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f6197f43c2914b4f848d6c8f62f67ac0 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:56.730669 22408 raft_consensus.cc:504] T 00000000000000000000000000000000 P f6197f43c2914b4f848d6c8f62f67ac0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6197f43c2914b4f848d6c8f62f67ac0" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37179 } }
I20260811 08:17:56.730786 22408 leader_election.cc:302] T 00000000000000000000000000000000 P f6197f43c2914b4f848d6c8f62f67ac0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f6197f43c2914b4f848d6c8f62f67ac0; no voters:
I20260811 08:17:56.730947 22408 leader_election.cc:288] T 00000000000000000000000000000000 P f6197f43c2914b4f848d6c8f62f67ac0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:17:56.731019 22415 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f6197f43c2914b4f848d6c8f62f67ac0 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:17:56.731215 22408 sys_catalog.cc:564] T 00000000000000000000000000000000 P f6197f43c2914b4f848d6c8f62f67ac0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:17:56.731240 22415 raft_consensus.cc:686] T 00000000000000000000000000000000 P f6197f43c2914b4f848d6c8f62f67ac0 [term 1 LEADER]: Becoming Leader. State: Replica: f6197f43c2914b4f848d6c8f62f67ac0, State: Running, Role: LEADER
I20260811 08:17:56.731400 22415 consensus_queue.cc:237] T 00000000000000000000000000000000 P f6197f43c2914b4f848d6c8f62f67ac0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6197f43c2914b4f848d6c8f62f67ac0" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37179 } }
Aug 11 08:17:56 dist-test-slave-gkw7 krb5kdc[22295](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436276, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:17:56.731805 22416 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6197f43c2914b4f848d6c8f62f67ac0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f6197f43c2914b4f848d6c8f62f67ac0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6197f43c2914b4f848d6c8f62f67ac0" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37179 } } }
I20260811 08:17:56.731894 22416 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6197f43c2914b4f848d6c8f62f67ac0 [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:56.732185 22418 sys_catalog.cc:455] T 00000000000000000000000000000000 P f6197f43c2914b4f848d6c8f62f67ac0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f6197f43c2914b4f848d6c8f62f67ac0. Latest consensus state: current_term: 1 leader_uuid: "f6197f43c2914b4f848d6c8f62f67ac0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f6197f43c2914b4f848d6c8f62f67ac0" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 37179 } } }
I20260811 08:17:56.732332 22418 sys_catalog.cc:458] T 00000000000000000000000000000000 P f6197f43c2914b4f848d6c8f62f67ac0 [sys.catalog]: This master's current role is: LEADER
W20260811 08:17:56.733182 22437 catalog_manager.cc:1558] T 00000000000000000000000000000000 P f6197f43c2914b4f848d6c8f62f67ac0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:17:56.733297 22437 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:17:56.733374 22427 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:17:56.733629 22427 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:17:56.735313 22427 catalog_manager.cc:1347] Generated new cluster ID: 9eba473a4d8e4f5ba031129f12800ccb
I20260811 08:17:56.735371 22427 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:17:56.736243 22413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:56.724597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34341 (local address 127.20.158.190:37179)
0811 08:17:56.724813 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:56.724824 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:56.724858 (+ 34us) server_negotiation.cc:407] Connection header received
0811 08:17:56.725297 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:56.725304 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:56.725355 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:56.725516 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:56.726336 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:56.727462 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:56.728396 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:56.728951 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:56.729083 (+ 132us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:56.732265 (+ 3182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:56.732270 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:56.732270 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:17:56.732284 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:56.734397 (+ 2113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:56.734899 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:56.734902 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:56.734902 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:56.735007 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:56.735298 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:56.735299 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:56.735299 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:56.735608 (+ 309us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:56.735791 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:56.735994 (+ 203us) server_negotiation.cc:299] Negotiation successful
0811 08:17:56.736103 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":86,"threads_started":1}
I20260811 08:17:56.737284 21114 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:17:56.750500 22427 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:17:56.751336 22427 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:17:56.753088 22413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:56.745995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48187 (local address 127.20.158.190:37179)
0811 08:17:56.746045 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:56.746048 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:56.746319 (+ 271us) server_negotiation.cc:407] Connection header received
0811 08:17:56.746563 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:56.746565 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:56.746577 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:56.746652 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:56.747239 (+ 587us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:56.747757 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:56.748474 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:56.748695 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:56.748791 (+ 96us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:56.750194 (+ 1403us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:56.750195 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:56.750196 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:17:56.750204 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:56.751874 (+ 1670us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:56.752262 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:56.752263 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:56.752264 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:56.752325 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:17:56.752560 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:17:56.752561 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:17:56.752562 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:17:56.752674 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:56.752803 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:56.752918 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 08:17:56.752982 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:17:56.758584 22427 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f6197f43c2914b4f848d6c8f62f67ac0: Generated new TSK 0
I20260811 08:17:56.758793 22427 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:17:56.766002 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 22321
W20260811 08:17:56.783246 22292 connection.cc:535] client connection to 127.20.158.190:37179 recv error: Network error: failed to read from TLS socket (remote: 127.20.158.190:37179): Connection reset by peer (error 104)
2026-08-11T08:17:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1608 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:17:56 dist-test-slave-gkw7 krb5kdc[22451](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:17:56 dist-test-slave-gkw7 krb5kdc[22451](info): set up 2 sockets
Aug 11 08:17:56 dist-test-slave-gkw7 krb5kdc[22451](info): commencing operation
krb5kdc: starting...
W20260811 08:17:58.136099 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.339s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:17:58 dist-test-slave-gkw7 krb5kdc[22451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436278, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:17:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:17:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:17:58.264748 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:38429
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:42747
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:38429
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:58.352800 22471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:58.353076 22471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:58.353120 22471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:58.354313 22471 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:17:58.354390 22471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:58.354419 22471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:58.354456 22471 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:17:58.354507 22471 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:17:58.356068 22471 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:42747
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:38429
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:38429
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22471
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:58.356379 22471 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:58.356631 22471 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:58.361956 22481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:58.362051 22480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:58.362035 22471 server_base.cc:1034] running on GCE node
W20260811 08:17:58.361956 22485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:58.362418 22471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:58.362720 22471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:58.363931 22471 hybrid_clock.cc:648] HybridClock initialized: now 1786436278363916 us; error 28 us; skew 500 ppm
Aug 11 08:17:58 dist-test-slave-gkw7 krb5kdc[22451](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436278, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:58.371308 22471 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:17:58.371786 22471 webserver.cc:460] Webserver started at http://127.20.158.190:39743/ using document root <none> and password file <none>
I20260811 08:17:58.371974 22471 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:58.372015 22471 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:58.372129 22471 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:58.373193 22471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "d797f52cbe4f4f61bec1fda9677fd33f"
format_stamp: "Formatted at 2026-08-11 08:17:58 on dist-test-slave-gkw7"
server_key: "07ec24cc6fee0a5ec49a8587cbbacb12"
server_key_iv: "443bc9b8a41175db6aac57b661e9c5e8"
server_key_version: "encryptionkey@0"
I20260811 08:17:58.373502 22471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "d797f52cbe4f4f61bec1fda9677fd33f"
format_stamp: "Formatted at 2026-08-11 08:17:58 on dist-test-slave-gkw7"
server_key: "07ec24cc6fee0a5ec49a8587cbbacb12"
server_key_iv: "443bc9b8a41175db6aac57b661e9c5e8"
server_key_version: "encryptionkey@0"
I20260811 08:17:58.374949 22471 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:17:58.375756 22493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:58.376005 22471 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:17:58.376106 22471 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "d797f52cbe4f4f61bec1fda9677fd33f"
format_stamp: "Formatted at 2026-08-11 08:17:58 on dist-test-slave-gkw7"
server_key: "07ec24cc6fee0a5ec49a8587cbbacb12"
server_key_iv: "443bc9b8a41175db6aac57b661e9c5e8"
server_key_version: "encryptionkey@0"
I20260811 08:17:58.376185 22471 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:58.414367 22471 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:58.416905 22471 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:58.417076 22471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:58.421625 22471 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:38429
I20260811 08:17:58.421712 22562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:38429 every 8 connection(s)
I20260811 08:17:58.422099 22471 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:17:58.423070 22563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:58.425446 22563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d797f52cbe4f4f61bec1fda9677fd33f: Bootstrap starting.
I20260811 08:17:58.426107 22563 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d797f52cbe4f4f61bec1fda9677fd33f: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:58.426407 22563 log.cc:824] T 00000000000000000000000000000000 P d797f52cbe4f4f61bec1fda9677fd33f: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:58.427148 22563 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d797f52cbe4f4f61bec1fda9677fd33f: No bootstrap required, opened a new log
I20260811 08:17:58.428746 22563 raft_consensus.cc:348] T 00000000000000000000000000000000 P d797f52cbe4f4f61bec1fda9677fd33f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d797f52cbe4f4f61bec1fda9677fd33f" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38429 } }
I20260811 08:17:58.428885 22563 raft_consensus.cc:374] T 00000000000000000000000000000000 P d797f52cbe4f4f61bec1fda9677fd33f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:58.428907 22563 raft_consensus.cc:729] T 00000000000000000000000000000000 P d797f52cbe4f4f61bec1fda9677fd33f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d797f52cbe4f4f61bec1fda9677fd33f, State: Initialized, Role: FOLLOWER
I20260811 08:17:58.429086 22563 consensus_queue.cc:260] T 00000000000000000000000000000000 P d797f52cbe4f4f61bec1fda9677fd33f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d797f52cbe4f4f61bec1fda9677fd33f" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38429 } }
I20260811 08:17:58.429152 22563 raft_consensus.cc:388] T 00000000000000000000000000000000 P d797f52cbe4f4f61bec1fda9677fd33f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:17:58.429208 22563 raft_consensus.cc:482] T 00000000000000000000000000000000 P d797f52cbe4f4f61bec1fda9677fd33f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:17:58.429263 22563 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d797f52cbe4f4f61bec1fda9677fd33f [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:58.430228 22563 raft_consensus.cc:504] T 00000000000000000000000000000000 P d797f52cbe4f4f61bec1fda9677fd33f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d797f52cbe4f4f61bec1fda9677fd33f" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38429 } }
I20260811 08:17:58.430347 22563 leader_election.cc:302] T 00000000000000000000000000000000 P d797f52cbe4f4f61bec1fda9677fd33f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d797f52cbe4f4f61bec1fda9677fd33f; no voters:
I20260811 08:17:58.430536 22563 leader_election.cc:288] T 00000000000000000000000000000000 P d797f52cbe4f4f61bec1fda9677fd33f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:17:58.430579 22567 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d797f52cbe4f4f61bec1fda9677fd33f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:17:58.430754 22567 raft_consensus.cc:686] T 00000000000000000000000000000000 P d797f52cbe4f4f61bec1fda9677fd33f [term 1 LEADER]: Becoming Leader. State: Replica: d797f52cbe4f4f61bec1fda9677fd33f, State: Running, Role: LEADER
I20260811 08:17:58.430827 22563 sys_catalog.cc:564] T 00000000000000000000000000000000 P d797f52cbe4f4f61bec1fda9677fd33f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:17:58.430924 22567 consensus_queue.cc:237] T 00000000000000000000000000000000 P d797f52cbe4f4f61bec1fda9677fd33f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d797f52cbe4f4f61bec1fda9677fd33f" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38429 } }
I20260811 08:17:58.431349 22573 sys_catalog.cc:455] T 00000000000000000000000000000000 P d797f52cbe4f4f61bec1fda9677fd33f [sys.catalog]: SysCatalogTable state changed. Reason: New leader d797f52cbe4f4f61bec1fda9677fd33f. Latest consensus state: current_term: 1 leader_uuid: "d797f52cbe4f4f61bec1fda9677fd33f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d797f52cbe4f4f61bec1fda9677fd33f" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38429 } } }
I20260811 08:17:58.431449 22573 sys_catalog.cc:458] T 00000000000000000000000000000000 P d797f52cbe4f4f61bec1fda9677fd33f [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:58.431710 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 22471
I20260811 08:17:58.431859 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:17:58.432057 21114 external_mini_cluster.cc:1428] Setting key 2dc60ee645c42074eeb0afade190e138
I20260811 08:17:58.432518 22570 sys_catalog.cc:455] T 00000000000000000000000000000000 P d797f52cbe4f4f61bec1fda9677fd33f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d797f52cbe4f4f61bec1fda9677fd33f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d797f52cbe4f4f61bec1fda9677fd33f" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38429 } } }
I20260811 08:17:58.432585 22586 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:17:58.432682 22570 sys_catalog.cc:458] T 00000000000000000000000000000000 P d797f52cbe4f4f61bec1fda9677fd33f [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:58.433306 22586 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:17:58.435715 22586 catalog_manager.cc:1347] Generated new cluster ID: d253d4036c094e79947627dcfc8b6a7a
I20260811 08:17:58.435781 22586 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:17:58.438855 22600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:58.432778 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50263 (local address 127.20.158.190:38429)
0811 08:17:58.432955 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:58.432966 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:58.433221 (+ 255us) server_negotiation.cc:407] Connection header received
0811 08:17:58.433364 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:58.433373 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:58.433437 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:58.433708 (+ 271us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:58.434074 (+ 366us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:58.435434 (+ 1360us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:58.436597 (+ 1163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:58.437245 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:58.437365 (+ 120us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:58.438128 (+ 763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:58.438132 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:58.438132 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:58.438345 (+ 213us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:58.438386 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:58.438401 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:58.438503 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:58.438583 (+ 80us) server_negotiation.cc:299] Negotiation successful
0811 08:17:58.438613 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":74,"threads_started":1}
I20260811 08:17:58.440166 21114 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:17:58.443830 22586 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:17:58.444491 22586 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:17:58.447034 22600 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:58.441864 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44951 (local address 127.20.158.190:38429)
0811 08:17:58.443403 (+ 1539us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:58.443405 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:58.443415 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:17:58.443435 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:58.443435 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:58.443445 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:58.443512 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:58.443752 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:58.444502 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:58.445641 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:17:58.445952 (+ 311us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:17:58.446015 (+ 63us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:17:58.446779 (+ 764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:58.446781 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:58.446781 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:58.446785 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:58.446800 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:58.446804 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:58.446854 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:58.446941 (+ 87us) server_negotiation.cc:299] Negotiation successful
0811 08:17:58.446955 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1520}
I20260811 08:17:58.448668 22586 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d797f52cbe4f4f61bec1fda9677fd33f: Generated new TSK 0
I20260811 08:17:58.448859 22586 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:17:58.457955 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 22471
W20260811 08:17:58.474238 22448 connection.cc:535] client connection to 127.20.158.190:38429 recv error: Network error: failed to read from TLS socket (remote: 127.20.158.190:38429): Connection reset by peer (error 104)
2026-08-11T08:17:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1691 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:17:58 dist-test-slave-gkw7 krb5kdc[22620](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:17:58 dist-test-slave-gkw7 krb5kdc[22620](info): set up 2 sockets
Aug 11 08:17:58 dist-test-slave-gkw7 krb5kdc[22620](info): commencing operation
krb5kdc: starting...
W20260811 08:17:59.718735 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.230s user 0.003s sys 0.003s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:17:59 dist-test-slave-gkw7 krb5kdc[22620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436279, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:17:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:17:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:17:59.850896 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:42707
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:44205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:42707
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:17:59.940580 22641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:17:59.940828 22641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:17:59.940855 22641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:17:59.942124 22641 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:17:59.942180 22641 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:17:59.942196 22641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:17:59.942209 22641 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:17:59.942224 22641 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:17:59.943799 22641 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:44205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:42707
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:42707
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22641
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:17:59.944089 22641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:17:59.944348 22641 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:17:59.949725 22655 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:59.949752 22653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:17:59.949700 22658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:17:59.949981 22641 server_base.cc:1034] running on GCE node
I20260811 08:17:59.950313 22641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:17:59.950627 22641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:17:59.951820 22641 hybrid_clock.cc:648] HybridClock initialized: now 1786436279951798 us; error 51 us; skew 500 ppm
Aug 11 08:17:59 dist-test-slave-gkw7 krb5kdc[22620](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436279, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:17:59.954594 22641 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:17:59.955065 22641 webserver.cc:460] Webserver started at http://127.20.158.190:45661/ using document root <none> and password file <none>
I20260811 08:17:59.955343 22641 fs_manager.cc:359] Metadata directory not provided
I20260811 08:17:59.955420 22641 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:17:59.955578 22641 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:17:59.956746 22641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "c32b3369968041ecb5b1f9b8809a014c"
format_stamp: "Formatted at 2026-08-11 08:17:59 on dist-test-slave-gkw7"
server_key: "20cd4f73c37d84332fc09530a0c0b152"
server_key_iv: "a1177c1449992dd87e28e9c0b5a3add2"
server_key_version: "encryptionkey@0"
I20260811 08:17:59.957130 22641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "c32b3369968041ecb5b1f9b8809a014c"
format_stamp: "Formatted at 2026-08-11 08:17:59 on dist-test-slave-gkw7"
server_key: "20cd4f73c37d84332fc09530a0c0b152"
server_key_iv: "a1177c1449992dd87e28e9c0b5a3add2"
server_key_version: "encryptionkey@0"
I20260811 08:17:59.958590 22641 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:17:59.959399 22669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:17:59.959640 22641 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:17:59.959769 22641 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "c32b3369968041ecb5b1f9b8809a014c"
format_stamp: "Formatted at 2026-08-11 08:17:59 on dist-test-slave-gkw7"
server_key: "20cd4f73c37d84332fc09530a0c0b152"
server_key_iv: "a1177c1449992dd87e28e9c0b5a3add2"
server_key_version: "encryptionkey@0"
I20260811 08:17:59.959851 22641 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:17:59.963465 22641 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:17:59.965503 22641 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:17:59.965698 22641 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:17:59.970021 22641 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:42707
I20260811 08:17:59.970077 22748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:42707 every 8 connection(s)
I20260811 08:17:59.970444 22641 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:17:59.971369 22749 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:17:59.973965 22749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c32b3369968041ecb5b1f9b8809a014c: Bootstrap starting.
I20260811 08:17:59.974613 22749 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c32b3369968041ecb5b1f9b8809a014c: Neither blocks nor log segments found. Creating new log.
I20260811 08:17:59.974959 22749 log.cc:824] T 00000000000000000000000000000000 P c32b3369968041ecb5b1f9b8809a014c: Log is configured to *not* fsync() on all Append() calls
I20260811 08:17:59.975708 22749 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c32b3369968041ecb5b1f9b8809a014c: No bootstrap required, opened a new log
I20260811 08:17:59.976967 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 22641
I20260811 08:17:59.977097 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:17:59.977289 21114 external_mini_cluster.cc:1428] Setting key 0ae76559e957ae1905eabf1a8aea9b78
I20260811 08:17:59.977833 22749 raft_consensus.cc:348] T 00000000000000000000000000000000 P c32b3369968041ecb5b1f9b8809a014c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c32b3369968041ecb5b1f9b8809a014c" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42707 } }
I20260811 08:17:59.978040 22749 raft_consensus.cc:374] T 00000000000000000000000000000000 P c32b3369968041ecb5b1f9b8809a014c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:17:59.978088 22749 raft_consensus.cc:729] T 00000000000000000000000000000000 P c32b3369968041ecb5b1f9b8809a014c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c32b3369968041ecb5b1f9b8809a014c, State: Initialized, Role: FOLLOWER
I20260811 08:17:59.978242 22749 consensus_queue.cc:260] T 00000000000000000000000000000000 P c32b3369968041ecb5b1f9b8809a014c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c32b3369968041ecb5b1f9b8809a014c" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42707 } }
I20260811 08:17:59.978343 22749 raft_consensus.cc:388] T 00000000000000000000000000000000 P c32b3369968041ecb5b1f9b8809a014c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:17:59.978376 22749 raft_consensus.cc:482] T 00000000000000000000000000000000 P c32b3369968041ecb5b1f9b8809a014c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:17:59.978425 22749 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c32b3369968041ecb5b1f9b8809a014c [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:17:59.979234 22749 raft_consensus.cc:504] T 00000000000000000000000000000000 P c32b3369968041ecb5b1f9b8809a014c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c32b3369968041ecb5b1f9b8809a014c" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42707 } }
I20260811 08:17:59.979360 22749 leader_election.cc:302] T 00000000000000000000000000000000 P c32b3369968041ecb5b1f9b8809a014c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c32b3369968041ecb5b1f9b8809a014c; no voters:
I20260811 08:17:59.979588 22757 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c32b3369968041ecb5b1f9b8809a014c [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:17:59.979548 22749 leader_election.cc:288] T 00000000000000000000000000000000 P c32b3369968041ecb5b1f9b8809a014c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:17:59.979773 22757 raft_consensus.cc:686] T 00000000000000000000000000000000 P c32b3369968041ecb5b1f9b8809a014c [term 1 LEADER]: Becoming Leader. State: Replica: c32b3369968041ecb5b1f9b8809a014c, State: Running, Role: LEADER
I20260811 08:17:59.979884 22757 consensus_queue.cc:237] T 00000000000000000000000000000000 P c32b3369968041ecb5b1f9b8809a014c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c32b3369968041ecb5b1f9b8809a014c" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42707 } }
I20260811 08:17:59.980038 22749 sys_catalog.cc:564] T 00000000000000000000000000000000 P c32b3369968041ecb5b1f9b8809a014c [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:17:59.980378 22757 sys_catalog.cc:455] T 00000000000000000000000000000000 P c32b3369968041ecb5b1f9b8809a014c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c32b3369968041ecb5b1f9b8809a014c. Latest consensus state: current_term: 1 leader_uuid: "c32b3369968041ecb5b1f9b8809a014c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c32b3369968041ecb5b1f9b8809a014c" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42707 } } }
I20260811 08:17:59.980480 22755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:59.977960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47319 (local address 127.20.158.190:42707)
0811 08:17:59.978245 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:59.978256 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:59.978290 (+ 34us) server_negotiation.cc:407] Connection header received
0811 08:17:59.978751 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:59.978761 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:59.978823 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:59.978983 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:59.979809 (+ 826us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:59.979813 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:59.979814 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:59.979819 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:59.979919 (+ 100us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:59.979938 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:59.980185 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:59.980221 (+ 36us) server_negotiation.cc:299] Negotiation successful
0811 08:17:59.980265 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":232,"thread_start_us":111,"threads_started":1}
I20260811 08:17:59.980531 22757 sys_catalog.cc:458] T 00000000000000000000000000000000 P c32b3369968041ecb5b1f9b8809a014c [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:59.980814 22757 sys_catalog.cc:455] T 00000000000000000000000000000000 P c32b3369968041ecb5b1f9b8809a014c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c32b3369968041ecb5b1f9b8809a014c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c32b3369968041ecb5b1f9b8809a014c" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 42707 } } }
I20260811 08:17:59.980890 22757 sys_catalog.cc:458] T 00000000000000000000000000000000 P c32b3369968041ecb5b1f9b8809a014c [sys.catalog]: This master's current role is: LEADER
I20260811 08:17:59.981642 21114 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260811 08:17:59.982071 22778 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c32b3369968041ecb5b1f9b8809a014c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:17:59.983237 22778 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:17:59.983314 22769 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:17:59.983536 22769 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:17:59.985162 22755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:17:59.983232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52409 (local address 127.20.158.190:42707)
0811 08:17:59.983351 (+ 119us) server_negotiation.cc:206] Beginning negotiation
0811 08:17:59.983353 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:17:59.983662 (+ 309us) server_negotiation.cc:407] Connection header received
0811 08:17:59.983728 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:17:59.983729 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:17:59.983735 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:17:59.983797 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:17:59.984860 (+ 1063us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:17:59.984861 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:17:59.984862 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:17:59.984868 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:17:59.984885 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:17:59.984890 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:17:59.984953 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 08:17:59.985068 (+ 115us) server_negotiation.cc:299] Negotiation successful
0811 08:17:59.985081 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260811 08:17:59.985304 22769 catalog_manager.cc:1347] Generated new cluster ID: 414e09a2befa4e9c90aef697fe646983
I20260811 08:17:59.985358 22769 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:18:00.001487 22769 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:18:00.001773 22769 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:18:00.004745 22769 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c32b3369968041ecb5b1f9b8809a014c: Generated new TSK 0
I20260811 08:18:00.004969 22769 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:18:00.008673 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 22641
2026-08-11T08:18:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1553 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:18:00 dist-test-slave-gkw7 krb5kdc[22792](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:18:00 dist-test-slave-gkw7 krb5kdc[22792](info): set up 2 sockets
Aug 11 08:18:00 dist-test-slave-gkw7 krb5kdc[22792](info): commencing operation
krb5kdc: starting...
W20260811 08:18:01.287997 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.246s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:18:01 dist-test-slave-gkw7 krb5kdc[22792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:18:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:18:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:18:01.421060 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:41115
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:40821
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:41115
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:18:01.505712 22814 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:18:01.505976 22814 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:18:01.506014 22814 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:18:01.507149 22814 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:18:01.507229 22814 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:18:01.507253 22814 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:18:01.507274 22814 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:18:01.507304 22814 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:18:01.508772 22814 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:40821
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:41115
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:41115
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22814
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:18:01.509060 22814 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:18:01.509316 22814 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:18:01.514515 22819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:18:01.514534 22822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:18:01.514583 22820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:18:01.514889 22814 server_base.cc:1034] running on GCE node
I20260811 08:18:01.515148 22814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:18:01.515422 22814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:18:01.516583 22814 hybrid_clock.cc:648] HybridClock initialized: now 1786436281516550 us; error 53 us; skew 500 ppm
Aug 11 08:18:01 dist-test-slave-gkw7 krb5kdc[22792](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436281, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:18:01.519512 22814 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:18:01.520056 22814 webserver.cc:460] Webserver started at http://127.20.158.190:37755/ using document root <none> and password file <none>
I20260811 08:18:01.520259 22814 fs_manager.cc:359] Metadata directory not provided
I20260811 08:18:01.520296 22814 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:18:01.520501 22814 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:18:01.521770 22814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "92b78447cea74111b63e896d19e49ea9"
format_stamp: "Formatted at 2026-08-11 08:18:01 on dist-test-slave-gkw7"
server_key: "c953f0e465debcaed8e44c740703236f"
server_key_iv: "b0f739910203a13f902dd3537a6079b2"
server_key_version: "encryptionkey@0"
I20260811 08:18:01.522193 22814 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "92b78447cea74111b63e896d19e49ea9"
format_stamp: "Formatted at 2026-08-11 08:18:01 on dist-test-slave-gkw7"
server_key: "c953f0e465debcaed8e44c740703236f"
server_key_iv: "b0f739910203a13f902dd3537a6079b2"
server_key_version: "encryptionkey@0"
I20260811 08:18:01.523658 22814 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260811 08:18:01.524506 22832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:18:01.524741 22814 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:18:01.524830 22814 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "92b78447cea74111b63e896d19e49ea9"
format_stamp: "Formatted at 2026-08-11 08:18:01 on dist-test-slave-gkw7"
server_key: "c953f0e465debcaed8e44c740703236f"
server_key_iv: "b0f739910203a13f902dd3537a6079b2"
server_key_version: "encryptionkey@0"
I20260811 08:18:01.524927 22814 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:18:01.546108 22814 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:18:01.548285 22814 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:18:01.548449 22814 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:18:01.553020 22814 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:41115
I20260811 08:18:01.553062 22909 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:41115 every 8 connection(s)
I20260811 08:18:01.553491 22814 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:18:01.554468 22910 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:18:01.556891 22910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92b78447cea74111b63e896d19e49ea9: Bootstrap starting.
I20260811 08:18:01.557180 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 22814
I20260811 08:18:01.557320 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:18:01.557492 21114 external_mini_cluster.cc:1428] Setting key e379dace4ff49684f2ce665e2d290945
I20260811 08:18:01.557664 22910 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 92b78447cea74111b63e896d19e49ea9: Neither blocks nor log segments found. Creating new log.
I20260811 08:18:01.558066 22910 log.cc:824] T 00000000000000000000000000000000 P 92b78447cea74111b63e896d19e49ea9: Log is configured to *not* fsync() on all Append() calls
I20260811 08:18:01.559051 22910 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 92b78447cea74111b63e896d19e49ea9: No bootstrap required, opened a new log
I20260811 08:18:01.561451 22910 raft_consensus.cc:348] T 00000000000000000000000000000000 P 92b78447cea74111b63e896d19e49ea9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92b78447cea74111b63e896d19e49ea9" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 41115 } }
I20260811 08:18:01.561676 22910 raft_consensus.cc:374] T 00000000000000000000000000000000 P 92b78447cea74111b63e896d19e49ea9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:18:01.561707 22910 raft_consensus.cc:729] T 00000000000000000000000000000000 P 92b78447cea74111b63e896d19e49ea9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 92b78447cea74111b63e896d19e49ea9, State: Initialized, Role: FOLLOWER
I20260811 08:18:01.561879 22910 consensus_queue.cc:260] T 00000000000000000000000000000000 P 92b78447cea74111b63e896d19e49ea9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92b78447cea74111b63e896d19e49ea9" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 41115 } }
I20260811 08:18:01.561954 22910 raft_consensus.cc:388] T 00000000000000000000000000000000 P 92b78447cea74111b63e896d19e49ea9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:18:01.562008 22910 raft_consensus.cc:482] T 00000000000000000000000000000000 P 92b78447cea74111b63e896d19e49ea9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:18:01.562059 22910 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 92b78447cea74111b63e896d19e49ea9 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:18:01.562742 22910 raft_consensus.cc:504] T 00000000000000000000000000000000 P 92b78447cea74111b63e896d19e49ea9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92b78447cea74111b63e896d19e49ea9" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 41115 } }
I20260811 08:18:01.562855 22910 leader_election.cc:302] T 00000000000000000000000000000000 P 92b78447cea74111b63e896d19e49ea9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 92b78447cea74111b63e896d19e49ea9; no voters:
I20260811 08:18:01.563009 22910 leader_election.cc:288] T 00000000000000000000000000000000 P 92b78447cea74111b63e896d19e49ea9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:18:01.563097 22917 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 92b78447cea74111b63e896d19e49ea9 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:18:01.563246 22917 raft_consensus.cc:686] T 00000000000000000000000000000000 P 92b78447cea74111b63e896d19e49ea9 [term 1 LEADER]: Becoming Leader. State: Replica: 92b78447cea74111b63e896d19e49ea9, State: Running, Role: LEADER
I20260811 08:18:01.563318 22910 sys_catalog.cc:564] T 00000000000000000000000000000000 P 92b78447cea74111b63e896d19e49ea9 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:18:01.563407 22917 consensus_queue.cc:237] T 00000000000000000000000000000000 P 92b78447cea74111b63e896d19e49ea9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92b78447cea74111b63e896d19e49ea9" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 41115 } }
I20260811 08:18:01.564023 22918 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92b78447cea74111b63e896d19e49ea9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "92b78447cea74111b63e896d19e49ea9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92b78447cea74111b63e896d19e49ea9" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 41115 } } }
I20260811 08:18:01.564128 22918 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92b78447cea74111b63e896d19e49ea9 [sys.catalog]: This master's current role is: LEADER
I20260811 08:18:01.564684 22919 sys_catalog.cc:455] T 00000000000000000000000000000000 P 92b78447cea74111b63e896d19e49ea9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 92b78447cea74111b63e896d19e49ea9. Latest consensus state: current_term: 1 leader_uuid: "92b78447cea74111b63e896d19e49ea9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "92b78447cea74111b63e896d19e49ea9" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 41115 } } }
I20260811 08:18:01.564834 22919 sys_catalog.cc:458] T 00000000000000000000000000000000 P 92b78447cea74111b63e896d19e49ea9 [sys.catalog]: This master's current role is: LEADER
W20260811 08:18:01.565371 22948 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 92b78447cea74111b63e896d19e49ea9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:18:01.565435 22948 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:18:01.565505 22932 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:18:01.565738 22932 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Aug 11 08:18:01 dist-test-slave-gkw7 krb5kdc[22792](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436281, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:18:01.567536 22932 catalog_manager.cc:1347] Generated new cluster ID: b84a0d72375b45258c554d8f6979a03f
I20260811 08:18:01.567611 22932 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:18:01.570109 22914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:01.558102 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50865 (local address 127.20.158.190:41115)
0811 08:18:01.558356 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:01.558366 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:01.558403 (+ 37us) server_negotiation.cc:407] Connection header received
0811 08:18:01.559020 (+ 617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:01.559030 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:01.559109 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:01.559271 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:01.559888 (+ 617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:01.561412 (+ 1524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:01.562470 (+ 1058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:01.563133 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:01.563624 (+ 491us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:01.566555 (+ 2931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:01.566559 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:01.566559 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:01.566572 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:01.568346 (+ 1774us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:01.568757 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:01.568760 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:01.568761 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:01.568879 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:01.569106 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:01.569107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:01.569108 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:01.569427 (+ 319us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:01.569647 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:01.569733 (+ 86us) server_negotiation.cc:299] Negotiation successful
0811 08:18:01.569878 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":199,"thread_start_us":135,"threads_started":1}
I20260811 08:18:01.571270 21114 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:18:01.576139 22932 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:18:01.576879 22932 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:18:01.580142 22914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:01.572943 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35297 (local address 127.20.158.190:41115)
0811 08:18:01.572981 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:01.572983 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:01.573170 (+ 187us) server_negotiation.cc:407] Connection header received
0811 08:18:01.573264 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:01.573265 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:01.573276 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:01.573305 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:01.574081 (+ 776us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:01.574815 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:01.575807 (+ 992us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:01.576132 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:01.576204 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:01.577473 (+ 1269us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:01.577475 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:01.577475 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:01.577482 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:01.578937 (+ 1455us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:01.579311 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:01.579312 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:01.579312 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:01.579374 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:01.579582 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:01.579583 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:01.579584 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:01.579734 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:01.579839 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:01.579948 (+ 109us) server_negotiation.cc:299] Negotiation successful
0811 08:18:01.580036 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260811 08:18:01.590535 22932 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 92b78447cea74111b63e896d19e49ea9: Generated new TSK 0
I20260811 08:18:01.590741 22932 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:18:01.592857 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 22814
2026-08-11T08:18:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1572 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:18:01 dist-test-slave-gkw7 krb5kdc[22963](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:18:01 dist-test-slave-gkw7 krb5kdc[22963](info): set up 2 sockets
Aug 11 08:18:01 dist-test-slave-gkw7 krb5kdc[22963](info): commencing operation
krb5kdc: starting...
W20260811 08:18:02.856372 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.242s user 0.001s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:18:02 dist-test-slave-gkw7 krb5kdc[22963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436282, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:18:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:18:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:18:02.986634 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:45233
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:43683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:45233
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:18:03.072503 22989 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:18:03.072763 22989 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:18:03.072803 22989 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:18:03.074059 22989 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:18:03.074143 22989 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:18:03.074172 22989 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:18:03.074215 22989 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:18:03.074246 22989 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:18:03.075814 22989 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:43683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:45233
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:45233
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.22989
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:18:03.076107 22989 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:18:03.076344 22989 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:18:03.081717 22998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:18:03.081898 22989 server_base.cc:1034] running on GCE node
W20260811 08:18:03.081708 22995 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:18:03.081743 22994 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:18:03.082228 22989 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:18:03.082547 22989 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:18:03.083732 22989 hybrid_clock.cc:648] HybridClock initialized: now 1786436283083719 us; error 33 us; skew 500 ppm
Aug 11 08:18:03 dist-test-slave-gkw7 krb5kdc[22963](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436283, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:18:03.086406 22989 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:18:03.086943 22989 webserver.cc:460] Webserver started at http://127.20.158.190:33537/ using document root <none> and password file <none>
I20260811 08:18:03.087184 22989 fs_manager.cc:359] Metadata directory not provided
I20260811 08:18:03.087255 22989 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:18:03.087427 22989 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:18:03.088531 22989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "3ff92451e22a458aa261cd91eb59315f"
format_stamp: "Formatted at 2026-08-11 08:18:03 on dist-test-slave-gkw7"
server_key: "39669a6e91dc106830f8de0df7f98477"
server_key_iv: "a920bc9a287a47e45e15ca39fe2297d0"
server_key_version: "encryptionkey@0"
I20260811 08:18:03.088923 22989 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "3ff92451e22a458aa261cd91eb59315f"
format_stamp: "Formatted at 2026-08-11 08:18:03 on dist-test-slave-gkw7"
server_key: "39669a6e91dc106830f8de0df7f98477"
server_key_iv: "a920bc9a287a47e45e15ca39fe2297d0"
server_key_version: "encryptionkey@0"
I20260811 08:18:03.090442 22989 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:18:03.091274 23015 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:18:03.091473 22989 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:18:03.091588 22989 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "3ff92451e22a458aa261cd91eb59315f"
format_stamp: "Formatted at 2026-08-11 08:18:03 on dist-test-slave-gkw7"
server_key: "39669a6e91dc106830f8de0df7f98477"
server_key_iv: "a920bc9a287a47e45e15ca39fe2297d0"
server_key_version: "encryptionkey@0"
I20260811 08:18:03.091683 22989 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:18:03.112329 22989 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:18:03.114588 22989 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:18:03.114780 22989 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:18:03.119427 22989 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:45233
I20260811 08:18:03.119472 23099 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:45233 every 8 connection(s)
I20260811 08:18:03.119910 22989 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:18:03.120868 23100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:18:03.122915 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 22989
I20260811 08:18:03.123018 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:18:03.123277 21114 external_mini_cluster.cc:1428] Setting key 134cb044bbf63a421ad2f427ddd3ae5d
I20260811 08:18:03.123675 23100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ff92451e22a458aa261cd91eb59315f: Bootstrap starting.
I20260811 08:18:03.124361 23100 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3ff92451e22a458aa261cd91eb59315f: Neither blocks nor log segments found. Creating new log.
I20260811 08:18:03.124703 23100 log.cc:824] T 00000000000000000000000000000000 P 3ff92451e22a458aa261cd91eb59315f: Log is configured to *not* fsync() on all Append() calls
I20260811 08:18:03.125658 23100 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3ff92451e22a458aa261cd91eb59315f: No bootstrap required, opened a new log
I20260811 08:18:03.128067 23100 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3ff92451e22a458aa261cd91eb59315f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ff92451e22a458aa261cd91eb59315f" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 45233 } }
I20260811 08:18:03.128266 23100 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3ff92451e22a458aa261cd91eb59315f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:18:03.128329 23100 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3ff92451e22a458aa261cd91eb59315f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3ff92451e22a458aa261cd91eb59315f, State: Initialized, Role: FOLLOWER
I20260811 08:18:03.128888 23100 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3ff92451e22a458aa261cd91eb59315f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ff92451e22a458aa261cd91eb59315f" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 45233 } }
I20260811 08:18:03.129014 23100 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3ff92451e22a458aa261cd91eb59315f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:18:03.129070 23100 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3ff92451e22a458aa261cd91eb59315f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:18:03.129124 23100 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3ff92451e22a458aa261cd91eb59315f [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:18:03.129880 23100 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3ff92451e22a458aa261cd91eb59315f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ff92451e22a458aa261cd91eb59315f" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 45233 } }
I20260811 08:18:03.129925 23108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:03.123938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57963 (local address 127.20.158.190:45233)
0811 08:18:03.124135 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:03.124147 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:03.124321 (+ 174us) server_negotiation.cc:407] Connection header received
0811 08:18:03.124959 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:03.124970 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:03.125039 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:03.125206 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:03.125469 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:03.126474 (+ 1005us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:03.127661 (+ 1187us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:03.128089 (+ 428us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:03.128186 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:03.129073 (+ 887us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:03.129079 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:03.129079 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:18:03.129359 (+ 280us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:03.129394 (+ 35us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:18:03.129407 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:03.129470 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:03.129625 (+ 155us) server_negotiation.cc:299] Negotiation successful
0811 08:18:03.129714 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":104,"threads_started":1}
I20260811 08:18:03.130028 23100 leader_election.cc:302] T 00000000000000000000000000000000 P 3ff92451e22a458aa261cd91eb59315f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3ff92451e22a458aa261cd91eb59315f; no voters:
I20260811 08:18:03.130229 23100 leader_election.cc:288] T 00000000000000000000000000000000 P 3ff92451e22a458aa261cd91eb59315f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:18:03.130512 23100 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3ff92451e22a458aa261cd91eb59315f [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:18:03.130530 23113 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3ff92451e22a458aa261cd91eb59315f [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:18:03.130834 23113 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3ff92451e22a458aa261cd91eb59315f [term 1 LEADER]: Becoming Leader. State: Replica: 3ff92451e22a458aa261cd91eb59315f, State: Running, Role: LEADER
I20260811 08:18:03.131064 21114 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:18:03.130993 23113 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3ff92451e22a458aa261cd91eb59315f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ff92451e22a458aa261cd91eb59315f" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 45233 } }
I20260811 08:18:03.132512 23116 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ff92451e22a458aa261cd91eb59315f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3ff92451e22a458aa261cd91eb59315f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ff92451e22a458aa261cd91eb59315f" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 45233 } } }
I20260811 08:18:03.132613 23116 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ff92451e22a458aa261cd91eb59315f [sys.catalog]: This master's current role is: LEADER
I20260811 08:18:03.132946 23118 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3ff92451e22a458aa261cd91eb59315f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3ff92451e22a458aa261cd91eb59315f. Latest consensus state: current_term: 1 leader_uuid: "3ff92451e22a458aa261cd91eb59315f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3ff92451e22a458aa261cd91eb59315f" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 45233 } } }
I20260811 08:18:03.133023 23118 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3ff92451e22a458aa261cd91eb59315f [sys.catalog]: This master's current role is: LEADER
W20260811 08:18:03.133059 23140 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 3ff92451e22a458aa261cd91eb59315f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:18:03.133121 23140 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:18:03.133201 23142 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:18:03.133385 23142 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:18:03.134984 23142 catalog_manager.cc:1347] Generated new cluster ID: 211fbb65c1824f01b8f30dd39a48ed01
I20260811 08:18:03.135041 23142 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:18:03.141341 23108 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:03.133821 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38687 (local address 127.20.158.190:45233)
0811 08:18:03.133868 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:03.133871 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:03.137741 (+ 3870us) server_negotiation.cc:407] Connection header received
0811 08:18:03.137795 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:03.137796 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:03.137810 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:03.137879 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:03.138047 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:03.138850 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:03.139898 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:03.140252 (+ 354us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:03.140320 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:03.141075 (+ 755us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:03.141076 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:03.141077 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:18:03.141082 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:03.141098 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:18:03.141102 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:03.141158 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:03.141231 (+ 73us) server_negotiation.cc:299] Negotiation successful
0811 08:18:03.141254 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:18:03.155138 23142 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:18:03.155759 23142 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:18:03.159737 23142 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3ff92451e22a458aa261cd91eb59315f: Generated new TSK 0
I20260811 08:18:03.159958 23142 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:18:03.163471 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 22989
2026-08-11T08:18:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1577 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:18:03 dist-test-slave-gkw7 krb5kdc[23152](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:18:03 dist-test-slave-gkw7 krb5kdc[23152](info): set up 2 sockets
Aug 11 08:18:03 dist-test-slave-gkw7 krb5kdc[23152](info): commencing operation
krb5kdc: starting...
W20260811 08:18:04.455940 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.264s user 0.000s sys 0.008s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:18:04 dist-test-slave-gkw7 krb5kdc[23152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436284, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:18:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:18:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:18:04.584930 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:38373
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:46353
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:38373
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:18:04.668673 23170 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:18:04.668921 23170 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:18:04.668959 23170 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:18:04.670184 23170 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:18:04.670252 23170 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:18:04.670274 23170 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:18:04.670295 23170 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:18:04.670325 23170 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:18:04.671782 23170 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:46353
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:38373
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:38373
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23170
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:18:04.672060 23170 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:18:04.672292 23170 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260811 08:18:04.677392 23170 server_base.cc:1034] running on GCE node
W20260811 08:18:04.677376 23177 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:18:04.677356 23178 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:18:04.677572 23180 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:18:04.677850 23170 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:18:04.678148 23170 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:18:04.679311 23170 hybrid_clock.cc:648] HybridClock initialized: now 1786436284679296 us; error 30 us; skew 500 ppm
Aug 11 08:18:04 dist-test-slave-gkw7 krb5kdc[23152](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436284, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:18:04.686869 23170 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:18:04.687371 23170 webserver.cc:460] Webserver started at http://127.20.158.190:46023/ using document root <none> and password file <none>
I20260811 08:18:04.687613 23170 fs_manager.cc:359] Metadata directory not provided
I20260811 08:18:04.687685 23170 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:18:04.687846 23170 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:18:04.688931 23170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "f8a6683cdcf7486792cf5d1f72128bbb"
format_stamp: "Formatted at 2026-08-11 08:18:04 on dist-test-slave-gkw7"
server_key: "2756265e1c5e37947103ac552dc21940"
server_key_iv: "90b04bb5009242662e86be0a8e9cabdd"
server_key_version: "encryptionkey@0"
I20260811 08:18:04.689316 23170 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "f8a6683cdcf7486792cf5d1f72128bbb"
format_stamp: "Formatted at 2026-08-11 08:18:04 on dist-test-slave-gkw7"
server_key: "2756265e1c5e37947103ac552dc21940"
server_key_iv: "90b04bb5009242662e86be0a8e9cabdd"
server_key_version: "encryptionkey@0"
I20260811 08:18:04.690793 23170 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:18:04.691606 23191 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:18:04.691807 23170 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:18:04.691922 23170 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "f8a6683cdcf7486792cf5d1f72128bbb"
format_stamp: "Formatted at 2026-08-11 08:18:04 on dist-test-slave-gkw7"
server_key: "2756265e1c5e37947103ac552dc21940"
server_key_iv: "90b04bb5009242662e86be0a8e9cabdd"
server_key_version: "encryptionkey@0"
I20260811 08:18:04.691999 23170 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:18:04.695441 23170 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:18:04.697481 23170 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:18:04.697670 23170 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:18:04.701866 23170 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:38373
I20260811 08:18:04.701901 23273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:38373 every 8 connection(s)
I20260811 08:18:04.702239 23170 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:18:04.703265 23274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:18:04.705649 23274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8a6683cdcf7486792cf5d1f72128bbb: Bootstrap starting.
I20260811 08:18:04.706220 23274 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f8a6683cdcf7486792cf5d1f72128bbb: Neither blocks nor log segments found. Creating new log.
I20260811 08:18:04.706522 23274 log.cc:824] T 00000000000000000000000000000000 P f8a6683cdcf7486792cf5d1f72128bbb: Log is configured to *not* fsync() on all Append() calls
I20260811 08:18:04.707262 23274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f8a6683cdcf7486792cf5d1f72128bbb: No bootstrap required, opened a new log
I20260811 08:18:04.708822 23274 raft_consensus.cc:348] T 00000000000000000000000000000000 P f8a6683cdcf7486792cf5d1f72128bbb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8a6683cdcf7486792cf5d1f72128bbb" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38373 } }
I20260811 08:18:04.708954 23274 raft_consensus.cc:374] T 00000000000000000000000000000000 P f8a6683cdcf7486792cf5d1f72128bbb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260811 08:18:04.708976 23274 raft_consensus.cc:729] T 00000000000000000000000000000000 P f8a6683cdcf7486792cf5d1f72128bbb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8a6683cdcf7486792cf5d1f72128bbb, State: Initialized, Role: FOLLOWER
I20260811 08:18:04.709125 23274 consensus_queue.cc:260] T 00000000000000000000000000000000 P f8a6683cdcf7486792cf5d1f72128bbb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8a6683cdcf7486792cf5d1f72128bbb" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38373 } }
I20260811 08:18:04.709195 23274 raft_consensus.cc:388] T 00000000000000000000000000000000 P f8a6683cdcf7486792cf5d1f72128bbb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260811 08:18:04.709219 23274 raft_consensus.cc:482] T 00000000000000000000000000000000 P f8a6683cdcf7486792cf5d1f72128bbb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260811 08:18:04.709246 23274 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f8a6683cdcf7486792cf5d1f72128bbb [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:18:04.710111 23274 raft_consensus.cc:504] T 00000000000000000000000000000000 P f8a6683cdcf7486792cf5d1f72128bbb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8a6683cdcf7486792cf5d1f72128bbb" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38373 } }
I20260811 08:18:04.710230 23274 leader_election.cc:302] T 00000000000000000000000000000000 P f8a6683cdcf7486792cf5d1f72128bbb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f8a6683cdcf7486792cf5d1f72128bbb; no voters:
I20260811 08:18:04.710417 23274 leader_election.cc:288] T 00000000000000000000000000000000 P f8a6683cdcf7486792cf5d1f72128bbb [CANDIDATE]: Term 1 election: Requested vote from peers
I20260811 08:18:04.710454 23279 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f8a6683cdcf7486792cf5d1f72128bbb [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:18:04.710503 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 23170
I20260811 08:18:04.710641 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:18:04.710654 23279 raft_consensus.cc:686] T 00000000000000000000000000000000 P f8a6683cdcf7486792cf5d1f72128bbb [term 1 LEADER]: Becoming Leader. State: Replica: f8a6683cdcf7486792cf5d1f72128bbb, State: Running, Role: LEADER
I20260811 08:18:04.710696 23274 sys_catalog.cc:564] T 00000000000000000000000000000000 P f8a6683cdcf7486792cf5d1f72128bbb [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:18:04.710734 23279 consensus_queue.cc:237] T 00000000000000000000000000000000 P f8a6683cdcf7486792cf5d1f72128bbb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8a6683cdcf7486792cf5d1f72128bbb" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38373 } }
I20260811 08:18:04.710866 21114 external_mini_cluster.cc:1428] Setting key 0d7c0c7436741dbe5b29867f07e8336a
I20260811 08:18:04.711110 23279 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8a6683cdcf7486792cf5d1f72128bbb [sys.catalog]: SysCatalogTable state changed. Reason: New leader f8a6683cdcf7486792cf5d1f72128bbb. Latest consensus state: current_term: 1 leader_uuid: "f8a6683cdcf7486792cf5d1f72128bbb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8a6683cdcf7486792cf5d1f72128bbb" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38373 } } }
I20260811 08:18:04.711118 23282 sys_catalog.cc:455] T 00000000000000000000000000000000 P f8a6683cdcf7486792cf5d1f72128bbb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f8a6683cdcf7486792cf5d1f72128bbb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f8a6683cdcf7486792cf5d1f72128bbb" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 38373 } } }
I20260811 08:18:04.711202 23279 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8a6683cdcf7486792cf5d1f72128bbb [sys.catalog]: This master's current role is: LEADER
I20260811 08:18:04.711206 23282 sys_catalog.cc:458] T 00000000000000000000000000000000 P f8a6683cdcf7486792cf5d1f72128bbb [sys.catalog]: This master's current role is: LEADER
I20260811 08:18:04.712013 23295 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:18:04.712522 23295 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:18:04.713631 23298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:04.711513 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55327 (local address 127.20.158.190:38373)
0811 08:18:04.712054 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:04.712065 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:04.712102 (+ 37us) server_negotiation.cc:407] Connection header received
0811 08:18:04.712263 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:04.712271 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:04.712304 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:04.712450 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:04.713141 (+ 691us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:04.713145 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:04.713145 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:18:04.713150 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:04.713193 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:18:04.713208 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:04.713276 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:04.713380 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 08:18:04.713419 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":489,"thread_start_us":99,"threads_started":1}
I20260811 08:18:04.714200 23295 catalog_manager.cc:1347] Generated new cluster ID: d072584e75ed42cdb6c1b860bf4400d0
I20260811 08:18:04.714259 23295 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:18:04.714727 21114 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:18:04.723532 23295 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:18:04.723717 23295 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:18:04.732489 23295 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f8a6683cdcf7486792cf5d1f72128bbb: Generated new TSK 0
I20260811 08:18:04.732771 23295 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:18:04.732865 23298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:04.716043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41823 (local address 127.20.158.190:38373)
0811 08:18:04.716075 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:04.716077 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:04.723251 (+ 7174us) server_negotiation.cc:407] Connection header received
0811 08:18:04.723330 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:04.723331 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:04.723338 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:04.723412 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:04.732482 (+ 9070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:04.732484 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:04.732484 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0811 08:18:04.732490 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:04.732506 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0811 08:18:04.732511 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:04.732571 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:04.732730 (+ 159us) server_negotiation.cc:299] Negotiation successful
0811 08:18:04.732748 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260811 08:18:04.735013 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 23170
2026-08-11T08:18:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1575 ms)
[----------] 18 tests from AuthTokenIssuingTest (28762 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:18:04 dist-test-slave-gkw7 krb5kdc[23326](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:18:04 dist-test-slave-gkw7 krb5kdc[23326](info): set up 2 sockets
Aug 11 08:18:04 dist-test-slave-gkw7 krb5kdc[23326](info): commencing operation
krb5kdc: starting...
W20260811 08:18:06.005198 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.237s user 0.006s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:18:06 dist-test-slave-gkw7 krb5kdc[23326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:18:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:18:06Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:18:06.132586 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:36421
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:34953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:36421,127.20.158.189:34751,127.20.158.188:37613
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:18:06.216818 23348 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 08:18:06.217024 23348 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:18:06.217042 23348 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:18:06.217063 23348 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:18:06.218297 23348 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:18:06.218341 23348 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:18:06.218356 23348 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:18:06.218369 23348 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:18:06.218422 23348 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:18:06.219878 23348 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:34953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:36421,127.20.158.189:34751,127.20.158.188:37613
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:36421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23348
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:18:06.220132 23348 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:18:06.220357 23348 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:18:06.225339 23357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:18:06.225348 23362 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:18:06.225379 23358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:18:06.225726 23348 server_base.cc:1034] running on GCE node
I20260811 08:18:06.225968 23348 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:18:06.226259 23348 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:18:06.227407 23348 hybrid_clock.cc:648] HybridClock initialized: now 1786436286227383 us; error 41 us; skew 500 ppm
Aug 11 08:18:06 dist-test-slave-gkw7 krb5kdc[23326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436286, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:18:06.229946 23348 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:18:06.230414 23348 webserver.cc:460] Webserver started at http://127.20.158.190:45529/ using document root <none> and password file <none>
I20260811 08:18:06.230651 23348 fs_manager.cc:359] Metadata directory not provided
I20260811 08:18:06.230697 23348 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:18:06.230844 23348 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:18:06.231940 23348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "ace0ae67f6fd498dae39740f62db8834"
format_stamp: "Formatted at 2026-08-11 08:18:06 on dist-test-slave-gkw7"
server_key: "6a8e4d7f60725eda760fc401974cef82"
server_key_iv: "77c82c201c49e7fd56e097e81192dbe4"
server_key_version: "encryptionkey@0"
I20260811 08:18:06.232326 23348 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "ace0ae67f6fd498dae39740f62db8834"
format_stamp: "Formatted at 2026-08-11 08:18:06 on dist-test-slave-gkw7"
server_key: "6a8e4d7f60725eda760fc401974cef82"
server_key_iv: "77c82c201c49e7fd56e097e81192dbe4"
server_key_version: "encryptionkey@0"
I20260811 08:18:06.233779 23348 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260811 08:18:06.234648 23375 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:18:06.234839 23348 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:18:06.234951 23348 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "ace0ae67f6fd498dae39740f62db8834"
format_stamp: "Formatted at 2026-08-11 08:18:06 on dist-test-slave-gkw7"
server_key: "6a8e4d7f60725eda760fc401974cef82"
server_key_iv: "77c82c201c49e7fd56e097e81192dbe4"
server_key_version: "encryptionkey@0"
I20260811 08:18:06.235028 23348 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:18:06.246764 23348 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:18:06.248620 23348 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:18:06.248781 23348 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:18:06.253146 23348 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:36421
I20260811 08:18:06.253186 23457 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:36421 every 8 connection(s)
I20260811 08:18:06.253612 23348 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:18:06.254509 23458 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:18:06.256137 23458 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36421 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:18:06.258284 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 23348
I20260811 08:18:06.258428 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:18:06.258638 21114 external_mini_cluster.cc:1428] Setting key 40a467554a5874f05c25ee2bbd66c5a8
Aug 11 08:18:06 dist-test-slave-gkw7 krb5kdc[23326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436286, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:18:06.266769 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.256861 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36421 (local address 127.0.0.1:58746)
0811 08:18:06.257037 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:06.257078 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 08:18:06.257625 (+ 547us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:18:06.257908 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:18:06.257911 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:18:06.258152 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:18:06.258304 (+ 152us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:06.258308 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.259461 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.259463 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:06.260142 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:06.260144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.260656 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.260657 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:06.260724 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:06.261264 (+ 540us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:18:06.261273 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:18:06.262942 (+ 1669us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:18:06.265212 (+ 2270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:06.265219 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:06.265220 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:06.265416 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:06.265738 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:06.265739 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:06.265739 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:06.265827 (+ 88us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:06.266311 (+ 484us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:18:06.266318 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:18:06.266381 (+ 63us) client_negotiation.cc:769] Sending connection context
0811 08:18:06.266469 (+ 88us) client_negotiation.cc:240] Negotiation successful
0811 08:18:06.266606 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":77,"threads_started":1}
I20260811 08:18:06.266860 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.256887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58746 (local address 127.20.158.190:36421)
0811 08:18:06.257075 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:06.257084 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:06.257182 (+ 98us) server_negotiation.cc:407] Connection header received
0811 08:18:06.257782 (+ 600us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:06.257784 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:06.257801 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:06.257881 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:06.258414 (+ 533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.259346 (+ 932us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.260245 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.260561 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.260679 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:06.263046 (+ 2367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:06.263054 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:06.263055 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:06.263064 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:06.265105 (+ 2041us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.265506 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.265510 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.265511 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.265652 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.265897 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.265898 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.265899 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.266211 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:06.266302 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:06.266537 (+ 235us) server_negotiation.cc:299] Negotiation successful
0811 08:18:06.266701 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":44,"server-negotiator.queue_time_us":161,"thread_start_us":101,"threads_started":1}
I20260811 08:18:06.267669 23458 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.189" port: 34751 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:18:06.268039 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.267912 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:34751 (local address 127.0.0.1:59110)
0811 08:18:06.267967 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:06.268013 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.189:34751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260811 08:18:06.268189 23380 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.158.189:34751: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.20.158.189@KRBTEST.COM; defaulting to no policy
I20260811 08:18:06.268612 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.268512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:34751 (local address 127.0.0.1:59124)
0811 08:18:06.268560 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:06.268584 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.189:34751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 08:18:06.268738 23458 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.158.189:34751: Network error: Client connection negotiation failed: client connection to 127.20.158.189:34751: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.189.keytab.
Entry for principal kudu/127.20.158.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.189.keytab.
I20260811 08:18:06.288097 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.189:34751
--webserver_interface=127.20.158.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.189.keytab
--principal=kudu/127.20.158.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:34953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:36421,127.20.158.189:34751,127.20.158.188:37613
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:18:06.317950 23458 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.158.189" port: 34751 } attempt: 1
I20260811 08:18:06.318426 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.318289 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:34751 (local address 127.0.0.1:59126)
0811 08:18:06.318359 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:06.318397 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.189:34751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 08:18:06.318815 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.318715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:34751 (local address 127.0.0.1:59134)
0811 08:18:06.318763 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:06.318795 (+ 32us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.189:34751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260811 08:18:06.318912 23458 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.158.189:34751: Network error: Client connection negotiation failed: client connection to 127.20.158.189:34751: connect: Connection refused (error 111)
W20260811 08:18:06.375368 23470 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 08:18:06.375578 23470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:18:06.375603 23470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:18:06.375623 23470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:18:06.376792 23470 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:18:06.376832 23470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:18:06.376847 23470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:18:06.376859 23470 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:18:06.376871 23470 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:18:06.378369 23470 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:34953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:36421,127.20.158.189:34751,127.20.158.188:37613
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.189.keytab
--principal=kudu/127.20.158.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.189:34751
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.158.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23470
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:18:06.378641 23470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:18:06.378867 23470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:18:06.383937 23477 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:18:06.383909 23485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:18:06.383952 23478 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:18:06.384186 23470 server_base.cc:1034] running on GCE node
I20260811 08:18:06.384473 23470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:18:06.384768 23470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:18:06.385977 23470 hybrid_clock.cc:648] HybridClock initialized: now 1786436286385953 us; error 38 us; skew 500 ppm
I20260811 08:18:06.387085 23458 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.158.189" port: 34751 } attempt: 2
I20260811 08:18:06.387483 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.387352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:34751 (local address 127.0.0.1:59148)
0811 08:18:06.387413 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:06.387456 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.189:34751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
I20260811 08:18:06.387879 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.387793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:34751 (local address 127.0.0.1:59164)
0811 08:18:06.387838 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:06.387863 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.189:34751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 08:18:06.387981 23458 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.158.189:34751: Network error: Client connection negotiation failed: client connection to 127.20.158.189:34751: connect: Connection refused (error 111)
Aug 11 08:18:06 dist-test-slave-gkw7 krb5kdc[23326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436286, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:18:06.388877 23470 init.cc:377] Logged in from keytab as kudu/127.20.158.189@KRBTEST.COM (short username kudu)
I20260811 08:18:06.389338 23470 webserver.cc:460] Webserver started at http://127.20.158.189:42407/ using document root <none> and password file <none>
I20260811 08:18:06.389658 23470 fs_manager.cc:359] Metadata directory not provided
I20260811 08:18:06.389732 23470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:18:06.389896 23470 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:18:06.390937 23470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-1/data/instance:
uuid: "a5a88e4dde2c43098e8c32f1001186c0"
format_stamp: "Formatted at 2026-08-11 08:18:06 on dist-test-slave-gkw7"
server_key: "3a846e863a50a731f051599f9457ec64"
server_key_iv: "a56aa49dd0a084d7ac20a594ab0f31fa"
server_key_version: "encryptionkey@0"
I20260811 08:18:06.391299 23470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-1/wal/instance:
uuid: "a5a88e4dde2c43098e8c32f1001186c0"
format_stamp: "Formatted at 2026-08-11 08:18:06 on dist-test-slave-gkw7"
server_key: "3a846e863a50a731f051599f9457ec64"
server_key_iv: "a56aa49dd0a084d7ac20a594ab0f31fa"
server_key_version: "encryptionkey@0"
I20260811 08:18:06.392614 23470 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260811 08:18:06.393368 23497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:18:06.393618 23470 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:18:06.393721 23470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-1/wal
uuid: "a5a88e4dde2c43098e8c32f1001186c0"
format_stamp: "Formatted at 2026-08-11 08:18:06 on dist-test-slave-gkw7"
server_key: "3a846e863a50a731f051599f9457ec64"
server_key_iv: "a56aa49dd0a084d7ac20a594ab0f31fa"
server_key_version: "encryptionkey@0"
I20260811 08:18:06.393803 23470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:18:06.406788 23470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:18:06.408775 23470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:18:06.408954 23470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:18:06.413314 23470 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.189:34751
I20260811 08:18:06.413378 23578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.189:34751 every 8 connection(s)
I20260811 08:18:06.413811 23470 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-1/data/info.pb
I20260811 08:18:06.414745 23579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:18:06.416299 23579 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36421 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:18:06 dist-test-slave-gkw7 krb5kdc[23326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436286, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.189@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:18:06.423652 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 23470
I20260811 08:18:06.423763 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-1/wal/instance
I20260811 08:18:06.423959 21114 external_mini_cluster.cc:1428] Setting key 10ae44ac107a8d1bda7b73b5be7dc64e
I20260811 08:18:06.425623 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.416986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58748 (local address 127.20.158.190:36421)
0811 08:18:06.417103 (+ 117us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:06.417105 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:06.417273 (+ 168us) server_negotiation.cc:407] Connection header received
0811 08:18:06.417801 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:06.417802 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:06.417815 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:06.417874 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:06.418473 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.418950 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.419917 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.420139 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.420204 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:06.422363 (+ 2159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:06.422364 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:06.422365 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:06.422371 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:06.424076 (+ 1705us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.424485 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.424486 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.424487 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.424556 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.424871 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.424873 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.424873 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.425027 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:06.425093 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:06.425347 (+ 254us) server_negotiation.cc:299] Negotiation successful
0811 08:18:06.425442 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 08:18:06.425658 23583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.416938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36421 (local address 127.0.0.1:58748)
0811 08:18:06.417111 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:06.417152 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0811 08:18:06.417700 (+ 548us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:18:06.417948 (+ 248us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:18:06.417951 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:18:06.418209 (+ 258us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:18:06.418396 (+ 187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:06.418401 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.419026 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.419026 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:06.419819 (+ 793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:06.419822 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.420236 (+ 414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.420236 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:06.420336 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:06.420808 (+ 472us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:18:06.420816 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:18:06.422277 (+ 1461us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:18:06.424173 (+ 1896us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:06.424180 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:06.424181 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:06.424405 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:06.424663 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:06.424664 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:06.424664 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:06.424777 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:06.425094 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:18:06.425099 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:18:06.425219 (+ 120us) client_negotiation.cc:769] Sending connection context
0811 08:18:06.425304 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 08:18:06.425429 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":84,"threads_started":1}
I20260811 08:18:06.426281 23579 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.189" port: 34751 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:18:06 dist-test-slave-gkw7 krb5kdc[23326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436286, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.189@KRBTEST.COM for kudu/127.20.158.189@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.158.188@KRBTEST.COM; defaulting to no policy
I20260811 08:18:06.434679 23583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.426561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:34751 (local address 127.0.0.1:59170)
0811 08:18:06.426780 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:06.426791 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:18:06.426842 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:18:06.426979 (+ 137us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:18:06.426980 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:18:06.427117 (+ 137us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:18:06.427167 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:06.427168 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.428394 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.428395 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:06.428926 (+ 531us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:06.428927 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.429691 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.429692 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:06.429754 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:06.430218 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:18:06.430223 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:18:06.431366 (+ 1143us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:18:06.433433 (+ 2067us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:06.433434 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:06.433434 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:06.433677 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:06.433927 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:06.433928 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:06.433928 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:06.433988 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:06.434311 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:18:06.434312 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:18:06.434351 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 08:18:06.434437 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 08:18:06.434540 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 08:18:06.434710 23585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.426647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59170 (local address 127.20.158.189:34751)
0811 08:18:06.426794 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:06.426799 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:06.426842 (+ 43us) server_negotiation.cc:407] Connection header received
0811 08:18:06.426899 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:06.426901 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:06.426915 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:06.426980 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:06.427246 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.428287 (+ 1041us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.429050 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.429614 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.429694 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:06.431447 (+ 1753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:06.431456 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:06.431457 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:06.431465 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:06.433346 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.433790 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.433793 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.433794 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.433857 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.434052 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.434053 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.434053 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.434229 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:06.434323 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:06.434470 (+ 147us) server_negotiation.cc:299] Negotiation successful
0811 08:18:06.434593 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":57,"server-negotiator.queue_time_us":117,"thread_start_us":90,"threads_started":1}
I20260811 08:18:06.435441 23579 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37613 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:18:06.435834 23583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.435710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:37613 (local address 127.0.0.1:36196)
0811 08:18:06.435763 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:06.435811 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 08:18:06.436046 23499 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37613: connect: Connection refused (error 111)
I20260811 08:18:06.436712 23583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.436572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:37613 (local address 127.0.0.1:36212)
0811 08:18:06.436655 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:06.436691 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.188@KRBTEST.COM" created.
W20260811 08:18:06.436827 23579 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.158.188:37613: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37613: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.188.keytab.
Entry for principal kudu/127.20.158.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.188.keytab.
I20260811 08:18:06.452291 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.188:37613
--webserver_interface=127.20.158.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.188.keytab
--principal=kudu/127.20.158.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:34953
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:36421,127.20.158.189:34751,127.20.158.188:37613
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:18:06.479139 23458 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.158.189" port: 34751 } attempt: 3
Aug 11 08:18:06 dist-test-slave-gkw7 krb5kdc[23326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436286, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for kudu/127.20.158.189@KRBTEST.COM
I20260811 08:18:06.486068 23579 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37613 } attempt: 1
I20260811 08:18:06.486562 23583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.486421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:37613 (local address 127.0.0.1:36222)
0811 08:18:06.486484 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:06.486519 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 08:18:06.486982 23583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.486880 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:37613 (local address 127.0.0.1:36224)
0811 08:18:06.486930 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:06.486958 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 08:18:06.487082 23579 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.158.188:37613: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37613: connect: Connection refused (error 111)
I20260811 08:18:06.487497 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.479577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:34751 (local address 127.0.0.1:59186)
0811 08:18:06.479648 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:06.479659 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:18:06.479735 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:18:06.479901 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:18:06.479902 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:18:06.480074 (+ 172us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:18:06.480164 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:06.480167 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.480868 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.480869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:06.481423 (+ 554us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:06.481424 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.482092 (+ 668us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.482094 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:06.482215 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:06.482795 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:18:06.482802 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:18:06.484226 (+ 1424us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:18:06.486036 (+ 1810us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:06.486037 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:06.486038 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:06.486254 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:06.486536 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:06.486537 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:06.486538 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:06.486638 (+ 100us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:06.487112 (+ 474us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:18:06.487113 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:18:06.487182 (+ 69us) client_negotiation.cc:769] Sending connection context
0811 08:18:06.487289 (+ 107us) client_negotiation.cc:240] Negotiation successful
0811 08:18:06.487395 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260811 08:18:06.487808 23585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.479652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59186 (local address 127.20.158.189:34751)
0811 08:18:06.479721 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:06.479723 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:06.479735 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:18:06.479806 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:06.479807 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:06.479820 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:06.479894 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:06.480253 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.480770 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.481515 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.481924 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.482044 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:06.484319 (+ 2275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:06.484321 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:06.484321 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:06.484329 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:06.485944 (+ 1615us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.486360 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.486361 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.486362 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.486425 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.486815 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.486816 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.486816 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.486974 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:06.487050 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:06.487639 (+ 589us) server_negotiation.cc:299] Negotiation successful
0811 08:18:06.487724 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260811 08:18:06.488328 23458 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37613 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:18:06.488687 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.488580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:37613 (local address 127.0.0.1:36230)
0811 08:18:06.488622 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:06.488666 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260811 08:18:06.489009 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.488957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:37613 (local address 127.0.0.1:36242)
0811 08:18:06.488979 (+ 22us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:06.488997 (+ 18us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":14}
W20260811 08:18:06.489110 23458 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.158.188:37613: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37613: connect: Connection refused (error 111)
I20260811 08:18:06.520262 23458 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37613 } attempt: 1
I20260811 08:18:06.520848 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.520695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:37613 (local address 127.0.0.1:36244)
0811 08:18:06.520766 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:06.520817 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 08:18:06.521476 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.521363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:37613 (local address 127.0.0.1:36248)
0811 08:18:06.521424 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:06.521453 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260811 08:18:06.521637 23458 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.158.188:37613: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37613: connect: Connection refused (error 111)
W20260811 08:18:06.539984 23590 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 08:18:06.540200 23590 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:18:06.540218 23590 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:18:06.540266 23590 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:18:06.541424 23590 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:18:06.541468 23590 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:18:06.541482 23590 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:18:06.541522 23590 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:18:06.541575 23590 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:18:06.543079 23590 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:34953
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:36421,127.20.158.189:34751,127.20.158.188:37613
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.188.keytab
--principal=kudu/127.20.158.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.188:37613
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.158.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23590
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:18:06.543361 23590 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:18:06.543613 23590 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:18:06.548596 23602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:18:06.548609 23601 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:18:06.548687 23590 server_base.cc:1034] running on GCE node
W20260811 08:18:06.548615 23604 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:18:06.549037 23590 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:18:06.549322 23590 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:18:06.550513 23590 hybrid_clock.cc:648] HybridClock initialized: now 1786436286550479 us; error 64 us; skew 500 ppm
Aug 11 08:18:06 dist-test-slave-gkw7 krb5kdc[23326](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436286, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:18:06.553117 23590 init.cc:377] Logged in from keytab as kudu/127.20.158.188@KRBTEST.COM (short username kudu)
I20260811 08:18:06.553604 23590 webserver.cc:460] Webserver started at http://127.20.158.188:42121/ using document root <none> and password file <none>
I20260811 08:18:06.553854 23590 fs_manager.cc:359] Metadata directory not provided
I20260811 08:18:06.553922 23590 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:18:06.554073 23590 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:18:06.555236 23579 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37613 } attempt: 2
I20260811 08:18:06.555148 23590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-2/data/instance:
uuid: "d932157761c64fa0aa6b595018c660fa"
format_stamp: "Formatted at 2026-08-11 08:18:06 on dist-test-slave-gkw7"
server_key: "ad49f89f8763ff496831d06edba9a9ef"
server_key_iv: "b69dc72fa4ae0a8add7b99beec903ed8"
server_key_version: "encryptionkey@0"
I20260811 08:18:06.555609 23590 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-2/wal/instance:
uuid: "d932157761c64fa0aa6b595018c660fa"
format_stamp: "Formatted at 2026-08-11 08:18:06 on dist-test-slave-gkw7"
server_key: "ad49f89f8763ff496831d06edba9a9ef"
server_key_iv: "b69dc72fa4ae0a8add7b99beec903ed8"
server_key_version: "encryptionkey@0"
I20260811 08:18:06.555696 23583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.555546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:37613 (local address 127.0.0.1:36264)
0811 08:18:06.555616 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:06.555658 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260811 08:18:06.556143 23583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.555996 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:37613 (local address 127.0.0.1:36272)
0811 08:18:06.556053 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:06.556083 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37613: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
W20260811 08:18:06.556305 23579 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.158.188:37613: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37613: connect: Connection refused (error 111)
I20260811 08:18:06.557343 23590 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:18:06.558485 23615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:18:06.558775 23590 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:18:06.558883 23590 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-2/wal
uuid: "d932157761c64fa0aa6b595018c660fa"
format_stamp: "Formatted at 2026-08-11 08:18:06 on dist-test-slave-gkw7"
server_key: "ad49f89f8763ff496831d06edba9a9ef"
server_key_iv: "b69dc72fa4ae0a8add7b99beec903ed8"
server_key_version: "encryptionkey@0"
I20260811 08:18:06.558961 23590 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:18:06.567804 23590 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:18:06.570225 23590 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:18:06.570379 23590 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:18:06.574640 23590 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.188:37613
I20260811 08:18:06.574698 23694 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.188:37613 every 8 connection(s)
I20260811 08:18:06.575066 23590 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-2/data/info.pb
I20260811 08:18:06.576007 23697 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:18:06.577314 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 23590
I20260811 08:18:06.577411 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786436003833085-21114-0/minicluster-data/master-2/wal/instance
I20260811 08:18:06.577679 21114 external_mini_cluster.cc:1428] Setting key 8763d2b5ad49d563421bfa44f18383c5
I20260811 08:18:06.577792 23697 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36421 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:18:06 dist-test-slave-gkw7 krb5kdc[23326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436286, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.188@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
Aug 11 08:18:06 dist-test-slave-gkw7 krb5kdc[23326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.188@KRBTEST.COM
I20260811 08:18:06.588164 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.578668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58762 (local address 127.20.158.190:36421)
0811 08:18:06.578722 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:06.578725 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:06.578865 (+ 140us) server_negotiation.cc:407] Connection header received
0811 08:18:06.579277 (+ 412us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:06.579279 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:06.579290 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:06.579359 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:06.580004 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.580502 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.581741 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.582056 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.582135 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:06.584647 (+ 2512us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:06.584649 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:06.584649 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:06.584657 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:06.586551 (+ 1894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.586984 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.586986 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.586986 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.587050 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.587327 (+ 277us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.587328 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.587329 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.587450 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:06.587530 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:06.587850 (+ 320us) server_negotiation.cc:299] Negotiation successful
0811 08:18:06.588048 (+ 198us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260811 08:18:06.588201 23703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.578574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:36421 (local address 127.0.0.1:58762)
0811 08:18:06.578732 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:06.578775 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0811 08:18:06.579152 (+ 377us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:18:06.579396 (+ 244us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:18:06.579399 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:18:06.579704 (+ 305us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:18:06.579870 (+ 166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:06.579874 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.580584 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.580585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:06.581661 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:06.581663 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.582152 (+ 489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.582153 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:06.582289 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:06.582908 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:18:06.582917 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:18:06.584556 (+ 1639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:18:06.586658 (+ 2102us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:06.586665 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:06.586668 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:06.586901 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:06.587139 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:06.587139 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:06.587140 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:06.587255 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:06.587563 (+ 308us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:18:06.587595 (+ 32us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:18:06.587730 (+ 135us) client_negotiation.cc:769] Sending connection context
0811 08:18:06.587816 (+ 86us) client_negotiation.cc:240] Negotiation successful
0811 08:18:06.587971 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"mutex_wait_us":60,"thread_start_us":82,"threads_started":1}
I20260811 08:18:06.588826 23702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.578272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36288 (local address 127.20.158.188:37613)
0811 08:18:06.578444 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:06.578452 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:06.578508 (+ 56us) server_negotiation.cc:407] Connection header received
0811 08:18:06.579150 (+ 642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:06.579159 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:06.579187 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:06.579320 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:06.579966 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.581143 (+ 1177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.582139 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.582582 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.582644 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:06.585237 (+ 2593us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:06.585246 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:06.585246 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:06.585253 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:06.587162 (+ 1909us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.587636 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.587639 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.587640 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.587705 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.587924 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.587925 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.587925 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.588094 (+ 169us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:06.588245 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:06.588595 (+ 350us) server_negotiation.cc:299] Negotiation successful
0811 08:18:06.588721 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":93,"threads_started":1}
I20260811 08:18:06.588860 23697 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.189" port: 34751 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:18:06 dist-test-slave-gkw7 krb5kdc[23326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436286, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.188@KRBTEST.COM for kudu/127.20.158.189@KRBTEST.COM
Aug 11 08:18:06 dist-test-slave-gkw7 krb5kdc[23326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:18:06.595623 23703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.589124 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:34751 (local address 127.0.0.1:59202)
0811 08:18:06.589162 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:06.589174 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:18:06.589217 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:18:06.589366 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:18:06.589367 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:18:06.589582 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:18:06.589635 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:06.589637 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.590264 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.590265 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:06.590744 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:06.590746 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.591120 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.591121 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:06.591186 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:06.591577 (+ 391us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:18:06.591582 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:18:06.592743 (+ 1161us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:18:06.594577 (+ 1834us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:06.594578 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:06.594579 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:06.594812 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:06.595057 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:06.595058 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:06.595058 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:06.595120 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:06.595409 (+ 289us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:18:06.595409 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:18:06.595442 (+ 33us) client_negotiation.cc:769] Sending connection context
0811 08:18:06.595492 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 08:18:06.595562 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20}
I20260811 08:18:06.595796 23585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.589192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59202 (local address 127.20.158.189:34751)
0811 08:18:06.589248 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:06.589250 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:06.589261 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:18:06.589285 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:06.589286 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:06.589296 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:06.589353 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:06.589722 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.590174 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.590831 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.591044 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.591123 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:06.592845 (+ 1722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:06.592846 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:06.592846 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:06.592854 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:06.594496 (+ 1642us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.594897 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.594898 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.594899 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.594961 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.595200 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.595201 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.595201 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.595338 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:06.595416 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:06.595522 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 08:18:06.595597 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:18:06.596140 23697 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37613 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:18:06.596819 23458 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37613 } attempt: 2
I20260811 08:18:06.597041 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.589611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58772 (local address 127.20.158.190:36421)
0811 08:18:06.589646 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:06.589648 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:06.589679 (+ 31us) server_negotiation.cc:407] Connection header received
0811 08:18:06.589749 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:06.589749 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:06.589758 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:06.589813 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:06.590261 (+ 448us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.590707 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.591392 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.591590 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.591663 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:06.594034 (+ 2371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:06.594035 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:06.594035 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:06.594041 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:06.595693 (+ 1652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.596044 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.596046 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.596046 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.596105 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.596317 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.596318 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.596318 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.596444 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:06.596659 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:06.596875 (+ 216us) server_negotiation.cc:299] Negotiation successful
0811 08:18:06.596957 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
Aug 11 08:18:06 dist-test-slave-gkw7 krb5kdc[23326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436286, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.188@KRBTEST.COM for kudu/127.20.158.188@KRBTEST.COM
Aug 11 08:18:06 dist-test-slave-gkw7 krb5kdc[23326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436286, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for kudu/127.20.158.188@KRBTEST.COM
Aug 11 08:18:06 dist-test-slave-gkw7 krb5kdc[23326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436286, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.189@KRBTEST.COM
I20260811 08:18:06.603863 23703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.596430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:37613 (local address 127.0.0.1:36292)
0811 08:18:06.596481 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:06.596491 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:18:06.596532 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:18:06.596666 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:18:06.596667 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:18:06.596798 (+ 131us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:18:06.596851 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:06.596852 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.597745 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.597746 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:06.598524 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:06.598527 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.599002 (+ 475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.599003 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:06.599061 (+ 58us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:06.599500 (+ 439us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:18:06.599505 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:18:06.600853 (+ 1348us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:18:06.602823 (+ 1970us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:06.602824 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:06.602825 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:06.603025 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:06.603234 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:06.603235 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:06.603235 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:06.603289 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:06.603567 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:18:06.603568 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:18:06.603607 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 08:18:06.603673 (+ 66us) client_negotiation.cc:240] Negotiation successful
0811 08:18:06.603757 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260811 08:18:06.604194 23702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.596484 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36292 (local address 127.20.158.188:37613)
0811 08:18:06.596518 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:06.596520 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:06.596528 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:18:06.596606 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:06.596607 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:06.596614 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:06.596655 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:06.596928 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.597671 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.598610 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.598918 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.598993 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:06.600961 (+ 1968us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:06.600963 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:06.600963 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:06.600970 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:06.602749 (+ 1779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.603119 (+ 370us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.603120 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.603120 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.603170 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.603350 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.603350 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.603350 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.603487 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:06.603545 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:06.603978 (+ 433us) server_negotiation.cc:299] Negotiation successful
0811 08:18:06.604096 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:18:06.605439 23460 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.597042 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:37613 (local address 127.0.0.1:36304)
0811 08:18:06.597096 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:06.597104 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0811 08:18:06.597138 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:18:06.597631 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:18:06.597632 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:18:06.597800 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:18:06.597835 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:06.597837 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.598728 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.598729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:06.599446 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:06.599464 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.599960 (+ 496us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.599961 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:06.600021 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:06.600431 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:18:06.600437 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:18:06.601954 (+ 1517us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:18:06.604321 (+ 2367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:06.604323 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:06.604323 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:06.604546 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:06.604771 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:06.604772 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:06.604772 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:06.604829 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:06.605116 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:18:06.605117 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:18:06.605161 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 08:18:06.605252 (+ 91us) client_negotiation.cc:240] Negotiation successful
0811 08:18:06.605348 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260811 08:18:06.605465 23704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.597293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36304 (local address 127.20.158.188:37613)
0811 08:18:06.597467 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:06.597469 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:06.597477 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:18:06.597494 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:06.597494 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:06.597503 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:06.597902 (+ 399us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:06.597932 (+ 30us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.598641 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.599536 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.599857 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.599954 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:06.602467 (+ 2513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:06.602468 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:06.602468 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:06.602475 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:06.604218 (+ 1743us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.604658 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.604659 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.604659 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.604719 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.604906 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.604907 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.604907 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.605036 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:06.605122 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:06.605276 (+ 154us) server_negotiation.cc:299] Negotiation successful
0811 08:18:06.605348 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":102,"threads_started":1}
I20260811 08:18:06.605742 23697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d932157761c64fa0aa6b595018c660fa: Bootstrap starting.
I20260811 08:18:06.606452 23697 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d932157761c64fa0aa6b595018c660fa: Neither blocks nor log segments found. Creating new log.
I20260811 08:18:06.606745 23697 log.cc:824] T 00000000000000000000000000000000 P d932157761c64fa0aa6b595018c660fa: Log is configured to *not* fsync() on all Append() calls
I20260811 08:18:06.607131 23458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834: Bootstrap starting.
I20260811 08:18:06.607517 23697 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d932157761c64fa0aa6b595018c660fa: No bootstrap required, opened a new log
I20260811 08:18:06.607787 23458 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834: Neither blocks nor log segments found. Creating new log.
I20260811 08:18:06.608060 23458 log.cc:824] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834: Log is configured to *not* fsync() on all Append() calls
I20260811 08:18:06.608750 23458 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834: No bootstrap required, opened a new log
I20260811 08:18:06.609037 23697 raft_consensus.cc:348] T 00000000000000000000000000000000 P d932157761c64fa0aa6b595018c660fa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ace0ae67f6fd498dae39740f62db8834" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36421 } } peers { permanent_uuid: "a5a88e4dde2c43098e8c32f1001186c0" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 34751 } } peers { permanent_uuid: "d932157761c64fa0aa6b595018c660fa" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37613 } }
I20260811 08:18:06.609157 23697 raft_consensus.cc:729] T 00000000000000000000000000000000 P d932157761c64fa0aa6b595018c660fa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d932157761c64fa0aa6b595018c660fa, State: Initialized, Role: FOLLOWER
I20260811 08:18:06.609249 23697 consensus_queue.cc:260] T 00000000000000000000000000000000 P d932157761c64fa0aa6b595018c660fa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ace0ae67f6fd498dae39740f62db8834" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36421 } } peers { permanent_uuid: "a5a88e4dde2c43098e8c32f1001186c0" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 34751 } } peers { permanent_uuid: "d932157761c64fa0aa6b595018c660fa" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37613 } }
I20260811 08:18:06.609573 23707 sys_catalog.cc:455] T 00000000000000000000000000000000 P d932157761c64fa0aa6b595018c660fa [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ace0ae67f6fd498dae39740f62db8834" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36421 } } peers { permanent_uuid: "a5a88e4dde2c43098e8c32f1001186c0" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 34751 } } peers { permanent_uuid: "d932157761c64fa0aa6b595018c660fa" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37613 } } }
I20260811 08:18:06.609632 23697 sys_catalog.cc:564] T 00000000000000000000000000000000 P d932157761c64fa0aa6b595018c660fa [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:18:06.609761 23707 sys_catalog.cc:458] T 00000000000000000000000000000000 P d932157761c64fa0aa6b595018c660fa [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:18:06.610675 23458 raft_consensus.cc:348] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ace0ae67f6fd498dae39740f62db8834" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36421 } } peers { permanent_uuid: "a5a88e4dde2c43098e8c32f1001186c0" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 34751 } } peers { permanent_uuid: "d932157761c64fa0aa6b595018c660fa" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37613 } }
I20260811 08:18:06.610785 23585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.597675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59210 (local address 127.20.158.189:34751)
0811 08:18:06.597728 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:06.597730 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:06.597756 (+ 26us) server_negotiation.cc:407] Connection header received
0811 08:18:06.597825 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:06.597826 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:06.597835 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:06.597878 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:06.598336 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.598937 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.599889 (+ 952us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.600192 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.600280 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:06.602833 (+ 2553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:06.602834 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:06.602835 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:06.602842 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:06.604551 (+ 1709us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.609684 (+ 5133us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.609685 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.609686 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.609775 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.610009 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.610010 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.610010 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.610155 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:06.610308 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:06.610580 (+ 272us) server_negotiation.cc:299] Negotiation successful
0811 08:18:06.610687 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 08:18:06.610808 23458 raft_consensus.cc:729] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ace0ae67f6fd498dae39740f62db8834, State: Initialized, Role: FOLLOWER
I20260811 08:18:06.610893 23458 consensus_queue.cc:260] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ace0ae67f6fd498dae39740f62db8834" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36421 } } peers { permanent_uuid: "a5a88e4dde2c43098e8c32f1001186c0" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 34751 } } peers { permanent_uuid: "d932157761c64fa0aa6b595018c660fa" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37613 } }
I20260811 08:18:06.611155 23715 sys_catalog.cc:455] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ace0ae67f6fd498dae39740f62db8834" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36421 } } peers { permanent_uuid: "a5a88e4dde2c43098e8c32f1001186c0" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 34751 } } peers { permanent_uuid: "d932157761c64fa0aa6b595018c660fa" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37613 } } }
I20260811 08:18:06.611301 23715 sys_catalog.cc:458] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:18:06.611227 23458 sys_catalog.cc:564] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:18:06.613016 21114 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260811 08:18:06.613646 23720 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d932157761c64fa0aa6b595018c660fa: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:18:06.613693 23720 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:18:06.614153 23419 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "ace0ae67f6fd498dae39740f62db8834"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58772
I20260811 08:18:06.614272 23419 raft_consensus.cc:482] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 08:18:06.614312 23419 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834 [term 0 FOLLOWER]: Advancing to term 1
W20260811 08:18:06.614454 23740 catalog_manager.cc:1558] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:18:06.614492 23740 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:18:06.612257 23590 master_runner.cc:186] Error getting master registration for 127.20.158.190:36421: OK, instance_id { permanent_uuid: "ace0ae67f6fd498dae39740f62db8834" instance_seqno: 1786436286251914 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 08:18:06.615238 23590 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 08:18:06.615595 23419 raft_consensus.cc:504] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ace0ae67f6fd498dae39740f62db8834" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36421 } } peers { permanent_uuid: "a5a88e4dde2c43098e8c32f1001186c0" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 34751 } } peers { permanent_uuid: "d932157761c64fa0aa6b595018c660fa" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37613 } }
I20260811 08:18:06.615819 23419 leader_election.cc:288] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834 [CANDIDATE]: Term 1 election: Requested vote from peers a5a88e4dde2c43098e8c32f1001186c0 (127.20.158.189:34751), d932157761c64fa0aa6b595018c660fa (127.20.158.188:37613)
I20260811 08:18:06.614287 23348 master_runner.cc:186] Error getting master registration for 127.20.158.189:34751: OK, instance_id { permanent_uuid: "a5a88e4dde2c43098e8c32f1001186c0" instance_seqno: 1786436286412079 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 08:18:06.616022 23348 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 08:18:06.616287 23653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ace0ae67f6fd498dae39740f62db8834" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d932157761c64fa0aa6b595018c660fa"
I20260811 08:18:06.616428 23653 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d932157761c64fa0aa6b595018c660fa [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:18:06.617448 23653 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d932157761c64fa0aa6b595018c660fa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ace0ae67f6fd498dae39740f62db8834 in term 1.
I20260811 08:18:06.617733 23379 leader_election.cc:302] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ace0ae67f6fd498dae39740f62db8834, d932157761c64fa0aa6b595018c660fa; no voters:
I20260811 08:18:06.617858 23715 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834 [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:18:06.618014 23715 raft_consensus.cc:686] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834 [term 1 LEADER]: Becoming Leader. State: Replica: ace0ae67f6fd498dae39740f62db8834, State: Running, Role: LEADER
I20260811 08:18:06.618111 23715 consensus_queue.cc:237] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ace0ae67f6fd498dae39740f62db8834" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36421 } } peers { permanent_uuid: "a5a88e4dde2c43098e8c32f1001186c0" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 34751 } } peers { permanent_uuid: "d932157761c64fa0aa6b595018c660fa" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37613 } }
I20260811 08:18:06.618541 23715 sys_catalog.cc:455] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ace0ae67f6fd498dae39740f62db8834. Latest consensus state: current_term: 1 leader_uuid: "ace0ae67f6fd498dae39740f62db8834" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ace0ae67f6fd498dae39740f62db8834" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36421 } } peers { permanent_uuid: "a5a88e4dde2c43098e8c32f1001186c0" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 34751 } } peers { permanent_uuid: "d932157761c64fa0aa6b595018c660fa" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37613 } } }
I20260811 08:18:06.618636 23715 sys_catalog.cc:458] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834 [sys.catalog]: This master's current role is: LEADER
I20260811 08:18:06.625931 23704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.617188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36320 (local address 127.20.158.188:37613)
0811 08:18:06.617236 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:06.617238 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:06.617392 (+ 154us) server_negotiation.cc:407] Connection header received
0811 08:18:06.617480 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:06.617481 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:06.617494 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:06.617648 (+ 154us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:06.618670 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.619231 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.620311 (+ 1080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.620632 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.620695 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:06.622417 (+ 1722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:06.622418 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:06.622419 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:06.622426 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:06.624240 (+ 1814us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.624665 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.624666 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.624666 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.624739 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.624940 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.624941 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.624942 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.625076 (+ 134us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:06.625199 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:06.625691 (+ 492us) server_negotiation.cc:299] Negotiation successful
0811 08:18:06.625777 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:18:06.625982 23759 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:18:06.626192 23759 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:18:06.628017 23653 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d932157761c64fa0aa6b595018c660fa [term 1 FOLLOWER]: Refusing update from remote peer ace0ae67f6fd498dae39740f62db8834: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:18:06.628352 23715 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d932157761c64fa0aa6b595018c660fa" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37613 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:18:06.629889 23707 sys_catalog.cc:455] T 00000000000000000000000000000000 P d932157761c64fa0aa6b595018c660fa [sys.catalog]: SysCatalogTable state changed. Reason: New leader ace0ae67f6fd498dae39740f62db8834. Latest consensus state: current_term: 1 leader_uuid: "ace0ae67f6fd498dae39740f62db8834" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ace0ae67f6fd498dae39740f62db8834" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36421 } } peers { permanent_uuid: "a5a88e4dde2c43098e8c32f1001186c0" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 34751 } } peers { permanent_uuid: "d932157761c64fa0aa6b595018c660fa" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37613 } } }
I20260811 08:18:06.629997 23707 sys_catalog.cc:458] T 00000000000000000000000000000000 P d932157761c64fa0aa6b595018c660fa [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:18:06.634812 23762 mvcc.cc:205] Tried to move back new op lower bound from 7317243030025535488 to 7317243029988548608. Current Snapshot: MvccSnapshot[applied={T|T < 7317243030025535488}]
I20260811 08:18:06.635274 23715 sys_catalog.cc:455] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ace0ae67f6fd498dae39740f62db8834" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ace0ae67f6fd498dae39740f62db8834" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36421 } } peers { permanent_uuid: "a5a88e4dde2c43098e8c32f1001186c0" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 34751 } } peers { permanent_uuid: "d932157761c64fa0aa6b595018c660fa" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37613 } } }
I20260811 08:18:06.635380 23715 sys_catalog.cc:458] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834 [sys.catalog]: This master's current role is: LEADER
I20260811 08:18:06.636014 23707 sys_catalog.cc:455] T 00000000000000000000000000000000 P d932157761c64fa0aa6b595018c660fa [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ace0ae67f6fd498dae39740f62db8834" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ace0ae67f6fd498dae39740f62db8834" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36421 } } peers { permanent_uuid: "a5a88e4dde2c43098e8c32f1001186c0" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 34751 } } peers { permanent_uuid: "d932157761c64fa0aa6b595018c660fa" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37613 } } }
I20260811 08:18:06.636116 23707 sys_catalog.cc:458] T 00000000000000000000000000000000 P d932157761c64fa0aa6b595018c660fa [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:18:06.637279 23763 mvcc.cc:205] Tried to move back new op lower bound from 7317243030025535488 to 7317243029988548608. Current Snapshot: MvccSnapshot[applied={T|T < 7317243030025535488}]
I20260811 08:18:06.638180 23759 catalog_manager.cc:1347] Generated new cluster ID: 68679e17f4d64bb9a2605c4d3e681de1
I20260811 08:18:06.638234 23759 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:18:06.639943 23461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.617654 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58774 (local address 127.20.158.190:36421)
0811 08:18:06.617884 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:06.617886 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:06.626349 (+ 8463us) server_negotiation.cc:407] Connection header received
0811 08:18:06.626449 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:06.626451 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:06.626464 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:06.626495 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:06.627244 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.627997 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.629909 (+ 1912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.630252 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.630306 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:06.633210 (+ 2904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:06.633211 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:06.633212 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:06.633220 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:06.635347 (+ 2127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.636243 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.636245 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.636245 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.636316 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.636684 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.636686 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.636686 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.636839 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:06.636932 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:06.639441 (+ 2509us) server_negotiation.cc:299] Negotiation successful
0811 08:18:06.639846 (+ 405us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":210}
I20260811 08:18:06.642390 23585 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.625800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59212 (local address 127.20.158.189:34751)
0811 08:18:06.625856 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:06.625859 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:06.630242 (+ 4383us) server_negotiation.cc:407] Connection header received
0811 08:18:06.630318 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:06.630319 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:06.630330 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:06.630390 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:06.634203 (+ 3813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.634936 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.636390 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.636723 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.636770 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:06.639273 (+ 2503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:06.639276 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:06.639276 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:06.639294 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:06.640824 (+ 1530us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.641322 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.641323 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.641324 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.641384 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.641675 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.641676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.641677 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.641835 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:06.641910 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:06.642193 (+ 283us) server_negotiation.cc:299] Negotiation successful
0811 08:18:06.642290 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:18:06.647455 23579 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37613 } attempt: 3
Aug 11 08:18:06 dist-test-slave-gkw7 krb5kdc[23326](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436286, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.189@KRBTEST.COM for kudu/127.20.158.188@KRBTEST.COM
I20260811 08:18:06.655984 23583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.647705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:37613 (local address 127.0.0.1:36326)
0811 08:18:06.647750 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:06.647759 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0811 08:18:06.647794 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:18:06.647958 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:18:06.647959 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:18:06.648127 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:18:06.648170 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:06.648171 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.649099 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.649101 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:06.649924 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:06.649926 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.650438 (+ 512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.650439 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:06.650496 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:06.650982 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:18:06.650988 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:18:06.652642 (+ 1654us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:18:06.654924 (+ 2282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:06.654925 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:06.654926 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:06.655155 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:06.655361 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:06.655361 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:06.655362 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:06.655416 (+ 54us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:06.655686 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:18:06.655687 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:18:06.655731 (+ 44us) client_negotiation.cc:769] Sending connection context
0811 08:18:06.655791 (+ 60us) client_negotiation.cc:240] Negotiation successful
0811 08:18:06.655886 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28}
I20260811 08:18:06.656498 23704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:06.647787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36326 (local address 127.20.158.188:37613)
0811 08:18:06.647832 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:06.647834 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:06.647843 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:18:06.647869 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:06.647869 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:06.647881 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:06.647954 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:06.648260 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.648996 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.650015 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:06.650324 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:06.650386 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:06.652719 (+ 2333us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:06.652720 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:06.652720 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:06.652728 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:06.654756 (+ 2028us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.655238 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.655240 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.655240 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.655296 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:06.655478 (+ 182us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:06.655478 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:06.655479 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:06.655600 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:06.655660 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:06.656328 (+ 668us) server_negotiation.cc:299] Negotiation successful
0811 08:18:06.656409 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260811 08:18:06.656932 23759 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:18:06.657743 23759 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:18:06.658401 23579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5a88e4dde2c43098e8c32f1001186c0: Bootstrap starting.
I20260811 08:18:06.659171 23579 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a5a88e4dde2c43098e8c32f1001186c0: Neither blocks nor log segments found. Creating new log.
I20260811 08:18:06.659502 23579 log.cc:824] T 00000000000000000000000000000000 P a5a88e4dde2c43098e8c32f1001186c0: Log is configured to *not* fsync() on all Append() calls
I20260811 08:18:06.661382 23579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a5a88e4dde2c43098e8c32f1001186c0: No bootstrap required, opened a new log
I20260811 08:18:06.663432 23579 raft_consensus.cc:348] T 00000000000000000000000000000000 P a5a88e4dde2c43098e8c32f1001186c0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ace0ae67f6fd498dae39740f62db8834" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36421 } } peers { permanent_uuid: "a5a88e4dde2c43098e8c32f1001186c0" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 34751 } } peers { permanent_uuid: "d932157761c64fa0aa6b595018c660fa" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37613 } }
I20260811 08:18:06.663573 23579 raft_consensus.cc:729] T 00000000000000000000000000000000 P a5a88e4dde2c43098e8c32f1001186c0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a5a88e4dde2c43098e8c32f1001186c0, State: Initialized, Role: FOLLOWER
I20260811 08:18:06.663667 23579 consensus_queue.cc:260] T 00000000000000000000000000000000 P a5a88e4dde2c43098e8c32f1001186c0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ace0ae67f6fd498dae39740f62db8834" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36421 } } peers { permanent_uuid: "a5a88e4dde2c43098e8c32f1001186c0" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 34751 } } peers { permanent_uuid: "d932157761c64fa0aa6b595018c660fa" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37613 } }
I20260811 08:18:06.664006 23579 sys_catalog.cc:564] T 00000000000000000000000000000000 P a5a88e4dde2c43098e8c32f1001186c0 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:18:06.665469 23539 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a5a88e4dde2c43098e8c32f1001186c0 [term 0 FOLLOWER]: Advancing to term 1
W20260811 08:18:06.665903 23794 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a5a88e4dde2c43098e8c32f1001186c0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:18:06.665961 23794 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:18:06.666395 23539 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a5a88e4dde2c43098e8c32f1001186c0 [term 1 FOLLOWER]: Refusing update from remote peer ace0ae67f6fd498dae39740f62db8834: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:18:06.666761 23541 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ace0ae67f6fd498dae39740f62db8834" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "a5a88e4dde2c43098e8c32f1001186c0"
I20260811 08:18:06.667543 23541 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a5a88e4dde2c43098e8c32f1001186c0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ace0ae67f6fd498dae39740f62db8834 in term 1.
I20260811 08:18:06.668411 23769 consensus_queue.cc:1035] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a5a88e4dde2c43098e8c32f1001186c0" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 34751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:18:06.669377 23759 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834: Generated new TSK 0
I20260811 08:18:06.669600 23759 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260811 08:18:06.670231 23776 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5a88e4dde2c43098e8c32f1001186c0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ace0ae67f6fd498dae39740f62db8834" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ace0ae67f6fd498dae39740f62db8834" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36421 } } peers { permanent_uuid: "a5a88e4dde2c43098e8c32f1001186c0" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 34751 } } peers { permanent_uuid: "d932157761c64fa0aa6b595018c660fa" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37613 } } }
I20260811 08:18:06.670321 23776 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5a88e4dde2c43098e8c32f1001186c0 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:18:06.670373 23776 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5a88e4dde2c43098e8c32f1001186c0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ace0ae67f6fd498dae39740f62db8834. Latest consensus state: current_term: 1 leader_uuid: "ace0ae67f6fd498dae39740f62db8834" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ace0ae67f6fd498dae39740f62db8834" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36421 } } peers { permanent_uuid: "a5a88e4dde2c43098e8c32f1001186c0" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 34751 } } peers { permanent_uuid: "d932157761c64fa0aa6b595018c660fa" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37613 } } }
I20260811 08:18:06.670428 23776 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5a88e4dde2c43098e8c32f1001186c0 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:18:06.670462 23776 sys_catalog.cc:455] T 00000000000000000000000000000000 P a5a88e4dde2c43098e8c32f1001186c0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ace0ae67f6fd498dae39740f62db8834" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ace0ae67f6fd498dae39740f62db8834" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36421 } } peers { permanent_uuid: "a5a88e4dde2c43098e8c32f1001186c0" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 34751 } } peers { permanent_uuid: "d932157761c64fa0aa6b595018c660fa" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37613 } } }
I20260811 08:18:06.670511 23776 sys_catalog.cc:458] T 00000000000000000000000000000000 P a5a88e4dde2c43098e8c32f1001186c0 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:18:06.674948 23800 mvcc.cc:205] Tried to move back new op lower bound from 7317243030131458048 to 7317243029988548608. Current Snapshot: MvccSnapshot[applied={T|T < 7317243030025535488}]
I20260811 08:18:06.675740 23715 sys_catalog.cc:455] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ace0ae67f6fd498dae39740f62db8834" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ace0ae67f6fd498dae39740f62db8834" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 36421 } } peers { permanent_uuid: "a5a88e4dde2c43098e8c32f1001186c0" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 34751 } } peers { permanent_uuid: "d932157761c64fa0aa6b595018c660fa" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37613 } } }
I20260811 08:18:06.675829 23715 sys_catalog.cc:458] T 00000000000000000000000000000000 P ace0ae67f6fd498dae39740f62db8834 [sys.catalog]: This master's current role is: LEADER
W20260811 08:18:06.695030 23461 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:18:06.693693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58786 (local address 127.20.158.190:36421)
0811 08:18:06.693740 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:06.693742 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:06.694363 (+ 621us) server_negotiation.cc:407] Connection header received
0811 08:18:06.694471 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:06.694472 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:06.694484 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:06.694515 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:06.694953 (+ 438us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58786: BlockingRecv error: recv got EOF from 127.0.0.1:58786 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 08:18:06.695899 23585 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:18:06.694098 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59222 (local address 127.20.158.189:34751)
0811 08:18:06.694136 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:06.694138 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:06.695407 (+ 1269us) server_negotiation.cc:407] Connection header received
0811 08:18:06.695500 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:06.695501 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:06.695511 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:06.695540 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:06.695840 (+ 300us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59222: BlockingRecv error: recv got EOF from 127.0.0.1:59222 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 08:18:06.696975 23704 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:18:06.696409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36336 (local address 127.20.158.188:37613)
0811 08:18:06.696454 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:06.696456 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:06.696493 (+ 37us) server_negotiation.cc:407] Connection header received
0811 08:18:06.696581 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:06.696583 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:06.696592 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:06.696621 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:06.696912 (+ 291us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:36336: BlockingRecv error: recv got EOF from 127.0.0.1:36336 (error 108)
Metrics: {"server-negotiator.queue_time_us":24}
W20260811 08:18:06.698984 23585 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:18:06.698292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59238 (local address 127.20.158.189:34751)
0811 08:18:06.698324 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:06.698326 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:06.698502 (+ 176us) server_negotiation.cc:407] Connection header received
0811 08:18:06.698605 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:06.698606 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:06.698625 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:06.698655 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:06.698942 (+ 287us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59238: BlockingRecv error: recv got EOF from 127.0.0.1:59238 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260811 08:18:06.702018 23585 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:18:06.701253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59246 (local address 127.20.158.189:34751)
0811 08:18:06.701284 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:06.701286 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:06.701497 (+ 211us) server_negotiation.cc:407] Connection header received
0811 08:18:06.701629 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:06.701630 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:06.701640 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:06.701668 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:06.701978 (+ 310us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59246: BlockingRecv error: recv got EOF from 127.0.0.1:59246 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260811 08:18:06.705906 23585 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:18:06.705165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59254 (local address 127.20.158.189:34751)
0811 08:18:06.705195 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:06.705196 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:06.705415 (+ 219us) server_negotiation.cc:407] Connection header received
0811 08:18:06.705507 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:06.705508 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:06.705517 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:06.705570 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:06.705866 (+ 296us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59254: BlockingRecv error: recv got EOF from 127.0.0.1:59254 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260811 08:18:06.711843 23585 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:18:06.711132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59258 (local address 127.20.158.189:34751)
0811 08:18:06.711165 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:06.711167 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:06.711370 (+ 203us) server_negotiation.cc:407] Connection header received
0811 08:18:06.711461 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:06.711462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:06.711472 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:06.711501 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:06.711803 (+ 302us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59258: BlockingRecv error: recv got EOF from 127.0.0.1:59258 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260811 08:18:06.721824 23585 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:18:06.721036 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59274 (local address 127.20.158.189:34751)
0811 08:18:06.721066 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:06.721068 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:06.721309 (+ 241us) server_negotiation.cc:407] Connection header received
0811 08:18:06.721395 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:06.721396 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:06.721405 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:06.721431 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:06.721767 (+ 336us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59274: BlockingRecv error: recv got EOF from 127.0.0.1:59274 (error 108)
Metrics: {"server-negotiator.queue_time_us":15}
W20260811 08:18:06.740116 23585 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:18:06.739227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59288 (local address 127.20.158.189:34751)
0811 08:18:06.739267 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:06.739269 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:06.739529 (+ 260us) server_negotiation.cc:407] Connection header received
0811 08:18:06.739633 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:06.739634 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:06.739646 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:06.739677 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:06.740049 (+ 372us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59288: BlockingRecv error: recv got EOF from 127.0.0.1:59288 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260811 08:18:06.774720 23585 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:18:06.773736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59300 (local address 127.20.158.189:34751)
0811 08:18:06.773780 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:06.773782 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:06.774094 (+ 312us) server_negotiation.cc:407] Connection header received
0811 08:18:06.774210 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:06.774211 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:06.774223 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:06.774255 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:06.774659 (+ 404us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59300: BlockingRecv error: recv got EOF from 127.0.0.1:59300 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 08:18:06.841219 23585 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:18:06.840366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59310 (local address 127.20.158.189:34751)
0811 08:18:06.840440 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:06.840443 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:06.840568 (+ 125us) server_negotiation.cc:407] Connection header received
0811 08:18:06.840678 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:06.840683 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:06.840695 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:06.840766 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:06.841144 (+ 378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59310: BlockingRecv error: recv got EOF from 127.0.0.1:59310 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
W20260811 08:18:06.971519 23585 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:18:06.970619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59312 (local address 127.20.158.189:34751)
0811 08:18:06.970735 (+ 116us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:06.970738 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:06.970887 (+ 149us) server_negotiation.cc:407] Connection header received
0811 08:18:06.970991 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:06.970992 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:06.971005 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:06.971084 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:06.971467 (+ 383us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59312: BlockingRecv error: recv got EOF from 127.0.0.1:59312 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260811 08:18:07.229771 23585 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:18:07.228968 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59316 (local address 127.20.158.189:34751)
0811 08:18:07.229049 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:07.229051 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:07.229064 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:18:07.229170 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:07.229171 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:07.229185 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:07.229282 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:07.229702 (+ 420us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59316: BlockingRecv error: recv got EOF from 127.0.0.1:59316 (error 108)
Metrics: {"server-negotiator.queue_time_us":51}
I20260811 08:18:07.614168 23720 catalog_manager.cc:1259] Loaded cluster ID: 68679e17f4d64bb9a2605c4d3e681de1
I20260811 08:18:07.614259 23720 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d932157761c64fa0aa6b595018c660fa: loading cluster ID for follower catalog manager: success
I20260811 08:18:07.615137 23720 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d932157761c64fa0aa6b595018c660fa: acquiring CA information for follower catalog manager: success
I20260811 08:18:07.615471 23720 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d932157761c64fa0aa6b595018c660fa: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 08:18:07.666447 23794 catalog_manager.cc:1259] Loaded cluster ID: 68679e17f4d64bb9a2605c4d3e681de1
I20260811 08:18:07.666538 23794 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a5a88e4dde2c43098e8c32f1001186c0: loading cluster ID for follower catalog manager: success
I20260811 08:18:07.667557 23794 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a5a88e4dde2c43098e8c32f1001186c0: acquiring CA information for follower catalog manager: success
I20260811 08:18:07.667943 23794 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a5a88e4dde2c43098e8c32f1001186c0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 08:18:07.746109 23914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:07.743112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59318 (local address 127.20.158.189:34751)
0811 08:18:07.743258 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:07.743260 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:07.743273 (+ 13us) server_negotiation.cc:407] Connection header received
0811 08:18:07.743346 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:07.743347 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:07.743415 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:07.743514 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:18:07.743696 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:07.744255 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:07.745142 (+ 887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:07.745369 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:07.745458 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:07.745710 (+ 252us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:18:07.745838 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:18:07.745941 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:07.745968 (+ 27us) server_negotiation.cc:299] Negotiation successful
0811 08:18:07.745993 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117,"thread_start_us":63,"threads_started":1}
I20260811 08:18:07.750644 23925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:07.748250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36352 (local address 127.20.158.188:37613)
0811 08:18:07.748356 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:07.748358 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:07.748390 (+ 32us) server_negotiation.cc:407] Connection header received
0811 08:18:07.748426 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:07.748426 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:07.748459 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:07.748538 (+ 79us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:18:07.748652 (+ 114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:07.749148 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:07.749911 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:07.750152 (+ 241us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:07.750211 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:07.750341 (+ 130us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:18:07.750440 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:18:07.750498 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:07.750558 (+ 60us) server_negotiation.cc:299] Negotiation successful
0811 08:18:07.750575 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89,"thread_start_us":58,"threads_started":1}
I20260811 08:18:07.755602 23925 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:07.752523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36366 (local address 127.20.158.188:37613)
0811 08:18:07.752566 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:07.752568 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:07.752827 (+ 259us) server_negotiation.cc:407] Connection header received
0811 08:18:07.752853 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:07.752854 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:07.752866 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:07.752914 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:18:07.753087 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:07.753850 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:07.754648 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:07.754839 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:07.754920 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:07.755093 (+ 173us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:18:07.755127 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:18:07.755181 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:07.755485 (+ 304us) server_negotiation.cc:299] Negotiation successful
0811 08:18:07.755508 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:18:07.755782 23914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:07.752529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59330 (local address 127.20.158.189:34751)
0811 08:18:07.752592 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:07.752595 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:07.752912 (+ 317us) server_negotiation.cc:407] Connection header received
0811 08:18:07.752969 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:07.752970 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:07.752981 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:07.753031 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:18:07.753194 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:07.753948 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:07.754947 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:07.755236 (+ 289us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:07.755321 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:07.755474 (+ 153us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:18:07.755509 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:18:07.755554 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:07.755660 (+ 106us) server_negotiation.cc:299] Negotiation successful
0811 08:18:07.755685 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260811 08:18:07.755991 23938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:07.752497 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58788 (local address 127.20.158.190:36421)
0811 08:18:07.752642 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:07.752643 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:07.752701 (+ 58us) server_negotiation.cc:407] Connection header received
0811 08:18:07.752770 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:07.752770 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:07.752827 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:07.752918 (+ 91us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:18:07.753098 (+ 180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:07.753787 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:07.754894 (+ 1107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:07.755223 (+ 329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:07.755289 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:07.755511 (+ 222us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:18:07.755592 (+ 81us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:18:07.755665 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:07.755835 (+ 170us) server_negotiation.cc:299] Negotiation successful
0811 08:18:07.755912 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124,"thread_start_us":90,"threads_started":1}
I20260811 08:18:07.757787 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 23348
I20260811 08:18:07.768832 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 23470
I20260811 08:18:07.779557 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 23590
2026-08-11T08:18:07Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (3038 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 11 08:18:07 dist-test-slave-gkw7 krb5kdc[23942](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 11 08:18:07 dist-test-slave-gkw7 krb5kdc[23942](info): set up 2 sockets
Aug 11 08:18:07 dist-test-slave-gkw7 krb5kdc[23942](info): commencing operation
krb5kdc: starting...
W20260811 08:18:09.069698 21114 mini_kdc.cc:121] Time spent starting KDC: real 1.263s user 0.000s sys 0.007s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/krb5kdc/test-user.keytab.
Aug 11 08:18:09 dist-test-slave-gkw7 krb5kdc[23942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436289, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-11T08:18:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-11T08:18:09Z Disabled control of system clock
WARNING: no policy specified for kudu/127.20.158.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
Entry for principal kudu/127.20.158.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab.
I20260811 08:18:09.197178 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:40845
--webserver_interface=127.20.158.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:45437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:40845,127.20.158.189:33791,127.20.158.188:37125
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260811 08:18:09.282136 23964 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 08:18:09.282444 23964 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:18:09.282536 23964 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:18:09.282585 23964 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:18:09.284170 23964 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:18:09.284227 23964 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:18:09.284245 23964 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:18:09.284257 23964 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:18:09.284269 23964 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:18:09.285858 23964 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:45437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:40845,127.20.158.189:33791,127.20.158.188:37125
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.190.keytab
--principal=kudu/127.20.158.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.190:40845
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.20.158.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.23964
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:18:09.286070 23964 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:18:09.286255 23964 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:18:09.291321 23971 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:18:09.291328 23973 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:18:09.291306 23969 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:18:09.291851 23964 server_base.cc:1034] running on GCE node
I20260811 08:18:09.292102 23964 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:18:09.292421 23964 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:18:09.293632 23964 hybrid_clock.cc:648] HybridClock initialized: now 1786436289293616 us; error 45 us; skew 500 ppm
Aug 11 08:18:09 dist-test-slave-gkw7 krb5kdc[23942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436289, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:18:09.296320 23964 init.cc:377] Logged in from keytab as kudu/127.20.158.190@KRBTEST.COM (short username kudu)
I20260811 08:18:09.296824 23964 webserver.cc:460] Webserver started at http://127.20.158.190:35083/ using document root <none> and password file <none>
I20260811 08:18:09.297070 23964 fs_manager.cc:359] Metadata directory not provided
I20260811 08:18:09.297142 23964 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:18:09.297297 23964 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:18:09.298524 23964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-0/data/instance:
uuid: "384ae745f6a64bccbfa00b1d5da5973a"
format_stamp: "Formatted at 2026-08-11 08:18:09 on dist-test-slave-gkw7"
server_key: "fde7d22502217884616d897e6af9ac43"
server_key_iv: "5a07037ab306ca8320fb9b93061984ce"
server_key_version: "encryptionkey@0"
I20260811 08:18:09.298930 23964 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-0/wal/instance:
uuid: "384ae745f6a64bccbfa00b1d5da5973a"
format_stamp: "Formatted at 2026-08-11 08:18:09 on dist-test-slave-gkw7"
server_key: "fde7d22502217884616d897e6af9ac43"
server_key_iv: "5a07037ab306ca8320fb9b93061984ce"
server_key_version: "encryptionkey@0"
I20260811 08:18:09.300420 23964 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260811 08:18:09.301285 23985 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:18:09.301491 23964 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260811 08:18:09.301673 23964 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-0/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-0/wal
uuid: "384ae745f6a64bccbfa00b1d5da5973a"
format_stamp: "Formatted at 2026-08-11 08:18:09 on dist-test-slave-gkw7"
server_key: "fde7d22502217884616d897e6af9ac43"
server_key_iv: "5a07037ab306ca8320fb9b93061984ce"
server_key_version: "encryptionkey@0"
I20260811 08:18:09.301759 23964 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:18:09.313227 23964 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:18:09.315467 23964 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:18:09.315641 23964 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:18:09.320222 23964 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.190:40845
I20260811 08:18:09.320362 24068 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.190:40845 every 8 connection(s)
I20260811 08:18:09.320705 23964 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-0/data/info.pb
I20260811 08:18:09.321780 24069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:18:09.322774 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 23964
I20260811 08:18:09.322863 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-0/wal/instance
I20260811 08:18:09.323081 21114 external_mini_cluster.cc:1428] Setting key d7cdf80f280b52ae4b47a35440d38669
I20260811 08:18:09.323691 24069 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.190" port: 40845 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:18:09 dist-test-slave-gkw7 krb5kdc[23942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436289, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.20.158.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.189@KRBTEST.COM" created.
I20260811 08:18:09.336225 24073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.324639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60520 (local address 127.20.158.190:40845)
0811 08:18:09.324828 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:09.324837 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:09.325913 (+ 1076us) server_negotiation.cc:407] Connection header received
0811 08:18:09.326456 (+ 543us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:09.326459 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:09.326483 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:09.326585 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:09.327363 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.328249 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.329716 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.330041 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.330155 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:09.332615 (+ 2460us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:09.332623 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:09.332623 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:09.332630 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:09.334451 (+ 1821us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.334871 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.334874 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.334874 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.334996 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.335239 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.335240 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.335241 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.335507 (+ 266us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:09.335606 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:09.335818 (+ 212us) server_negotiation.cc:299] Negotiation successful
0811 08:18:09.335944 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":89,"threads_started":1}
I20260811 08:18:09.336232 24072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.324574 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:40845 (local address 127.0.0.1:60520)
0811 08:18:09.325751 (+ 1177us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:09.325799 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0811 08:18:09.326286 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:18:09.326604 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:18:09.326608 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:18:09.326991 (+ 383us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:18:09.327235 (+ 244us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:09.327241 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.328347 (+ 1106us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.328348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:09.329621 (+ 1273us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:09.329625 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.330167 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.330169 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:09.330265 (+ 96us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:09.330806 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:18:09.330817 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:18:09.332517 (+ 1700us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:18:09.334550 (+ 2033us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:09.334557 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:09.334559 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:09.334756 (+ 197us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:09.335071 (+ 315us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:09.335072 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:09.335072 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:09.335168 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:09.335583 (+ 415us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:18:09.335589 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:18:09.335666 (+ 77us) client_negotiation.cc:769] Sending connection context
0811 08:18:09.335785 (+ 119us) client_negotiation.cc:240] Negotiation successful
0811 08:18:09.336025 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1127,"mutex_wait_us":96,"thread_start_us":83,"threads_started":1}
I20260811 08:18:09.337280 24069 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.189" port: 33791 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:18:09.337680 24072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.337571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:33791 (local address 127.0.0.1:43490)
0811 08:18:09.337605 (+ 34us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:09.337651 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.189:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":17}
W20260811 08:18:09.337810 23990 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.158.189:33791: connect: Connection refused (error 111)
I20260811 08:18:09.338266 24072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.338169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:33791 (local address 127.0.0.1:43506)
0811 08:18:09.338219 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:09.338244 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.189:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 08:18:09.338374 24069 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.158.189:33791: Network error: Client connection negotiation failed: client connection to 127.20.158.189:33791: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.189.keytab.
Entry for principal kudu/127.20.158.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.189.keytab.
I20260811 08:18:09.350886 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.189:33791
--webserver_interface=127.20.158.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.189.keytab
--principal=kudu/127.20.158.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:45437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:40845,127.20.158.189:33791,127.20.158.188:37125
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:18:09.387645 24069 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.158.189" port: 33791 } attempt: 1
I20260811 08:18:09.388293 24072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.388132 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:33791 (local address 127.0.0.1:43508)
0811 08:18:09.388212 (+ 80us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:09.388259 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.189:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260811 08:18:09.388756 24072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.388663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:33791 (local address 127.0.0.1:43524)
0811 08:18:09.388710 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:09.388737 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.189:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260811 08:18:09.388902 24069 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.158.189:33791: Network error: Client connection negotiation failed: client connection to 127.20.158.189:33791: connect: Connection refused (error 111)
W20260811 08:18:09.435129 24081 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 08:18:09.435351 24081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:18:09.435370 24081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:18:09.435391 24081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:18:09.436596 24081 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:18:09.436640 24081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:18:09.436654 24081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:18:09.436676 24081 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:18:09.436687 24081 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:18:09.438218 24081 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:45437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:40845,127.20.158.189:33791,127.20.158.188:37125
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.189.keytab
--principal=kudu/127.20.158.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.189:33791
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.20.158.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24081
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:18:09.438422 24081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:18:09.438596 24081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:18:09.443660 24094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:18:09.443658 24088 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:18:09.443843 24081 server_base.cc:1034] running on GCE node
W20260811 08:18:09.443706 24091 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:18:09.444165 24081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:18:09.444496 24081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:18:09.445662 24081 hybrid_clock.cc:648] HybridClock initialized: now 1786436289445650 us; error 29 us; skew 500 ppm
Aug 11 08:18:09 dist-test-slave-gkw7 krb5kdc[23942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436289, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:18:09.448218 24081 init.cc:377] Logged in from keytab as kudu/127.20.158.189@KRBTEST.COM (short username kudu)
I20260811 08:18:09.448654 24081 webserver.cc:460] Webserver started at http://127.20.158.189:41397/ using document root <none> and password file <none>
I20260811 08:18:09.448907 24081 fs_manager.cc:359] Metadata directory not provided
I20260811 08:18:09.448978 24081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:18:09.449138 24081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:18:09.450263 24081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-1/data/instance:
uuid: "07f337760bdb444c898439b371d05ad6"
format_stamp: "Formatted at 2026-08-11 08:18:09 on dist-test-slave-gkw7"
server_key: "b5b690af87dfcbc93f53a2a62d24d058"
server_key_iv: "51dd4d5f2c2b13558db7186c3d542d95"
server_key_version: "encryptionkey@0"
I20260811 08:18:09.450627 24081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-1/wal/instance:
uuid: "07f337760bdb444c898439b371d05ad6"
format_stamp: "Formatted at 2026-08-11 08:18:09 on dist-test-slave-gkw7"
server_key: "b5b690af87dfcbc93f53a2a62d24d058"
server_key_iv: "51dd4d5f2c2b13558db7186c3d542d95"
server_key_version: "encryptionkey@0"
I20260811 08:18:09.451946 24081 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260811 08:18:09.452677 24104 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:18:09.452850 24081 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260811 08:18:09.452961 24081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-1/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-1/wal
uuid: "07f337760bdb444c898439b371d05ad6"
format_stamp: "Formatted at 2026-08-11 08:18:09 on dist-test-slave-gkw7"
server_key: "b5b690af87dfcbc93f53a2a62d24d058"
server_key_iv: "51dd4d5f2c2b13558db7186c3d542d95"
server_key_version: "encryptionkey@0"
I20260811 08:18:09.453037 24081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:18:09.457073 24069 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.158.189" port: 33791 } attempt: 2
I20260811 08:18:09.457551 24072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.457405 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:33791 (local address 127.0.0.1:43536)
0811 08:18:09.457466 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:09.457503 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.189:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260811 08:18:09.457890 24072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.457806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:33791 (local address 127.0.0.1:43550)
0811 08:18:09.457848 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:09.457872 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.189:33791: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260811 08:18:09.458035 24069 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.158.189:33791: Network error: Client connection negotiation failed: client connection to 127.20.158.189:33791: connect: Connection refused (error 111)
I20260811 08:18:09.464968 24081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:18:09.466971 24081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:18:09.467131 24081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:18:09.471227 24081 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.189:33791
I20260811 08:18:09.471259 24180 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.189:33791 every 8 connection(s)
I20260811 08:18:09.471603 24081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-1/data/info.pb
I20260811 08:18:09.472500 24182 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:18:09.474136 24182 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.190" port: 40845 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:18:09.476456 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 24081
I20260811 08:18:09.476547 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-1/wal/instance
I20260811 08:18:09.476743 21114 external_mini_cluster.cc:1428] Setting key 9f9cba85adf5e1e31579888c070efa72
Aug 11 08:18:09 dist-test-slave-gkw7 krb5kdc[23942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436289, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.189@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:18:09.484159 24073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.474806 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60524 (local address 127.20.158.190:40845)
0811 08:18:09.474879 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:09.474882 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:09.475167 (+ 285us) server_negotiation.cc:407] Connection header received
0811 08:18:09.475573 (+ 406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:09.475574 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:09.475586 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:09.475649 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:09.476286 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.476902 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.478403 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.478655 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.478741 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:09.480904 (+ 2163us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:09.480906 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:09.480906 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:09.480916 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:09.482753 (+ 1837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.483156 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.483158 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.483159 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.483229 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.483473 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.483474 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.483474 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.483619 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:09.483695 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:09.483950 (+ 255us) server_negotiation.cc:299] Negotiation successful
0811 08:18:09.484040 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260811 08:18:09.484180 24188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.474790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:40845 (local address 127.0.0.1:60524)
0811 08:18:09.474987 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:09.475024 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0811 08:18:09.475477 (+ 453us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:18:09.475738 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:18:09.475741 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:18:09.475985 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:18:09.476182 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:09.476186 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.477006 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.477007 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:09.478310 (+ 1303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:09.478314 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.478765 (+ 451us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.478766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:09.478896 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:09.479437 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:18:09.479446 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:18:09.480803 (+ 1357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:18:09.482850 (+ 2047us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:09.482858 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:09.482860 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:09.483075 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:09.483304 (+ 229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:09.483304 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:09.483304 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:09.483402 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:09.483696 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:18:09.483701 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:18:09.483816 (+ 115us) client_negotiation.cc:769] Sending connection context
0811 08:18:09.483899 (+ 83us) client_negotiation.cc:240] Negotiation successful
0811 08:18:09.484013 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":107,"threads_started":1}
I20260811 08:18:09.484874 24182 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.189" port: 33791 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.20.158.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.20.158.188@KRBTEST.COM" created.
Aug 11 08:18:09 dist-test-slave-gkw7 krb5kdc[23942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436289, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.189@KRBTEST.COM for kudu/127.20.158.189@KRBTEST.COM
I20260811 08:18:09.493306 24188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.485142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:33791 (local address 127.0.0.1:43560)
0811 08:18:09.485200 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:09.485212 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:18:09.485262 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:18:09.485519 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:18:09.485520 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:18:09.485717 (+ 197us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:18:09.485782 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:09.485785 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.486604 (+ 819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.486605 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:09.487075 (+ 470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:09.487077 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.487781 (+ 704us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.487782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:09.487841 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:09.488219 (+ 378us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:18:09.488224 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:18:09.490327 (+ 2103us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:18:09.492220 (+ 1893us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:09.492221 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:09.492222 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:09.492444 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:09.492677 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:09.492678 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:09.492678 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:09.492739 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:09.493068 (+ 329us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:18:09.493069 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:18:09.493104 (+ 35us) client_negotiation.cc:769] Sending connection context
0811 08:18:09.493154 (+ 50us) client_negotiation.cc:240] Negotiation successful
0811 08:18:09.493241 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260811 08:18:09.493479 24193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.485211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43560 (local address 127.20.158.189:33791)
0811 08:18:09.485366 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:09.485371 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:09.485392 (+ 21us) server_negotiation.cc:407] Connection header received
0811 08:18:09.485416 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:09.485418 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:09.485429 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:09.485492 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:09.485863 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.486522 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.487203 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.487708 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.487767 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:09.490416 (+ 2649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:09.490424 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:09.490424 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:09.490431 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:09.492131 (+ 1700us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.492534 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.492538 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.492538 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.492608 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.492803 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.492804 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.492805 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.493001 (+ 196us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:09.493099 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:09.493202 (+ 103us) server_negotiation.cc:299] Negotiation successful
0811 08:18:09.493316 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":18,"server-negotiator.queue_time_us":125,"thread_start_us":99,"threads_started":1}
I20260811 08:18:09.494297 24182 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37125 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:18:09.494653 24188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.494533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:37125 (local address 127.0.0.1:35138)
0811 08:18:09.494582 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:09.494630 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 08:18:09.494789 24107 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37125: connect: Connection refused (error 111)
I20260811 08:18:09.495204 24188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.495107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:37125 (local address 127.0.0.1:35150)
0811 08:18:09.495155 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:09.495186 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260811 08:18:09.495318 24182 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.158.188:37125: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37125: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.20.158.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.188.keytab.
Entry for principal kudu/127.20.158.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.188.keytab.
I20260811 08:18:09.508194 21114 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgBR4MD/build/release/bin/kudu
/tmp/dist-test-taskgBR4MD/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.188:37125
--webserver_interface=127.20.158.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.188.keytab
--principal=kudu/127.20.158.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.20.158.148:45437
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.20.158.190:40845,127.20.158.189:33791,127.20.158.188:37125
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260811 08:18:09.544548 24182 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37125 } attempt: 1
I20260811 08:18:09.545080 24188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.544927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:37125 (local address 127.0.0.1:35154)
0811 08:18:09.544998 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:09.545049 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 08:18:09.545518 24188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.545356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:37125 (local address 127.0.0.1:35170)
0811 08:18:09.545428 (+ 72us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:09.545480 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260811 08:18:09.545662 24182 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.158.188:37125: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37125: connect: Connection refused (error 111)
I20260811 08:18:09.549224 24069 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.158.189" port: 33791 } attempt: 3
Aug 11 08:18:09 dist-test-slave-gkw7 krb5kdc[23942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436289, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for kudu/127.20.158.189@KRBTEST.COM
I20260811 08:18:09.557122 24193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.549619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43566 (local address 127.20.158.189:33791)
0811 08:18:09.549675 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:09.549677 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:09.549689 (+ 12us) server_negotiation.cc:407] Connection header received
0811 08:18:09.549771 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:09.549772 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:09.549783 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:09.549834 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:09.550280 (+ 446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.550795 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.551838 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.552102 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.552161 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:09.554308 (+ 2147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:09.554310 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:09.554310 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:09.554318 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:09.555929 (+ 1611us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.556289 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.556290 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.556291 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.556352 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.556586 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.556587 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.556588 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.556713 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:09.556793 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:09.556946 (+ 153us) server_negotiation.cc:299] Negotiation successful
0811 08:18:09.557028 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:18:09.557125 24072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.549516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:33791 (local address 127.0.0.1:43566)
0811 08:18:09.549626 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:09.549639 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0811 08:18:09.549705 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:18:09.549862 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:18:09.549863 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:18:09.550056 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:18:09.550136 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:09.550138 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.550890 (+ 752us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.550892 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:09.551750 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:09.551753 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.552180 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.552181 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:09.552265 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:09.552798 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:18:09.552804 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:18:09.554216 (+ 1412us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:18:09.556022 (+ 1806us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:09.556024 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:09.556024 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:09.556213 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:09.556429 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:09.556430 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:09.556431 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:09.556515 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:09.556781 (+ 266us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:18:09.556783 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:18:09.556851 (+ 68us) client_negotiation.cc:769] Sending connection context
0811 08:18:09.556923 (+ 72us) client_negotiation.cc:240] Negotiation successful
0811 08:18:09.557026 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":85}
I20260811 08:18:09.557752 24069 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37125 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:18:09.558142 24072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.558021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:37125 (local address 127.0.0.1:35176)
0811 08:18:09.558082 (+ 61us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:09.558116 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260811 08:18:09.558494 24072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.558397 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:37125 (local address 127.0.0.1:35184)
0811 08:18:09.558446 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:09.558473 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260811 08:18:09.558607 24069 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.158.188:37125: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37125: connect: Connection refused (error 111)
I20260811 08:18:09.589756 24069 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37125 } attempt: 1
I20260811 08:18:09.590314 24072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.590133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:37125 (local address 127.0.0.1:35192)
0811 08:18:09.590228 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:09.590283 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260811 08:18:09.590726 24072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.590625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:37125 (local address 127.0.0.1:35200)
0811 08:18:09.590678 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:09.590705 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260811 08:18:09.590852 24069 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.158.188:37125: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37125: connect: Connection refused (error 111)
W20260811 08:18:09.593724 24202 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260811 08:18:09.593926 24202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260811 08:18:09.593945 24202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260811 08:18:09.593966 24202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260811 08:18:09.595182 24202 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260811 08:18:09.595223 24202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260811 08:18:09.595237 24202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260811 08:18:09.595250 24202 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260811 08:18:09.595261 24202 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260811 08:18:09.596705 24202 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.20.158.148:45437
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.20.158.190:40845,127.20.158.189:33791,127.20.158.188:37125
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/krb5kdc/kudu_127.20.158.188.keytab
--principal=kudu/127.20.158.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.20.158.188:37125
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.20.158.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.24202
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 11 Aug 2026 06:51:45 UTC on ccycloud.quasar-cbatde.root.comops.site
build id 4579817
I20260811 08:18:09.596925 24202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260811 08:18:09.597100 24202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260811 08:18:09.602082 24209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:18:09.602144 24208 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260811 08:18:09.602108 24212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260811 08:18:09.602401 24202 server_base.cc:1034] running on GCE node
I20260811 08:18:09.602664 24202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260811 08:18:09.602962 24202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260811 08:18:09.604161 24202 hybrid_clock.cc:648] HybridClock initialized: now 1786436289604143 us; error 26 us; skew 500 ppm
Aug 11 08:18:09 dist-test-slave-gkw7 krb5kdc[23942](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436289, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260811 08:18:09.606956 24202 init.cc:377] Logged in from keytab as kudu/127.20.158.188@KRBTEST.COM (short username kudu)
I20260811 08:18:09.607424 24202 webserver.cc:460] Webserver started at http://127.20.158.188:34353/ using document root <none> and password file <none>
I20260811 08:18:09.607672 24202 fs_manager.cc:359] Metadata directory not provided
I20260811 08:18:09.607722 24202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260811 08:18:09.607898 24202 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260811 08:18:09.608994 24202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-2/data/instance:
uuid: "d19afc8dd5774dc799ce6d7a561629da"
format_stamp: "Formatted at 2026-08-11 08:18:09 on dist-test-slave-gkw7"
server_key: "c21de6f2a02815723ff82aaf4ef32100"
server_key_iv: "49a87065cf0dd3b025fb181903a20e0c"
server_key_version: "encryptionkey@0"
I20260811 08:18:09.609373 24202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-2/wal/instance:
uuid: "d19afc8dd5774dc799ce6d7a561629da"
format_stamp: "Formatted at 2026-08-11 08:18:09 on dist-test-slave-gkw7"
server_key: "c21de6f2a02815723ff82aaf4ef32100"
server_key_iv: "49a87065cf0dd3b025fb181903a20e0c"
server_key_version: "encryptionkey@0"
I20260811 08:18:09.610796 24202 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260811 08:18:09.611649 24221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260811 08:18:09.611868 24202 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260811 08:18:09.611981 24202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-2/data,/tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-2/wal
uuid: "d19afc8dd5774dc799ce6d7a561629da"
format_stamp: "Formatted at 2026-08-11 08:18:09 on dist-test-slave-gkw7"
server_key: "c21de6f2a02815723ff82aaf4ef32100"
server_key_iv: "49a87065cf0dd3b025fb181903a20e0c"
server_key_version: "encryptionkey@0"
I20260811 08:18:09.612044 24202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260811 08:18:09.613824 24182 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37125 } attempt: 2
I20260811 08:18:09.614257 24188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.614091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:37125 (local address 127.0.0.1:35204)
0811 08:18:09.614168 (+ 77us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:09.614216 (+ 48us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260811 08:18:09.614688 24188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.614550 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:37125 (local address 127.0.0.1:35210)
0811 08:18:09.614617 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:09.614655 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260811 08:18:09.614797 24182 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.20.158.188:37125: Network error: Client connection negotiation failed: client connection to 127.20.158.188:37125: connect: Connection refused (error 111)
I20260811 08:18:09.638939 24202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260811 08:18:09.641584 24202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260811 08:18:09.641774 24202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260811 08:18:09.646088 24202 rpc_server.cc:307] RPC server started. Bound to: 127.20.158.188:37125
I20260811 08:18:09.646201 24320 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.20.158.188:37125 every 8 connection(s)
I20260811 08:18:09.646545 24202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-2/data/info.pb
I20260811 08:18:09.647481 24322 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260811 08:18:09.649091 24322 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.190" port: 40845 } has no permanent_uuid. Determining permanent_uuid...
I20260811 08:18:09.654250 21114 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgBR4MD/build/release/bin/kudu as pid 24202
I20260811 08:18:09.654395 21114 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgBR4MD/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786436003833085-21114-0/minicluster-data/master-2/wal/instance
I20260811 08:18:09.654611 21114 external_mini_cluster.cc:1428] Setting key e837ccd88a023f5815d2008564d90b2a
Aug 11 08:18:09 dist-test-slave-gkw7 krb5kdc[23942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436289, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.188@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:18:09.658794 24073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.649822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60528 (local address 127.20.158.190:40845)
0811 08:18:09.649902 (+ 80us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:09.649904 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:09.650087 (+ 183us) server_negotiation.cc:407] Connection header received
0811 08:18:09.650543 (+ 456us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:09.650544 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:09.650555 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:09.650617 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:09.651249 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.651733 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.652668 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.652850 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.652903 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:09.655445 (+ 2542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:09.655447 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:09.655448 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:09.655456 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:09.657119 (+ 1663us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.657555 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.657557 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.657557 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.657620 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.658070 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.658072 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.658072 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.658212 (+ 140us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:09.658313 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:09.658613 (+ 300us) server_negotiation.cc:299] Negotiation successful
0811 08:18:09.658702 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260811 08:18:09.659011 24326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.649778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.190:40845 (local address 127.0.0.1:60528)
0811 08:18:09.649947 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:09.649993 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0811 08:18:09.650451 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:18:09.650707 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:18:09.650711 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:18:09.650965 (+ 254us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:18:09.651171 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:09.651174 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.651813 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.651814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:09.652584 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:09.652586 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.652926 (+ 340us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.652927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:09.653028 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:09.653629 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:18:09.653647 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:18:09.655347 (+ 1700us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:18:09.657204 (+ 1857us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:09.657211 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:09.657214 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:09.657447 (+ 233us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:09.657708 (+ 261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:09.657709 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:09.657709 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:09.657829 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:09.658308 (+ 479us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:18:09.658317 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:18:09.658462 (+ 145us) client_negotiation.cc:769] Sending connection context
0811 08:18:09.658574 (+ 112us) client_negotiation.cc:240] Negotiation successful
0811 08:18:09.658736 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":89,"threads_started":1}
I20260811 08:18:09.659574 24322 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.189" port: 33791 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:18:09 dist-test-slave-gkw7 krb5kdc[23942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436289, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.188@KRBTEST.COM
Aug 11 08:18:09 dist-test-slave-gkw7 krb5kdc[23942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436289, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.188@KRBTEST.COM for kudu/127.20.158.189@KRBTEST.COM
I20260811 08:18:09.665369 24329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.655024 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35212 (local address 127.20.158.188:37125)
0811 08:18:09.655233 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:09.655239 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:09.655261 (+ 22us) server_negotiation.cc:407] Connection header received
0811 08:18:09.655316 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:09.655319 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:09.655340 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:09.655428 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:09.656213 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.657176 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.658350 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.658727 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.658841 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:09.662183 (+ 3342us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:09.662192 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:09.662192 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:09.662199 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:09.664027 (+ 1828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.664398 (+ 371us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.664401 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.664402 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.664465 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.664728 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.664729 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.664729 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.664888 (+ 159us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:09.665060 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:09.665157 (+ 97us) server_negotiation.cc:299] Negotiation successful
0811 08:18:09.665243 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":86,"threads_started":1}
I20260811 08:18:09.666052 24069 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37125 } attempt: 2
I20260811 08:18:09.668427 24193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.659915 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43568 (local address 127.20.158.189:33791)
0811 08:18:09.659973 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:09.659976 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:09.659987 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:18:09.660019 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:09.660020 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:09.660034 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:09.660135 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:09.660376 (+ 241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.661215 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.662263 (+ 1048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.662563 (+ 300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.662654 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:09.664729 (+ 2075us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:09.664730 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:09.664731 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:09.664740 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:09.666592 (+ 1852us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.666980 (+ 388us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.666982 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.666982 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.667072 (+ 90us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.667313 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.667315 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.667315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.667470 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:09.667554 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:09.668263 (+ 709us) server_negotiation.cc:299] Negotiation successful
0811 08:18:09.668339 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260811 08:18:09.668427 24326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.659830 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.189:33791 (local address 127.0.0.1:43568)
0811 08:18:09.659880 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:09.659890 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0811 08:18:09.659926 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:18:09.660133 (+ 207us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:18:09.660133 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:18:09.660244 (+ 111us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:18:09.660289 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:09.660290 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.661346 (+ 1056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.661347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:09.662132 (+ 785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:09.662136 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.662672 (+ 536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.662673 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:09.662764 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:09.663261 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:18:09.663267 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:18:09.664637 (+ 1370us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:18:09.666671 (+ 2034us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:09.666672 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:09.666672 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:09.666877 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:09.667161 (+ 284us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:09.667162 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:09.667162 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:09.667230 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:09.668113 (+ 883us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:18:09.668114 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:18:09.668150 (+ 36us) client_negotiation.cc:769] Sending connection context
0811 08:18:09.668231 (+ 81us) client_negotiation.cc:240] Negotiation successful
0811 08:18:09.668333 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260811 08:18:09.668828 24322 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37125 } has no permanent_uuid. Determining permanent_uuid...
Aug 11 08:18:09 dist-test-slave-gkw7 krb5kdc[23942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436289, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.190@KRBTEST.COM for kudu/127.20.158.188@KRBTEST.COM
Aug 11 08:18:09 dist-test-slave-gkw7 krb5kdc[23942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436289, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.190@KRBTEST.COM
I20260811 08:18:09.674758 24329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.666455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35228 (local address 127.20.158.188:37125)
0811 08:18:09.666496 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:09.666499 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:09.666507 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:18:09.666526 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:09.666527 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:09.666538 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:09.666936 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:09.666965 (+ 29us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.667573 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.668441 (+ 868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.669215 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.669326 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:09.671779 (+ 2453us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:09.671780 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:09.671780 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:09.671787 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:09.673454 (+ 1667us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.673858 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.673860 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.673860 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.673925 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.674144 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.674144 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.674145 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.674280 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:09.674349 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:09.674571 (+ 222us) server_negotiation.cc:299] Negotiation successful
0811 08:18:09.674654 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:18:09.674787 24072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.666348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:37125 (local address 127.0.0.1:35228)
0811 08:18:09.666396 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:09.666408 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0811 08:18:09.666458 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:18:09.666639 (+ 181us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:18:09.666640 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:18:09.666811 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:18:09.666861 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:09.666864 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.667642 (+ 778us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.667650 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:09.668321 (+ 671us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:09.668325 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.669334 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.669335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:09.669407 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:09.669871 (+ 464us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:18:09.669874 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:18:09.671657 (+ 1783us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:18:09.673554 (+ 1897us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:09.673556 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:09.673556 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:09.673764 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:09.674006 (+ 242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:09.674007 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:09.674007 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:09.674069 (+ 62us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:09.674371 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:18:09.674372 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:18:09.674430 (+ 58us) client_negotiation.cc:769] Sending connection context
0811 08:18:09.674535 (+ 105us) client_negotiation.cc:240] Negotiation successful
0811 08:18:09.674667 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
Aug 11 08:18:09 dist-test-slave-gkw7 krb5kdc[23942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436289, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.188@KRBTEST.COM for kudu/127.20.158.188@KRBTEST.COM
I20260811 08:18:09.676692 24073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.666325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60542 (local address 127.20.158.190:40845)
0811 08:18:09.666371 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:09.666373 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:09.666623 (+ 250us) server_negotiation.cc:407] Connection header received
0811 08:18:09.666707 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:09.666708 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:09.666720 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:09.666788 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:09.667554 (+ 766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.668037 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.669255 (+ 1218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.669509 (+ 254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.669630 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:09.672630 (+ 3000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:09.672631 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:09.672631 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:09.672638 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:09.674484 (+ 1846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.675297 (+ 813us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.675298 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.675299 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.675353 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.675894 (+ 541us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.675895 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.675896 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.676084 (+ 188us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:09.676274 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:09.676502 (+ 228us) server_negotiation.cc:299] Negotiation successful
0811 08:18:09.676587 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:18:09.677619 24069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a: Bootstrap starting.
I20260811 08:18:09.678318 24326 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.669103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:37125 (local address 127.0.0.1:35234)
0811 08:18:09.669257 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:09.669275 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0811 08:18:09.669312 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:18:09.670207 (+ 895us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:18:09.670208 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:18:09.670562 (+ 354us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:18:09.670591 (+ 29us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:09.670593 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.671365 (+ 772us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.671366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:09.671933 (+ 567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:09.671936 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.673123 (+ 1187us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.673124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:09.673183 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:09.673637 (+ 454us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:18:09.673643 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:18:09.675173 (+ 1530us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:18:09.677232 (+ 2059us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:09.677233 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:09.677233 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:09.677403 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:09.677627 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:09.677627 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:09.677628 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:09.677679 (+ 51us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:09.677976 (+ 297us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:18:09.677977 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:18:09.678016 (+ 39us) client_negotiation.cc:769] Sending connection context
0811 08:18:09.678101 (+ 85us) client_negotiation.cc:240] Negotiation successful
0811 08:18:09.678206 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141}
I20260811 08:18:09.678483 24330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.669130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35234 (local address 127.20.158.188:37125)
0811 08:18:09.669415 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:09.669417 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:09.669426 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:18:09.669448 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:09.669449 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:09.669461 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:09.670178 (+ 717us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:09.670693 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.671196 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.672321 (+ 1125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.672983 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.673066 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:09.675296 (+ 2230us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:09.675298 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:09.675298 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:09.675306 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:09.677141 (+ 1835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.677474 (+ 333us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.677475 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.677475 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.677564 (+ 89us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.677753 (+ 189us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.677754 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.677761 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.677897 (+ 136us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:09.677972 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:09.678124 (+ 152us) server_negotiation.cc:299] Negotiation successful
0811 08:18:09.678258 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":66,"server-negotiator.queue_time_us":263,"thread_start_us":101,"threads_started":1}
I20260811 08:18:09.678488 24069 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a: Neither blocks nor log segments found. Creating new log.
I20260811 08:18:09.678907 24069 log.cc:824] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a: Log is configured to *not* fsync() on all Append() calls
I20260811 08:18:09.680006 24069 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a: No bootstrap required, opened a new log
I20260811 08:18:09.680137 24322 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d19afc8dd5774dc799ce6d7a561629da: Bootstrap starting.
I20260811 08:18:09.681005 24322 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d19afc8dd5774dc799ce6d7a561629da: Neither blocks nor log segments found. Creating new log.
I20260811 08:18:09.681416 24322 log.cc:824] T 00000000000000000000000000000000 P d19afc8dd5774dc799ce6d7a561629da: Log is configured to *not* fsync() on all Append() calls
I20260811 08:18:09.682579 24322 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d19afc8dd5774dc799ce6d7a561629da: No bootstrap required, opened a new log
I20260811 08:18:09.682839 24069 raft_consensus.cc:348] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "384ae745f6a64bccbfa00b1d5da5973a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 40845 } } peers { permanent_uuid: "07f337760bdb444c898439b371d05ad6" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 33791 } } peers { permanent_uuid: "d19afc8dd5774dc799ce6d7a561629da" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37125 } }
I20260811 08:18:09.683024 24069 raft_consensus.cc:729] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 384ae745f6a64bccbfa00b1d5da5973a, State: Initialized, Role: FOLLOWER
I20260811 08:18:09.683243 24069 consensus_queue.cc:260] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "384ae745f6a64bccbfa00b1d5da5973a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 40845 } } peers { permanent_uuid: "07f337760bdb444c898439b371d05ad6" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 33791 } } peers { permanent_uuid: "d19afc8dd5774dc799ce6d7a561629da" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37125 } }
I20260811 08:18:09.683610 24333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "384ae745f6a64bccbfa00b1d5da5973a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 40845 } } peers { permanent_uuid: "07f337760bdb444c898439b371d05ad6" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 33791 } } peers { permanent_uuid: "d19afc8dd5774dc799ce6d7a561629da" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37125 } } }
I20260811 08:18:09.683696 24069 sys_catalog.cc:564] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:18:09.683727 24333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:18:09.685220 24322 raft_consensus.cc:348] T 00000000000000000000000000000000 P d19afc8dd5774dc799ce6d7a561629da [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "384ae745f6a64bccbfa00b1d5da5973a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 40845 } } peers { permanent_uuid: "07f337760bdb444c898439b371d05ad6" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 33791 } } peers { permanent_uuid: "d19afc8dd5774dc799ce6d7a561629da" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37125 } }
I20260811 08:18:09.685391 24322 raft_consensus.cc:729] T 00000000000000000000000000000000 P d19afc8dd5774dc799ce6d7a561629da [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d19afc8dd5774dc799ce6d7a561629da, State: Initialized, Role: FOLLOWER
I20260811 08:18:09.685493 24322 consensus_queue.cc:260] T 00000000000000000000000000000000 P d19afc8dd5774dc799ce6d7a561629da [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "384ae745f6a64bccbfa00b1d5da5973a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 40845 } } peers { permanent_uuid: "07f337760bdb444c898439b371d05ad6" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 33791 } } peers { permanent_uuid: "d19afc8dd5774dc799ce6d7a561629da" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37125 } }
I20260811 08:18:09.685869 24322 sys_catalog.cc:564] T 00000000000000000000000000000000 P d19afc8dd5774dc799ce6d7a561629da [sys.catalog]: configured and running, proceeding with master startup.
W20260811 08:18:09.685921 24345 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:18:09.685977 24345 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:18:09.687604 24348 sys_catalog.cc:455] T 00000000000000000000000000000000 P d19afc8dd5774dc799ce6d7a561629da [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "384ae745f6a64bccbfa00b1d5da5973a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 40845 } } peers { permanent_uuid: "07f337760bdb444c898439b371d05ad6" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 33791 } } peers { permanent_uuid: "d19afc8dd5774dc799ce6d7a561629da" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37125 } } }
I20260811 08:18:09.687702 24348 sys_catalog.cc:458] T 00000000000000000000000000000000 P d19afc8dd5774dc799ce6d7a561629da [sys.catalog]: This master's current role is: FOLLOWER
W20260811 08:18:09.687989 24367 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d19afc8dd5774dc799ce6d7a561629da: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:18:09.688046 24367 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:18:09.688134 23964 master_runner.cc:186] Error getting master registration for 127.20.158.189:33791: OK, instance_id { permanent_uuid: "07f337760bdb444c898439b371d05ad6" instance_seqno: 1786436289470046 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 08:18:09.691102 23964 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260811 08:18:09.689399 24202 master_runner.cc:186] Error getting master registration for 127.20.158.189:33791: OK, instance_id { permanent_uuid: "07f337760bdb444c898439b371d05ad6" instance_seqno: 1786436289470046 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260811 08:18:09.691854 24202 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
Aug 11 08:18:09 dist-test-slave-gkw7 krb5kdc[23942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436289, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.20.158.189@KRBTEST.COM
I20260811 08:18:09.698257 24193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.679992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43570 (local address 127.20.158.189:33791)
0811 08:18:09.680034 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:09.680036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:09.681969 (+ 1933us) server_negotiation.cc:407] Connection header received
0811 08:18:09.682015 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:09.682017 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:09.682032 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:09.682115 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:09.686306 (+ 4191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.686969 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.687999 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.688296 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.688363 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:09.694897 (+ 6534us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:09.694900 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:09.694900 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:09.694910 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:09.696783 (+ 1873us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.697242 (+ 459us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.697243 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.697244 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.697314 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.697619 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.697621 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.697621 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.697786 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:09.697966 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:09.698055 (+ 89us) server_negotiation.cc:299] Negotiation successful
0811 08:18:09.698157 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260811 08:18:09.699918 21114 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260811 08:18:09.701141 24034 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "384ae745f6a64bccbfa00b1d5da5973a"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:60542
I20260811 08:18:09.701313 24034 raft_consensus.cc:482] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260811 08:18:09.701370 24034 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:18:09.702409 24034 raft_consensus.cc:504] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "384ae745f6a64bccbfa00b1d5da5973a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 40845 } } peers { permanent_uuid: "07f337760bdb444c898439b371d05ad6" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 33791 } } peers { permanent_uuid: "d19afc8dd5774dc799ce6d7a561629da" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37125 } }
I20260811 08:18:09.702682 24034 leader_election.cc:288] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a [CANDIDATE]: Term 1 election: Requested vote from peers 07f337760bdb444c898439b371d05ad6 (127.20.158.189:33791), d19afc8dd5774dc799ce6d7a561629da (127.20.158.188:37125)
I20260811 08:18:09.703053 24268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "384ae745f6a64bccbfa00b1d5da5973a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "d19afc8dd5774dc799ce6d7a561629da"
I20260811 08:18:09.703222 24268 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d19afc8dd5774dc799ce6d7a561629da [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:18:09.704195 24268 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d19afc8dd5774dc799ce6d7a561629da [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 384ae745f6a64bccbfa00b1d5da5973a in term 1.
I20260811 08:18:09.704399 23990 leader_election.cc:302] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 384ae745f6a64bccbfa00b1d5da5973a, d19afc8dd5774dc799ce6d7a561629da; no voters:
I20260811 08:18:09.704563 24333 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a [term 1 FOLLOWER]: Leader election won for term 1
I20260811 08:18:09.704797 24333 raft_consensus.cc:686] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a [term 1 LEADER]: Becoming Leader. State: Replica: 384ae745f6a64bccbfa00b1d5da5973a, State: Running, Role: LEADER
I20260811 08:18:09.704916 24333 consensus_queue.cc:237] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "384ae745f6a64bccbfa00b1d5da5973a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 40845 } } peers { permanent_uuid: "07f337760bdb444c898439b371d05ad6" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 33791 } } peers { permanent_uuid: "d19afc8dd5774dc799ce6d7a561629da" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37125 } }
I20260811 08:18:09.705935 24182 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37125 } attempt: 3
Aug 11 08:18:09 dist-test-slave-gkw7 krb5kdc[23942](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786436289, etypes {rep=17 tkt=17 ses=17}, kudu/127.20.158.189@KRBTEST.COM for kudu/127.20.158.188@KRBTEST.COM
I20260811 08:18:09.716707 24369 sys_catalog.cc:455] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 384ae745f6a64bccbfa00b1d5da5973a. Latest consensus state: current_term: 1 leader_uuid: "384ae745f6a64bccbfa00b1d5da5973a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "384ae745f6a64bccbfa00b1d5da5973a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 40845 } } peers { permanent_uuid: "07f337760bdb444c898439b371d05ad6" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 33791 } } peers { permanent_uuid: "d19afc8dd5774dc799ce6d7a561629da" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37125 } } }
I20260811 08:18:09.717003 24369 sys_catalog.cc:458] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a [sys.catalog]: This master's current role is: LEADER
I20260811 08:18:09.717279 24330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.706820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35246 (local address 127.20.158.188:37125)
0811 08:18:09.706867 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:09.706869 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:09.706878 (+ 9us) server_negotiation.cc:407] Connection header received
0811 08:18:09.706951 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:09.706952 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:09.706976 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:09.707022 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:09.707391 (+ 369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.708204 (+ 813us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.709277 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.709641 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.709703 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:09.712490 (+ 2787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:09.712492 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:09.712493 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:09.712500 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:09.714454 (+ 1954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.715122 (+ 668us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.715123 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.715124 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.715206 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.715496 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.715497 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.715497 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.715662 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:09.715731 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:09.717084 (+ 1353us) server_negotiation.cc:299] Negotiation successful
0811 08:18:09.717182 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260811 08:18:09.717425 24188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.706695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.20.158.188:37125 (local address 127.0.0.1:35246)
0811 08:18:09.706797 (+ 102us) negotiation.cc:107] Waiting for socket to connect
0811 08:18:09.706808 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0811 08:18:09.706862 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0811 08:18:09.707070 (+ 208us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0811 08:18:09.707071 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0811 08:18:09.707257 (+ 186us) client_negotiation.cc:189] Negotiated authn=SASL
0811 08:18:09.707307 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:09.707309 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.708325 (+ 1016us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.708327 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:09.709164 (+ 837us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0811 08:18:09.709166 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.709774 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.709775 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0811 08:18:09.709849 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:09.710627 (+ 778us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0811 08:18:09.710633 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0811 08:18:09.712388 (+ 1755us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0811 08:18:09.714794 (+ 2406us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:09.714796 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:09.714796 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:09.715041 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:09.715308 (+ 267us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0811 08:18:09.715309 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0811 08:18:09.715309 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0811 08:18:09.715382 (+ 73us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0811 08:18:09.715762 (+ 380us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0811 08:18:09.715763 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0811 08:18:09.715810 (+ 47us) client_negotiation.cc:769] Sending connection context
0811 08:18:09.715873 (+ 63us) client_negotiation.cc:240] Negotiation successful
0811 08:18:09.715977 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":81}
I20260811 08:18:09.719208 24182 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07f337760bdb444c898439b371d05ad6: Bootstrap starting.
I20260811 08:18:09.719991 24182 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07f337760bdb444c898439b371d05ad6: Neither blocks nor log segments found. Creating new log.
I20260811 08:18:09.720304 24182 log.cc:824] T 00000000000000000000000000000000 P 07f337760bdb444c898439b371d05ad6: Log is configured to *not* fsync() on all Append() calls
I20260811 08:18:09.725699 24381 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260811 08:18:09.726012 24381 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260811 08:18:09.727955 24193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.710113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43580 (local address 127.20.158.189:33791)
0811 08:18:09.710161 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:09.710163 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:09.710796 (+ 633us) server_negotiation.cc:407] Connection header received
0811 08:18:09.710883 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:09.710884 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:09.710894 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:09.710924 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:09.711731 (+ 807us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.712464 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.713823 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.714147 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.714189 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:09.722637 (+ 8448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:09.722638 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:09.722639 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:09.722647 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:09.724832 (+ 2185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.726567 (+ 1735us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.726568 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.726569 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.726636 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.726926 (+ 290us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.726927 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.726927 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.727088 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:09.727171 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:09.727770 (+ 599us) server_negotiation.cc:299] Negotiation successful
0811 08:18:09.727861 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260811 08:18:09.729372 24182 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07f337760bdb444c898439b371d05ad6: No bootstrap required, opened a new log
I20260811 08:18:09.729940 24329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.710418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35258 (local address 127.20.158.188:37125)
0811 08:18:09.710528 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:09.710530 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:09.717922 (+ 7392us) server_negotiation.cc:407] Connection header received
0811 08:18:09.718095 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:09.718096 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:09.718110 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:09.718141 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:09.719153 (+ 1012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.719857 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.722266 (+ 2409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.722610 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.722651 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:09.724999 (+ 2348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:09.725001 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:09.725002 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:09.725009 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:09.726839 (+ 1830us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.729054 (+ 2215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.729056 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.729056 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.729123 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.729324 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.729325 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.729325 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.729449 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:09.729520 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:09.729763 (+ 243us) server_negotiation.cc:299] Negotiation successful
0811 08:18:09.729848 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260811 08:18:09.731527 24182 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07f337760bdb444c898439b371d05ad6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "384ae745f6a64bccbfa00b1d5da5973a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 40845 } } peers { permanent_uuid: "07f337760bdb444c898439b371d05ad6" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 33791 } } peers { permanent_uuid: "d19afc8dd5774dc799ce6d7a561629da" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37125 } }
I20260811 08:18:09.731663 24182 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07f337760bdb444c898439b371d05ad6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07f337760bdb444c898439b371d05ad6, State: Initialized, Role: FOLLOWER
I20260811 08:18:09.731745 24182 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07f337760bdb444c898439b371d05ad6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "384ae745f6a64bccbfa00b1d5da5973a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 40845 } } peers { permanent_uuid: "07f337760bdb444c898439b371d05ad6" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 33791 } } peers { permanent_uuid: "d19afc8dd5774dc799ce6d7a561629da" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37125 } }
I20260811 08:18:09.732098 24182 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07f337760bdb444c898439b371d05ad6 [sys.catalog]: configured and running, proceeding with master startup.
I20260811 08:18:09.732064 24385 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07f337760bdb444c898439b371d05ad6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "384ae745f6a64bccbfa00b1d5da5973a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 40845 } } peers { permanent_uuid: "07f337760bdb444c898439b371d05ad6" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 33791 } } peers { permanent_uuid: "d19afc8dd5774dc799ce6d7a561629da" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37125 } } }
I20260811 08:18:09.732156 24385 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07f337760bdb444c898439b371d05ad6 [sys.catalog]: This master's current role is: FOLLOWER
W20260811 08:18:09.734061 24405 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 07f337760bdb444c898439b371d05ad6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260811 08:18:09.734122 24405 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260811 08:18:09.733501 24143 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "384ae745f6a64bccbfa00b1d5da5973a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "07f337760bdb444c898439b371d05ad6"
I20260811 08:18:09.734215 24143 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07f337760bdb444c898439b371d05ad6 [term 0 FOLLOWER]: Advancing to term 1
I20260811 08:18:09.735033 24073 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:09.710269 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60558 (local address 127.20.158.190:40845)
0811 08:18:09.710327 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:09.710329 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:09.711957 (+ 1628us) server_negotiation.cc:407] Connection header received
0811 08:18:09.711988 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:09.711989 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:09.712001 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:09.712058 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:09.716129 (+ 4071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.716912 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.721826 (+ 4914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:09.722141 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:09.722187 (+ 46us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:09.725309 (+ 3122us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0811 08:18:09.725311 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0811 08:18:09.725311 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0811 08:18:09.725320 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0811 08:18:09.728099 (+ 2779us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.733950 (+ 5851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.733951 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.733952 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.734027 (+ 75us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0811 08:18:09.734412 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0811 08:18:09.734413 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0811 08:18:09.734414 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0811 08:18:09.734563 (+ 149us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0811 08:18:09.734654 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:09.734851 (+ 197us) server_negotiation.cc:299] Negotiation successful
0811 08:18:09.734939 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260811 08:18:09.735162 24143 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 07f337760bdb444c898439b371d05ad6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 384ae745f6a64bccbfa00b1d5da5973a in term 1.
I20260811 08:18:09.736758 24268 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d19afc8dd5774dc799ce6d7a561629da [term 1 FOLLOWER]: Refusing update from remote peer 384ae745f6a64bccbfa00b1d5da5973a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:18:09.737074 24369 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a [LEADER]: Connected to new peer: Peer: permanent_uuid: "d19afc8dd5774dc799ce6d7a561629da" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:18:09.737620 24143 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 07f337760bdb444c898439b371d05ad6 [term 1 FOLLOWER]: Refusing update from remote peer 384ae745f6a64bccbfa00b1d5da5973a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260811 08:18:09.737864 24369 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a [LEADER]: Connected to new peer: Peer: permanent_uuid: "07f337760bdb444c898439b371d05ad6" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 33791 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260811 08:18:09.738500 24348 sys_catalog.cc:455] T 00000000000000000000000000000000 P d19afc8dd5774dc799ce6d7a561629da [sys.catalog]: SysCatalogTable state changed. Reason: New leader 384ae745f6a64bccbfa00b1d5da5973a. Latest consensus state: current_term: 1 leader_uuid: "384ae745f6a64bccbfa00b1d5da5973a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "384ae745f6a64bccbfa00b1d5da5973a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 40845 } } peers { permanent_uuid: "07f337760bdb444c898439b371d05ad6" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 33791 } } peers { permanent_uuid: "d19afc8dd5774dc799ce6d7a561629da" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37125 } } }
I20260811 08:18:09.738610 24348 sys_catalog.cc:458] T 00000000000000000000000000000000 P d19afc8dd5774dc799ce6d7a561629da [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:18:09.738972 24385 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07f337760bdb444c898439b371d05ad6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 384ae745f6a64bccbfa00b1d5da5973a. Latest consensus state: current_term: 1 leader_uuid: "384ae745f6a64bccbfa00b1d5da5973a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "384ae745f6a64bccbfa00b1d5da5973a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 40845 } } peers { permanent_uuid: "07f337760bdb444c898439b371d05ad6" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 33791 } } peers { permanent_uuid: "d19afc8dd5774dc799ce6d7a561629da" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37125 } } }
I20260811 08:18:09.739086 24385 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07f337760bdb444c898439b371d05ad6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:18:09.740012 24369 sys_catalog.cc:455] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "384ae745f6a64bccbfa00b1d5da5973a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "384ae745f6a64bccbfa00b1d5da5973a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 40845 } } peers { permanent_uuid: "07f337760bdb444c898439b371d05ad6" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 33791 } } peers { permanent_uuid: "d19afc8dd5774dc799ce6d7a561629da" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37125 } } }
I20260811 08:18:09.740114 24369 sys_catalog.cc:458] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a [sys.catalog]: This master's current role is: LEADER
I20260811 08:18:09.740490 24385 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07f337760bdb444c898439b371d05ad6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "384ae745f6a64bccbfa00b1d5da5973a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "384ae745f6a64bccbfa00b1d5da5973a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 40845 } } peers { permanent_uuid: "07f337760bdb444c898439b371d05ad6" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 33791 } } peers { permanent_uuid: "d19afc8dd5774dc799ce6d7a561629da" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37125 } } }
I20260811 08:18:09.740571 24385 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07f337760bdb444c898439b371d05ad6 [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:18:09.740773 24384 mvcc.cc:205] Tried to move back new op lower bound from 7317243042758352896 to 7317243042632167424. Current Snapshot: MvccSnapshot[applied={T|T < 7317243042758352896}]
I20260811 08:18:09.741991 24413 mvcc.cc:205] Tried to move back new op lower bound from 7317243042758352896 to 7317243042632167424. Current Snapshot: MvccSnapshot[applied={T|T < 7317243042758352896}]
I20260811 08:18:09.742358 24333 sys_catalog.cc:455] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "384ae745f6a64bccbfa00b1d5da5973a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "384ae745f6a64bccbfa00b1d5da5973a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 40845 } } peers { permanent_uuid: "07f337760bdb444c898439b371d05ad6" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 33791 } } peers { permanent_uuid: "d19afc8dd5774dc799ce6d7a561629da" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37125 } } }
I20260811 08:18:09.742442 24333 sys_catalog.cc:458] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a [sys.catalog]: This master's current role is: LEADER
I20260811 08:18:09.742853 24348 sys_catalog.cc:455] T 00000000000000000000000000000000 P d19afc8dd5774dc799ce6d7a561629da [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "384ae745f6a64bccbfa00b1d5da5973a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "384ae745f6a64bccbfa00b1d5da5973a" member_type: VOTER last_known_addr { host: "127.20.158.190" port: 40845 } } peers { permanent_uuid: "07f337760bdb444c898439b371d05ad6" member_type: VOTER last_known_addr { host: "127.20.158.189" port: 33791 } } peers { permanent_uuid: "d19afc8dd5774dc799ce6d7a561629da" member_type: VOTER last_known_addr { host: "127.20.158.188" port: 37125 } } }
I20260811 08:18:09.742949 24348 sys_catalog.cc:458] T 00000000000000000000000000000000 P d19afc8dd5774dc799ce6d7a561629da [sys.catalog]: This master's current role is: FOLLOWER
I20260811 08:18:09.743032 24411 mvcc.cc:205] Tried to move back new op lower bound from 7317243042758352896 to 7317243042632167424. Current Snapshot: MvccSnapshot[applied={T|T < 7317243042758352896}]
I20260811 08:18:09.743585 24381 catalog_manager.cc:1347] Generated new cluster ID: 1119fc4de31940168cae100236721533
I20260811 08:18:09.743639 24381 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260811 08:18:09.760757 24381 catalog_manager.cc:1370] Generated new certificate authority record
I20260811 08:18:09.761585 24381 catalog_manager.cc:1504] Loading token signing keys...
I20260811 08:18:09.766398 24381 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 384ae745f6a64bccbfa00b1d5da5973a: Generated new TSK 0
I20260811 08:18:09.766594 24381 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260811 08:18:09.794463 24073 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:18:09.792771 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60574 (local address 127.20.158.190:40845)
0811 08:18:09.792819 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:09.792822 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:09.793765 (+ 943us) server_negotiation.cc:407] Connection header received
0811 08:18:09.793878 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:09.793879 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:09.793891 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:09.793923 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:09.794385 (+ 462us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60574: BlockingRecv error: recv got EOF from 127.0.0.1:60574 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 08:18:09.795449 24193 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:18:09.793154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43592 (local address 127.20.158.189:33791)
0811 08:18:09.793196 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:09.793197 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:09.794721 (+ 1524us) server_negotiation.cc:407] Connection header received
0811 08:18:09.794827 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:09.794828 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:09.794845 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:09.794875 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:09.795199 (+ 324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43592: BlockingRecv error: recv got EOF from 127.0.0.1:43592 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 08:18:09.796288 24329 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:18:09.793440 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35270 (local address 127.20.158.188:37125)
0811 08:18:09.793479 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:09.793481 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:09.795683 (+ 2202us) server_negotiation.cc:407] Connection header received
0811 08:18:09.795844 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:09.795845 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:09.795855 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:09.795884 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:09.796229 (+ 345us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:35270: BlockingRecv error: recv got EOF from 127.0.0.1:35270 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 08:18:09.798725 24193 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:18:09.797938 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43600 (local address 127.20.158.189:33791)
0811 08:18:09.797984 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:09.797986 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:09.798176 (+ 190us) server_negotiation.cc:407] Connection header received
0811 08:18:09.798296 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:09.798297 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:09.798317 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:09.798346 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:09.798674 (+ 328us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43600: BlockingRecv error: recv got EOF from 127.0.0.1:43600 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260811 08:18:09.802008 24193 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:18:09.801025 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43604 (local address 127.20.158.189:33791)
0811 08:18:09.801064 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:09.801066 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:09.801403 (+ 337us) server_negotiation.cc:407] Connection header received
0811 08:18:09.801497 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:09.801498 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:09.801508 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:09.801587 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:09.801955 (+ 368us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43604: BlockingRecv error: recv got EOF from 127.0.0.1:43604 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260811 08:18:09.806248 24193 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:18:09.805303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43614 (local address 127.20.158.189:33791)
0811 08:18:09.805340 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:09.805342 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:09.805630 (+ 288us) server_negotiation.cc:407] Connection header received
0811 08:18:09.805736 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:09.805737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:09.805749 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:09.805779 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:09.806195 (+ 416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43614: BlockingRecv error: recv got EOF from 127.0.0.1:43614 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260811 08:18:09.812484 24193 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:18:09.811583 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43618 (local address 127.20.158.189:33791)
0811 08:18:09.811627 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:09.811629 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:09.811899 (+ 270us) server_negotiation.cc:407] Connection header received
0811 08:18:09.812003 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:09.812004 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:09.812016 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:09.812047 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:09.812425 (+ 378us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43618: BlockingRecv error: recv got EOF from 127.0.0.1:43618 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260811 08:18:09.823015 24193 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:18:09.822015 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43632 (local address 127.20.158.189:33791)
0811 08:18:09.822062 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:09.822065 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:09.822351 (+ 286us) server_negotiation.cc:407] Connection header received
0811 08:18:09.822468 (+ 117us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:09.822469 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:09.822481 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:09.822524 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:09.822957 (+ 433us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43632: BlockingRecv error: recv got EOF from 127.0.0.1:43632 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260811 08:18:09.841697 24193 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:18:09.840574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43634 (local address 127.20.158.189:33791)
0811 08:18:09.840625 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:09.840628 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:09.840964 (+ 336us) server_negotiation.cc:407] Connection header received
0811 08:18:09.841093 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:09.841095 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:09.841110 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:09.841145 (+ 35us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:09.841633 (+ 488us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43634: BlockingRecv error: recv got EOF from 127.0.0.1:43634 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260811 08:18:09.876396 24193 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:18:09.875309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43648 (local address 127.20.158.189:33791)
0811 08:18:09.875365 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:09.875367 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:09.875679 (+ 312us) server_negotiation.cc:407] Connection header received
0811 08:18:09.875795 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:09.875796 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:09.875812 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:09.875843 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:09.876328 (+ 485us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43648: BlockingRecv error: recv got EOF from 127.0.0.1:43648 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
W20260811 08:18:09.942708 24193 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:18:09.942059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43662 (local address 127.20.158.189:33791)
0811 08:18:09.942123 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:09.942125 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:09.942213 (+ 88us) server_negotiation.cc:407] Connection header received
0811 08:18:09.942258 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:09.942259 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:09.942271 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:09.942325 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:09.942646 (+ 321us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43662: BlockingRecv error: recv got EOF from 127.0.0.1:43662 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260811 08:18:10.072888 24193 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:18:10.072079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43672 (local address 127.20.158.189:33791)
0811 08:18:10.072203 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:10.072205 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:10.072278 (+ 73us) server_negotiation.cc:407] Connection header received
0811 08:18:10.072355 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:10.072356 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:10.072367 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:10.072416 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:10.072813 (+ 397us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43672: BlockingRecv error: recv got EOF from 127.0.0.1:43672 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
W20260811 08:18:10.330955 24193 negotiation.cc:337] Failed RPC negotiation. Trace:
0811 08:18:10.330327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43686 (local address 127.20.158.189:33791)
0811 08:18:10.330417 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:10.330419 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:10.330430 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:18:10.330460 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:10.330461 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:10.330472 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:10.330546 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0811 08:18:10.330901 (+ 355us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43686: BlockingRecv error: recv got EOF from 127.0.0.1:43686 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
I20260811 08:18:10.688503 24367 catalog_manager.cc:1259] Loaded cluster ID: 1119fc4de31940168cae100236721533
I20260811 08:18:10.688584 24367 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d19afc8dd5774dc799ce6d7a561629da: loading cluster ID for follower catalog manager: success
I20260811 08:18:10.689510 24367 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d19afc8dd5774dc799ce6d7a561629da: acquiring CA information for follower catalog manager: success
I20260811 08:18:10.689867 24367 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d19afc8dd5774dc799ce6d7a561629da: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 08:18:10.734568 24405 catalog_manager.cc:1259] Loaded cluster ID: 1119fc4de31940168cae100236721533
I20260811 08:18:10.734651 24405 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 07f337760bdb444c898439b371d05ad6: loading cluster ID for follower catalog manager: success
I20260811 08:18:10.735442 24405 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 07f337760bdb444c898439b371d05ad6: acquiring CA information for follower catalog manager: success
I20260811 08:18:10.735709 24405 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 07f337760bdb444c898439b371d05ad6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260811 08:18:10.847090 24528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:10.844195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43688 (local address 127.20.158.189:33791)
0811 08:18:10.844335 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:10.844338 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:10.844388 (+ 50us) server_negotiation.cc:407] Connection header received
0811 08:18:10.844478 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:10.844479 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:10.844556 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:10.844648 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:18:10.844816 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:10.845334 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:10.846195 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:10.846422 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:10.846504 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:10.846699 (+ 195us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:18:10.846831 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:18:10.846917 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:10.846967 (+ 50us) server_negotiation.cc:299] Negotiation successful
0811 08:18:10.846991 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":66,"threads_started":1}
I20260811 08:18:10.851413 24537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:10.848993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35284 (local address 127.20.158.188:37125)
0811 08:18:10.849175 (+ 182us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:10.849177 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:10.849187 (+ 10us) server_negotiation.cc:407] Connection header received
0811 08:18:10.849226 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:10.849226 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:10.849264 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:10.849342 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:18:10.849451 (+ 109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:10.850014 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:10.850708 (+ 694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:10.850907 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:10.850969 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:10.851118 (+ 149us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:18:10.851223 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:18:10.851282 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:10.851333 (+ 51us) server_negotiation.cc:299] Negotiation successful
0811 08:18:10.851351 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158,"thread_start_us":58,"threads_started":1}
I20260811 08:18:10.856276 24528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:10.853317 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43698 (local address 127.20.158.189:33791)
0811 08:18:10.853365 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:10.853366 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:10.853501 (+ 135us) server_negotiation.cc:407] Connection header received
0811 08:18:10.853624 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:10.853625 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:10.853637 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:10.853679 (+ 42us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:18:10.853834 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:10.854323 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:10.855427 (+ 1104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:10.855675 (+ 248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:10.855732 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:10.855945 (+ 213us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:18:10.855984 (+ 39us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:18:10.856054 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:10.856158 (+ 104us) server_negotiation.cc:299] Negotiation successful
0811 08:18:10.856181 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260811 08:18:10.856280 24537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:10.853607 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35298 (local address 127.20.158.188:37125)
0811 08:18:10.853644 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:10.853645 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:10.853653 (+ 8us) server_negotiation.cc:407] Connection header received
0811 08:18:10.853702 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:10.853703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:10.853713 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:10.853761 (+ 48us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:18:10.853886 (+ 125us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:10.854572 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:10.855364 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:10.855667 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:10.855730 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:10.855950 (+ 220us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:18:10.856009 (+ 59us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:18:10.856043 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:10.856153 (+ 110us) server_negotiation.cc:299] Negotiation successful
0811 08:18:10.856176 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260811 08:18:10.856555 24548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0811 08:18:10.853167 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60578 (local address 127.20.158.190:40845)
0811 08:18:10.853296 (+ 129us) server_negotiation.cc:206] Beginning negotiation
0811 08:18:10.853298 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0811 08:18:10.853309 (+ 11us) server_negotiation.cc:407] Connection header received
0811 08:18:10.853355 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0811 08:18:10.853356 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0811 08:18:10.853431 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0811 08:18:10.853520 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0811 08:18:10.853718 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:10.854524 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:10.855502 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0811 08:18:10.855807 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0811 08:18:10.855883 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0811 08:18:10.856075 (+ 192us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0811 08:18:10.856184 (+ 109us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0811 08:18:10.856339 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0811 08:18:10.856429 (+ 90us) server_negotiation.cc:299] Negotiation successful
0811 08:18:10.856462 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":81,"threads_started":1}
I20260811 08:18:10.858215 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 23964
I20260811 08:18:10.871577 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 24081
I20260811 08:18:10.885819 21114 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgBR4MD/build/release/bin/kudu with pid 24202
2026-08-11T08:18:10Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (3105 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (6143 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (287063 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST